Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1XMz5N-0008Q6-2o for pgsql-jdbc@arkaria.postgresql.org; Thu, 28 Aug 2014 12:45:53 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1XMz5L-00053e-OO for pgsql-jdbc@arkaria.postgresql.org; Thu, 28 Aug 2014 12:45:51 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1XMz5K-00053X-N5 for pgsql-jdbc@postgresql.org; Thu, 28 Aug 2014 12:45:50 +0000 Received: from post.officenet.no ([195.225.13.103]) by magus.postgresql.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:256) (Exim 4.80) (envelope-from ) id 1XMz5G-0003Cc-Ge for pgsql-jdbc@postgresql.org; Thu, 28 Aug 2014 12:45:49 +0000 Received: from [10.47.1.10] (helo=tc7-on) by post.officenet.no with esmtp (Exim 4.76) (envelope-from ) id 1XMz5C-0002eB-2X for pgsql-jdbc@postgresql.org; Thu, 28 Aug 2014 14:45:45 +0200 Received: from localhost ([127.0.0.1] helo=tc7-on) by tc7-on with esmtp (Exim 4.76) (envelope-from ) id 1XMz4t-00087D-UM for pgsql-jdbc@postgresql.org; Thu, 28 Aug 2014 14:45:23 +0200 Date: Thu, 28 Aug 2014 14:45:23 +0200 (CEST) From: Andreas Joseph Krogh To: pgsql-jdbc@postgresql.org Message-ID: In-Reply-To: Subject: Re: invalid byte sequence for encoding "UTF8": 0x00 MIME-Version: 1.0 X-Mailer: Visena Mail 1.9.0-SNAPSHOT X-Spam-Score: 0.0 X-Spam-Report: SpamAssasin (score=0.0, required 5.0 ALL_TRUSTED=-1, HTML_IMAGE_ONLY_20=0.7, HTML_MESSAGE=0.001, HTML_SHORT_LINK_IMG_3=0.328) X-Pg-Spam-Score: -0.2 (/) Content-Type: multipart/related; boundary="----=_Part_631_958208432.1409229923437" List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-jdbc Precedence: bulk Sender: pgsql-jdbc-owner@postgresql.org ------=_Part_630_1759493546.1409229923437 Content-Type: multipart/related; boundary="----=_Part_631_958208432.1409229923437" ------=_Part_631_958208432.1409229923437 Content-Type: multipart/alternative; boundary="----=_Part_632_718354993.1409229923464" ------=_Part_632_718354993.1409229923464 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable P=C3=A5 onsdag 27. august 2014 kl. 10:11:09, skrev Albe Laurenz < laurenz.albe@wien.gv.at >: JasmineLiu wrote= : > I've also got this problem while copy or insert data from MS SQL Server = to > PostgreSQL. > SQLServer 2008 R2, encoding :GBK > PostgreSQL 9.3.4, encoding:UTF8 > > Rather than modify the column value in sql server, > are=C2=A0 there any other ways to solve this problem? > Better to give me an=C2=A0 examples. You will never be able to insert a null character into a PostgreSQL databa= se. You can either modify the source data or change the data in transit. =C2= =A0 This=20 is not 100% true, but is true for text-fields. Youcan insert \0 into BYTEA= =20 columns. =C2=A0 =C2=A0 Usually the \0 isn't important so you can do this in= JAVA before=20 inserting into PG: =C2=A0 someString.replace('\0', ' ') or=20 someString.replaceAll("\0", "") =C2=A0 =C2=A0 -- Andreas Joseph Krogh CTO /= Partner -=20 Visena AS Mobile: +47 909 56 963 andreas@visena.com =20 www.visena.com =C2=A0 ------=_Part_632_718354993.1409229923464 Content-Type: text/html;charset=UTF-8 Content-Transfer-Encoding: quoted-printable
P=C3=A5 onsdag 27. august 2014 kl. 10:11:09, skrev Albe Laurenz <laurenz.albe@wien.gv.at>:
Jas= mineLiu wrote:
> I've also got this problem while copy or insert data from MS SQL Serve= r to
> PostgreSQL.
> SQLServer 2008 R2, encoding :GBK
> PostgreSQL 9.3.4, encoding:UTF8
>
> Rather than modify the column value in sql server,
> are=C2=A0 there any other ways to solve this problem?
> Better to give me an=C2=A0 examples.

You will never be able to insert a null character into a PostgreSQL databas= e.
You can either modify the source data or change the data in transit.
=C2=A0
This is not 100% true, but is true for text-fields. You can i= nsert \0 into BYTEA columns.
=C2=A0
=C2=A0
Usually the \0 isn't important so you can do this in JAVA before inser= ting into PG:
=C2=A0
someString.replace('\0', ' ') or someString.replaceAll("\0",= "")
=C2=A0
=C2=A0
--
Andrea= s Joseph Krogh
CTO / Partner<= /span> - Visena AS
Mobile: +47 90= 9 56 963
=3D""
=C2=A0
------=_Part_632_718354993.1409229923464-- ------=_Part_631_958208432.1409229923437 Content-Type: image/png Content-Transfer-Encoding: base64 Content-Disposition: inline Content-ID: iVBORw0KGgoAAAANSUhEUgAAAIUAAAAYCAYAAADUIj6hAAAABHNCSVQICAgIfAhkiAAABzBJREFU aEPtmNFxHDcMhmVP3i1VECpvnjzkVIHWFfhcgVcVRKrAUgWRK/C6Al8H3lTgy0PGbzFdQc4VJP/H ADs43q6kROeJNbOYgQACIAgCWJKng4MZ5gxUGXh0U0b+SIuF9G+EWXj2Q15vbrE/NPtk9uub7Gfd t5mBx1NhqSEo8HshjbEUtlO2yIM9tsx5dZP9rPt2MzDZFAqZE4LGcFjdsg3saQaHt7fY70X949On aS+OZidDBkavD33157L4xaw2os+Mp/DAC10l2XhOCeStj0W5ajrJL8WfCi80Xgf9vVlrhg9yRONe /f7xI2vNsIcM7JwU9o6oGyJrLT8JOA1aX9sKP4wl94bAniukEbo/n7YPmuTETzIab4Y9ZWCrKexd 8M58lxPCvvD6aihfvexbEQoPYO8NQRO0JnddGO6FJYaVsBde7cXj7KRk4LsqDxQzCYeGsJNgaXZe +JXkyGgWINq3Gp+bHNILz+wEYs5qH1eJrouNrpDXtk4O6x1IvtD40GWyJYYdkF0jIbYZlN16xygI gl9smbMDsmFdfAKb23xGB8H/mv3tOJfArs1kukk79DEPdQ5u0g1vCvvqKXIW8mZYW+F3Tg4r8HvZ kQCCLydK8EFMQCe5N8RgL9mRG0SqQFuNvdE6beSs0qPDBuCdg0+gvClso8SbTO4ki7mQzQqBrcMH QPwReg2wW8umEe/+L8T/LEzBGF9nXjzZ46s+ITHvhegW8LL39xm6App7KYL/GE+vcYnFbJiP/0aY hdiCnRC7jaj7eiK2ETInC5PRF6LYkSN0+HabF75WuT6syCyI0YkVGGMvUC33AmfZTDUEj8u6IVhu EhRUJ2U2g6UlugyNb03Hl9obHwlxJbcRzcYjO4QPjVfGFTQav4vrmp7cpMp2qbHnBxWJbisbho2Q XI6C1sIHDUFhH4Hij4UbIev66eANeiwbkA+LBsO36zAHzoXU7AhbqLAXEiOYTXcSdO8VS9L4wN8U BIYhBd6oSUgYMijOkecRuTdQa/YiBXhbXFcnCnI2SrfeBG9NydrLYMhGHa5qB9pQIxlzAE6Okjzx JO5afGe6kmhBicWKQNKuTZ5EW+MjQY8v/9rQ0bhJSJyNGUe/JH1t8h1iMbdSPAvxHYin6YmN9YBX QmTYZZNh14vHhhhal5vtcIrJjmvszPRJdExH3MWHvykoBEc9CoCGWJisOLOGoCORs1FvIMbYA8z3 kwM59oemy6LlWrLxFLmWgiQAfEGd8S+NssbK+EhyGLxUkhhiy717waBqHOJYSEacwBejkFNhjJNj v/gANOdQxPfciP/JVBCK2cOIcg3RRJ+CPrLPNVhhN6F38VKMF3XLlIJrjU5C8gMFxvKDvOcPc4rV NjCn7KM0BV+161V8viSCuJZ8SITGJGEh7IUUlxOFMYUH1kJOCN4Wh+I5pqCuK01k40kSNtnKiKIl UfxAgW5sU5JlS05rtt5YFJF1SWoqHv6BRgQcA4/bdb9WRjmMk3jyUMAbIoyJq9e4cVmgzKt9j5gN J/aYDhk+hhjExwaPcz5PObA5Zd9bvz5UzCTZuZDidu5AchpiKSwPR+TV1bCWqBQ9nCjJ5neivC82 Nr4LeS2j1gw5LUqwBuhGQQU5UwHeSslXkwIynz2U2A2yKDgG7OffwLA3TpGRpk0Tzpj3ZEJXi/GR a6GN0e0NtppChePdcAz1FTS+FN8Kpxoiykk+J8fC5tenjbu9kSqpHLu9jBrhUuhNwVGbpyZrzrl0 HPVD8SXj5EOOD/eDC64VjvYBZLuUbIVAfBN1t/C/SU+cAGtdGo+fVnzycUX5wmn6eCKPmWYJG2E/ ppTsuRCbvUD9fwquksG5GqLVKhzDQ3GrEyLKSXhsiK3T5j9EyxffCFOYi2wUlPyFFDQAhehESDjQ GoX0ho0oj8RPou6TxHJdcT0NTcWkO0AnG7+uXsnHqcas/72wvWF+mSf7N/Watp9kTXoluzeS0fB9 9CcZ/hvhSZTfh99pispZOXL9KrGrARkNUMu9ITbScZWs7xOYNt9pwxSZtYDsX/GE3xTkrXgwAsXm fud08FiTeC+m2/o7ppo+PTS/NBK5ARpDG5YHr++DpmVfreYdiX8mnp+DzPEG9WbqJON0JBenZofs sxBA1gj5NXGvfJu/Qh7HwQh/VDUEyUxCit5hH94QfKkEdu+GwK8BX0hvCF+D67xhjmXQCXMwJCZ+ olK0A1EKRCE4snsh42w8Mv/Zhxw9iD7Cjo7CyQC/KyF6oBfShL4PYgG+CHsYKyZxvxZSZBAgjhIz YDz+AbfD37GtbaoSKzgGt+lKfI/GZtay6vG4VXTpPsh+IcQhOk9I7WYeP5AM3HZ9+DaSGIp9HIuu huC4pCGGx+YD2fcc5tfIAA0h/Et4/jX8zz4fWAasIf4UbR9Y6HO4d8jAnd4U0Y8ageuCB+c+H5R3 CHU2mTMwZ+B/y8DfSMBLLOYXVuEAAAAASUVORK5CYII= ------=_Part_631_958208432.1409229923437-- ------=_Part_630_1759493546.1409229923437--