Received: from malur.postgresql.org ([217.196.149.56])
 by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from
 <pgsql-admin-owner+M42811=pgsql+2Dadmin=arkaria.postgresql.org@postgresql.org>)
 id 1XNAhJ-0004sO-9B
 for pgsql-admin@arkaria.postgresql.org; Fri, 29 Aug 2014 01:09:49 +0000
Received: from localhost ([127.0.0.1] helo=postgresql.org)
 by malur.postgresql.org with smtp (Exim 4.80) (envelope-from
 <pgsql-admin-owner+M42811=pgsql+2Dadmin=arkaria.postgresql.org@postgresql.org>)
 id 1XNAhH-0000f5-Fm
 for pgsql-admin@arkaria.postgresql.org; Fri, 29 Aug 2014 01:09:47 +0000
Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29])
 by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256)
 (Exim 4.80) (envelope-from <liuyuanyuangogo@gmail.com>)
 id 1XNAhG-0000ex-5u
 for pgsql-admin@postgresql.org; Fri, 29 Aug 2014 01:09:46 +0000
Received: from mail-pa0-x22d.google.com ([2607:f8b0:400e:c03::22d])
 by magus.postgresql.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.80) (envelope-from <liuyuanyuangogo@gmail.com>)
 id 1XNAhB-0000OK-Sv
 for pgsql-admin@postgresql.org; Fri, 29 Aug 2014 01:09:44 +0000
Received: by mail-pa0-f45.google.com with SMTP id bj1so4784553pad.4
 for <pgsql-admin@postgresql.org>; Thu, 28 Aug 2014 18:09:38 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=from:to:cc:subject:date:message-id:mime-version:content-type
 :thread-index:content-language;
 bh=X6KD2/4lmTQhqEOxx0QVuydYmSTDXFGqGFh7M9m5DP4=;
 b=nyGR8/WgHTR6bJchcEJgtM+DDY2XJQXk2AwUENwvuFHlQZmKNGGF/Ae3nvfOb+T6FN
 +Lx3uAC1lkbgE78pWOTsxtMPenAJyj+ERAXEm8halXcGJG3f0w6B/OM70Z0vLvUTqkla
 bO75vh+Vrux9uImClpUL3oG7BvXzItZHwKKr6QDdDhnfey1b+1A9/fY0fKwYDZdEJNup
 F+PgHiGJ7PqKVo6yNJhdyoBsgLHEMyZLKhotaK/2kPXJOXzLFWr00Wnjk7AMggZk4lP0
 LI2neR+wg02RotRNAS1xfK/VKilB8FwVcS07EzI96dd1C1YBrCfi+u6SbfkWtvi1+zAp
 iiKA==
X-Received: by 10.66.141.165 with SMTP id rp5mr11032984pab.115.1409274578192;
 Thu, 28 Aug 2014 18:09:38 -0700 (PDT)
Received: from YuanyuanPC ([58.58.27.50])
 by mx.google.com with ESMTPSA id e11sm7493055pdm.47.2014.08.28.18.09.34
 for <multiple recipients>
 (version=TLSv1 cipher=ECDHE-RSA-AES128-SHA bits=128/128);
 Thu, 28 Aug 2014 18:09:37 -0700 (PDT)
From: "liuyuanyuan" <liuyuanyuangogo@gmail.com>
To: "'Andreas Joseph Krogh-2 [via PostgreSQL]'"
 <ml-node+s1045698n5816732h11@n5.nabble.com>
Cc: <pgsql-admin@postgresql.org>
Subject: Re: invalid byte sequence for encoding "UTF8": 0x00
Date: Fri, 29 Aug 2014 09:09:03 +0800
Message-ID: <001f01cfc325$d614fe20$823efa60$@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="----=_NextPart_000_0020_01CFC368.E43B4B60"
X-Mailer: Microsoft Outlook 15.0
Thread-Index: Ac/DJJM+VBzkbdRkQg2qJ1vbKUKxPw==
Content-Language: zh-cn
X-Pg-Spam-Score: 0.1 (/)
List-Archive: <http://archives.postgresql.org/pgsql-admin>
List-Help: <mailto:majordomo@postgresql.org?body=help>
List-ID: <pgsql-admin.postgresql.org>
List-Owner: <mailto:pgsql-admin-owner@postgresql.org>
List-Post: <mailto:pgsql-admin@postgresql.org>
List-Subscribe: <mailto:majordomo@postgresql.org?body=sub%20pgsql-admin>
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-admin>
X-Mailing-List: pgsql-admin
Precedence: bulk
Sender: pgsql-admin-owner@postgresql.org

This is a multipart message in MIME format.

------=_NextPart_000_0020_01CFC368.E43B4B60
Content-Type: text/plain;
	charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Thanks Andreas! =20

I like this clear answer!

My colleague and I have found about this in PostgreSQL source code, but =
we=E2=80=99re not so sure.

Thanks for your reply!

=20

Regards!

=20

Jasmine Liu

=20

=E5=8F=91=E4=BB=B6=E4=BA=BA: Andreas Joseph Krogh-2 [via PostgreSQL] =
[mailto:ml-node+s1045698n5816732h11@n5.nabble.com]=20
=E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4: 2014=E5=B9=B48=E6=9C=8828=E6=97=A5 =
20:46
=E6=94=B6=E4=BB=B6=E4=BA=BA: JasmineLiu
=E4=B8=BB=E9=A2=98: Re: invalid byte sequence for encoding "UTF8": 0x00

=20

P=C3=A5 onsdag 27. august 2014 kl. 10:11:09, skrev Albe Laurenz <[hidden =
email]>:

JasmineLiu wrote:
> I've also got this problem while copy or insert data from MS SQL =
Server to
> PostgreSQL.
> SQLServer 2008 R2, encoding :GBK
> PostgreSQL 9.3.4, encoding:UTF8
>
> Rather than modify the column value in sql server,
> are  there any other ways to solve this problem?
> Better to give me an  examples.

You will never be able to insert a null character into a PostgreSQL =
database.
You can either modify the source data or change the data in transit.

=20

This is not 100% true, but is true for text-fields. You can insert \0 =
into BYTEA columns.

=20

=20

Usually the \0 isn't important so you can do this in JAVA before =
inserting into PG:

=20

someString.replace('\0', ' ') or someString.replaceAll("\0", "")

=20

=20

--=20

Andreas Joseph Krogh

CTO / Partner - Visena AS

Mobile: +47 909 56 963

[hidden email]

www.visena.com <https://www.visena.com>=20

 <https://www.visena.com>=20

=20

=20

  _____ =20

If you reply to this email, your message will be added to the discussion =
below:

http://postgresql.1045698.n5.nabble.com/invalid-byte-sequence-for-encodin=
g-UTF8-0x00-tp2172080p5816732.html=20

To unsubscribe from invalid byte sequence for encoding "UTF8": 0x00, =
click here =
<http://postgresql.1045698.n5.nabble.com/template/NamlServlet.jtp?macro=3D=
unsubscribe_by_code&node=3D2172080&code=3DbGl1eXVhbnl1YW5nb2dvQGdtYWlsLmN=
vbXwyMTcyMDgwfDU1NzU2MzQ0MQ=3D=3D> .
 =
<http://postgresql.1045698.n5.nabble.com/template/NamlServlet.jtp?macro=3D=
macro_viewer&id=3Dinstant_html%21nabble%3Aemail.naml&base=3Dnabble.naml.n=
amespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.=
view.web.template.NodeNamespace&breadcrumbs=3Dnotify_subscribers%21nabble=
%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21n=
abble%3Aemail.naml> NAML=20


------=_NextPart_000_0020_01CFC368.E43B4B60
Content-Type: text/html;
	charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta =
http-equiv=3DContent-Type content=3D"text/html; charset=3Dutf-8"><meta =
name=3DGenerator content=3D"Microsoft Word 15 (filtered medium)"><!--[if =
!mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
	{font-family:=E5=AE=8B=E4=BD=93;
	panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:Tahoma;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
	{font-family:"\@=E5=AE=8B=E4=BD=93";
	panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
	{font-family:=E5=BE=AE=E8=BD=AF=E9=9B=85=E9=BB=91;
	panose-1:2 11 5 3 2 2 4 2 2 4;}
@font-face
	{font-family:"\@=E5=BE=AE=E8=BD=AF=E9=9B=85=E9=BB=91";
	panose-1:2 11 5 3 2 2 4 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0cm;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:=E5=AE=8B=E4=BD=93;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
span.EmailStyle19
	{mso-style-type:personal-reply;
	font-family:"Calibri","sans-serif";
	color:#1F497D;}
span.def
	{mso-style-name:def;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-family:"Calibri","sans-serif";}
@page WordSection1
	{size:612.0pt 792.0pt;
	margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DZH-CN link=3Dblue =
vlink=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal><span =
lang=3DEN-US =
style=3D'font-size:10.5pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Thanks </span><span lang=3DEN-US =
style=3D'font-size:9.0pt;font-family:"Arial","sans-serif";color:#434343'>=
Andreas! =C2=A0<o:p></o:p></span></p><p class=3DMsoNormal><span =
lang=3DEN-US =
style=3D'font-size:9.0pt;font-family:"Arial","sans-serif";color:#434343'>=
I like this clear answer!<o:p></o:p></span></p><p =
class=3DMsoNormal><span lang=3DEN-US =
style=3D'font-size:9.0pt;font-family:"Arial","sans-serif";color:#434343'>=
My <span class=3Ddef>colleague and I have found about this in PostgreSQL =
source code, but we=E2=80=99re not so sure.</span></span><span =
lang=3DEN-US =
style=3D'font-size:10.5pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US =
style=3D'font-size:10.5pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Thanks for your reply!<o:p></o:p></span></p><p =
class=3DMsoNormal><span lang=3DEN-US =
style=3D'font-size:10.5pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p>&nbsp;</o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US =
style=3D'font-size:10.5pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Regards!<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US =
style=3D'font-size:10.5pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p>&nbsp;</o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US =
style=3D'font-size:10.5pt;font-family:"Calibri","sans-serif";color:#1F497=
D'>Jasmine Liu<o:p></o:p></span></p><p class=3DMsoNormal><span =
lang=3DEN-US =
style=3D'font-size:10.5pt;font-family:"Calibri","sans-serif";color:#1F497=
D'><o:p>&nbsp;</o:p></span></p><p class=3DMsoNormal><b><span =
style=3D'font-size:11.0pt;font-family:"=E5=BE=AE=E8=BD=AF=E9=9B=85=E9=BB=91=
","sans-serif"'>=E5=8F=91=E4=BB=B6=E4=BA=BA<span =
lang=3DEN-US>:</span></span></b><span lang=3DEN-US =
style=3D'font-size:11.0pt;font-family:"=E5=BE=AE=E8=BD=AF=E9=9B=85=E9=BB=91=
","sans-serif"'> Andreas Joseph Krogh-2 [via PostgreSQL] =
[mailto:ml-node+s1045698n5816732h11@n5.nabble.com] <br></span><b><span =
style=3D'font-size:11.0pt;font-family:"=E5=BE=AE=E8=BD=AF=E9=9B=85=E9=BB=91=
","sans-serif"'>=E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4<span =
lang=3DEN-US>:</span></span></b><span lang=3DEN-US =
style=3D'font-size:11.0pt;font-family:"=E5=BE=AE=E8=BD=AF=E9=9B=85=E9=BB=91=
","sans-serif"'> 2014</span><span =
style=3D'font-size:11.0pt;font-family:"=E5=BE=AE=E8=BD=AF=E9=9B=85=E9=BB=91=
","sans-serif"'>=E5=B9=B4<span lang=3DEN-US>8</span>=E6=9C=88<span =
lang=3DEN-US>28</span>=E6=97=A5<span lang=3DEN-US> =
20:46<br></span><b>=E6=94=B6=E4=BB=B6=E4=BA=BA<span =
lang=3DEN-US>:</span></b><span lang=3DEN-US> =
JasmineLiu<br></span><b>=E4=B8=BB=E9=A2=98<span =
lang=3DEN-US>:</span></b><span lang=3DEN-US> Re: invalid byte sequence =
for encoding &quot;UTF8&quot;: 0x00<o:p></o:p></span></span></p><p =
class=3DMsoNormal><span lang=3DEN-US><o:p>&nbsp;</o:p></span></p><div><p =
class=3DMsoNormal><span lang=3DEN-US>P=C3=A5 onsdag 27. august 2014 kl. =
10:11:09, skrev Albe Laurenz &lt;<a =
href=3D"/user/SendEmail.jtp?type=3Dnode&amp;node=3D5816732&amp;i=3D0" =
target=3D"_top">[hidden =
email]</a>&gt;:<o:p></o:p></span></p></div><blockquote =
style=3D'border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm =
6.0pt;margin-left:4.8pt;margin-right:0cm'><div><p =
class=3DMsoNormal><span lang=3DEN-US =
style=3D'font-size:9.0pt;font-family:"Courier New"'>JasmineLiu =
wrote:<br>&gt; I've also got this problem while copy or insert data from =
MS SQL Server to<br>&gt; PostgreSQL.<br>&gt; SQLServer 2008 R2, encoding =
:GBK<br>&gt; PostgreSQL 9.3.4, encoding:UTF8<br>&gt;<br>&gt; Rather than =
modify the column value in sql server,<br>&gt; are&nbsp; there any other =
ways to solve this problem?<br>&gt; Better to give me an&nbsp; =
examples.<br><br>You will never be able to insert a null character into =
a PostgreSQL database.<br>You can either modify the source data or =
change the data in =
transit.<o:p></o:p></span></p></div></blockquote><div><p =
class=3DMsoNormal><span =
lang=3DEN-US>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span lang=3DEN-US>This is not 100% true, but is true =
for text-fields. You <em><span =
style=3D'font-family:=E5=AE=8B=E4=BD=93'>can</span></em> insert \0 into =
BYTEA columns.<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span =
lang=3DEN-US>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span =
lang=3DEN-US>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span lang=3DEN-US>Usually the \0 isn't important so =
you can do this in JAVA before inserting into =
PG:<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span =
lang=3DEN-US>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span lang=3DEN-US>someString.replace('\0', ' ') or =
someString.replaceAll(&quot;\0&quot;, =
&quot;&quot;)<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span =
lang=3DEN-US>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span =
lang=3DEN-US>&nbsp;<o:p></o:p></span></p></div><div><div><p =
class=3DMsoNormal><span lang=3DEN-US>-- <o:p></o:p></span></p><div><p =
class=3DMsoNormal><strong><span lang=3DEN-US =
style=3D'font-family:"Arial","sans-serif"'>Andreas Joseph =
Krogh</span></strong><span =
lang=3DEN-US><o:p></o:p></span></p></div><div><p class=3DMsoNormal><span =
lang=3DEN-US style=3D'font-family:"Arial","sans-serif"'>CTO / =
Partner</span><span lang=3DEN-US> - Visena =
AS<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span =
lang=3DEN-US style=3D'font-family:"Arial","sans-serif"'>Mobile: +47 909 =
56 963</span><span lang=3DEN-US><o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span lang=3DEN-US><a =
href=3D"/user/SendEmail.jtp?type=3Dnode&amp;node=3D5816732&amp;i=3D1" =
target=3D"_top">[hidden email]</a><o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span lang=3DEN-US><a href=3D"https://www.visena.com" =
target=3D"_top">www.visena.com</a><o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span lang=3DEN-US><a href=3D"https://www.visena.com" =
target=3D"_top"><span style=3D'text-decoration:none'><img border=3D0 =
id=3D"_x0000_i1025" =
src=3D"http://postgresql.1045698.n5.nabble.com/attachment/5816732/0/part_=
F278519088191PMH0X4"></span></a><o:p></o:p></span></p></div></div></div><=
div><p class=3DMsoNormal><span =
lang=3DEN-US>&nbsp;<o:p></o:p></span></p></div><p class=3DMsoNormal =
style=3D'margin-bottom:12.0pt'><span =
lang=3DEN-US><o:p>&nbsp;</o:p></span></p><div class=3DMsoNormal =
align=3Dcenter style=3D'text-align:center'><span lang=3DEN-US><hr =
size=3D1 width=3D"100%" noshade style=3D'color:#CCCCCC' =
align=3Dcenter></span></div><div><div><p class=3DMsoNormal><b><span =
lang=3DEN-US =
style=3D'font-size:9.0pt;font-family:"Tahoma","sans-serif";color:#444444'=
>If you reply to this email, your message will be added to the =
discussion below:<o:p></o:p></span></b></p></div><p =
class=3DMsoNormal><span lang=3DEN-US =
style=3D'font-size:9.0pt;font-family:"Tahoma","sans-serif";color:#444444'=
><a =
href=3D"http://postgresql.1045698.n5.nabble.com/invalid-byte-sequence-for=
-encoding-UTF8-0x00-tp2172080p5816732.html">http://postgresql.1045698.n5.=
nabble.com/invalid-byte-sequence-for-encoding-UTF8-0x00-tp2172080p5816732=
.html</a> <o:p></o:p></span></p></div><div style=3D'margin-top:4.8pt'><p =
class=3DMsoNormal style=3D'line-height:18.0pt'><span lang=3DEN-US =
style=3D'font-size:8.5pt;font-family:"Tahoma","sans-serif";color:#666666'=
>To unsubscribe from invalid byte sequence for encoding =
&quot;UTF8&quot;: 0x00, <a =
href=3D"http://postgresql.1045698.n5.nabble.com/template/NamlServlet.jtp?=
macro=3Dunsubscribe_by_code&amp;node=3D2172080&amp;code=3DbGl1eXVhbnl1YW5=
nb2dvQGdtYWlsLmNvbXwyMTcyMDgwfDU1NzU2MzQ0MQ=3D=3D">click here</a>.<br><a =
href=3D"http://postgresql.1045698.n5.nabble.com/template/NamlServlet.jtp?=
macro=3Dmacro_viewer&amp;id=3Dinstant_html%21nabble%3Aemail.naml&amp;base=
=3Dnabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleN=
amespace-nabble.view.web.template.NodeNamespace&amp;breadcrumbs=3Dnotify_=
subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-se=
nd_instant_email%21nabble%3Aemail.naml"><span =
style=3D'font-size:7.0pt;font-family:"Times New =
Roman","serif"'>NAML</span></a> =
<o:p></o:p></span></p></div></div></body></html>
------=_NextPart_000_0020_01CFC368.E43B4B60--