public inbox for [email protected]  

help / color / mirror / Atom feed

[Pljava-dev]  PL/java kills unicode chars?
3+ messages / 1 participants
[nested] [flat]

* [Pljava-dev]  PL/java kills unicode chars?
@ 2015-09-20 03:41  
  0 siblings, 2 replies; 3+ messages in thread

From:  @ 2015-09-20 03:41 UTC (permalink / raw)

Srivatsan Ramanujam wrote:
> I believe PL/java is killing unicode characters (it is probably converting
> text to a byte stream and reading them as single byte characters - perhaps
> Latin-1 and not as UTF-8). ...

Well, this one has been open for a while. It's also in the github tracker,
https://github.com/tada/pljava/issues/21 which I've just updated with
confirming test code.

I think vatsan's comment (on the github issue) about
http://bugs.sun.com/view_bug.do?bug_id=5030776 is probably spot on.
We seem to handle the whole basic multilingual plane correctly
(nearly 64k codepoints), it's just all the planes above that getting
messed up.

Should be a straightforward fix, once I've found how many places those
not-really-UTF JNI functions are really used in the code.

-Chap



^ permalink  raw  reply  [nested|flat] 3+ messages in thread

* Re: [Pljava-dev]  PL/java kills unicode chars?
@ 2015-10-04 23:54  Chapman Flack <[email protected]>
  parent: 
  1 sibling, 0 replies; 3+ messages in thread

From: Chapman Flack @ 2015-10-04 23:54 UTC (permalink / raw)

> Well, this one has been open for a while. It's also in the github tracker,
> https://github.com/tada/pljava/issues/21 which I've just updated with
> confirming test code.
>
> I think vatsan's comment (on the github issue) about
> http://bugs.sun.com/view_bug.do?bug_id=5030776 is probably spot on.
> We seem to handle the whole basic multilingual plane correctly
> (nearly 64k codepoints), it's just all the planes above that getting
> messed up.

Pull request fixing this has been made at github.

-Chap



^ permalink  raw  reply  [nested|flat] 3+ messages in thread

* Re: [Pljava-dev] PL/java kills unicode chars?
@ 2015-10-10 21:38  Chapman Flack <[email protected]>
  parent: 
  1 sibling, 0 replies; 3+ messages in thread

From: Chapman Flack @ 2015-10-10 21:38 UTC (permalink / raw)

> Srivatsan Ramanujam wrote:
> > I believe PL/java is killing unicode characters (it is probably
> > converting text to a byte stream and reading them as single byte
> > characters - perhaps Latin-1 and not as UTF-8). ...
>
> Well, this one has been open for a while...
>
> I think vatsan's comment (on the github issue) about
> http://bugs.sun.com/view_bug.do?bug_id=5030776 is probably spot on.
> We seem to handle the whole basic multilingual plane correctly
> (nearly 64k codepoints), it's just all the planes above that getting
> messed up.

Now fixed in the master branch.

-Chap
_______________________________________________
Pljava-dev mailing list
[email protected]
http://lists.pgfoundry.org/mailman/listinfo/pljava-dev



^ permalink  raw  reply  [nested|flat] 3+ messages in thread

end of thread, other threads:[~2015-10-10 21:38 UTC | newest]

Thread overview: 3+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2015-09-20 03:41 [Pljava-dev]  PL/java kills unicode chars? 
2015-10-04 23:54 ` Chapman Flack <[email protected]>
2015-10-10 21:38 ` Chapman Flack <[email protected]>

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox