public inbox for [email protected]  

help / color / mirror / Atom feed

Subject: [Pljava-dev]  PL/java kills unicode chars?
Date: Sat, 19 Sep 2015 23:41:04 -0400
Message-ID: <[email protected]> (raw)
In-Reply-To: <CAHEGxbNQvw4VD00Otfbo0u+d9JVaMWqBWL3ggx0mHJyRcDuFLg@mail.gmail.com>
References: <CAHEGxbNQvw4VD00Otfbo0u+d9JVaMWqBWL3ggx0mHJyRcDuFLg@mail.gmail.com>

Srivatsan Ramanujam wrote:
> I believe PL/java is killing unicode characters (it is probably converting
> text to a byte stream and reading them as single byte characters - perhaps
> Latin-1 and not as UTF-8). ...

Well, this one has been open for a while. It's also in the github tracker,
https://github.com/tada/pljava/issues/21 which I've just updated with
confirming test code.

I think vatsan's comment (on the github issue) about
http://bugs.sun.com/view_bug.do?bug_id=5030776 is probably spot on.
We seem to handle the whole basic multilingual plane correctly
(nearly 64k codepoints), it's just all the planes above that getting
messed up.

Should be a straightforward fix, once I've found how many places those
not-really-UTF JNI functions are really used in the code.

-Chap

view thread (6+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Subject: Re: [Pljava-dev]  PL/java kills unicode chars?
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox