pgjdbc/pgjdbc GitHub issues and pull requests (mirror)
help / color / mirror / Atom feedFrom: james-johnston-thumbtack (@james-johnston-thumbtack) <[email protected]>
To: pgjdbc/pgjdbc <[email protected]>
Subject: Re: [pgjdbc/pgjdbc] issue #3483: Support adaptive fetching without enforcing memory limits, and/or have a separate buffer size for it
Date: Mon, 27 Jan 2025 20:26:20 +0000
Message-ID: <[email protected]> (raw)
In-Reply-To: <[email protected]>
References: <[email protected]>
In my situation, I'm an end-user using & tuning parameters for the existing open source [Debezium's PostgreSQL connector](https://debezium.io/documentation/reference/stable/connectors/postgresql.html), so changing JDBC drivers isn't practical. One of the tricky things here is easily setting efficient parameters generally while not running out of memory / making good use of memory, when row sizes and row counts do vary widely from table to table. Picking an appropriate buffer size measured in bytes, not rows, for the JDBC driver would make this much easier. I don't think there's a useful need to multiplex multiple queries or fetches over one connection in this use case, and IMHO it's perfectly reasonable to read the rest of the fetch before being able to do something else on the connection.
view thread (20+ messages) latest in thread
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: github://pgjdbc/pgjdbc
Cc: [email protected], [email protected]
Subject: Re: [pgjdbc/pgjdbc] issue #3483: Support adaptive fetching without enforcing memory limits, and/or have a separate buffer size for it
In-Reply-To: <<[email protected]>>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox