pg.ddx.io  GitHub: postgresql-interfaces/psqlodbc (issues + PRs as email threads)  
help / color / mirror / Atom feed
[postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
13+ messages / 2 participants
[nested] [flat]

* [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-01-27 10:37 "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
  0 siblings, 0 replies; 13+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-01-27 10:37 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

We are trying to use psqlodbc to perform ODBC batch/array operations (the operations include a mix of insert, update and delete) using the standard benchmark Tpcc load. 

We are seeing a rate of 12000 records/sec getting processed, which is a very poor number. Is there any known connection option which needs to be set OR any other way which can help us speed this performance ?

Please let me know

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-01 17:11 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: davecramer (@davecramer) @ 2025-02-01 17:11 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

Without knowing the exact code this is difficult to answer.

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-10 15:11 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-02-10 15:11 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

[Standalones.zip](https://github.com/user-attachments/files/18735771/Standalones.zip)

I have attached a standalone for batch_insert and batch_update in Standalones.zip . We are using these to detect the time taken and rate of records processed during batch insert and update simultaneously. The DDL of the table used is present in the CPP files.

We have the below summary where we have performed a comparison between the psqlodbc driver and a third party postgres driver. We are seeing significantly lower rates of processing in batch insert and update using psqlodbc driver. 

Summary of comparison

Records per batch 10000
Number of batches 1

Insert Rates
psqlodbc driver : 46190.0 records/sec
third party postgres driver : 163041.5 records/sec

Update Rates
psqlodbc driver : 26060.5 records/sec
third party postgres driver : 59786.5 records/sec

Would request you to provide us some fix which can help improve this performance
































































^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-10 16:35 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: davecramer (@davecramer) @ 2025-02-10 16:35 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

I'd be curious to see the server logs for each. I don't need all the logs, just a small sample of the inserts.

Thanks,
Dave

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-13 10:45 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-02-13 10:45 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

[ServerLogComparison.zip](https://github.com/user-attachments/files/18782517/ServerLogComparison.zip)

I have provided the server logs for 100 inserts in both the drivers - psqlodbc and the third party postgres driver. Please find the details in the attached zip.

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-17 18:23 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: davecramer (@davecramer) @ 2025-02-17 18:23 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

OK, I can see the difference, thanks!

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-20 09:39 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-02-20 09:39 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

Could you please triage this issue and let us know when can we expect some fix on this?

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-23 11:08 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: davecramer (@davecramer) @ 2025-02-23 11:08 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

I'm still trying to figure out why https://github.com/postgresql-interfaces/psqlodbc/issues/92 fails, but in the meantime you could provide a PR for this one.

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-04-21 09:58 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-04-21 09:58 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

Hi Dave, 
Could you please provide us some info on this, as to when can we expect some fix here?

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-04-22 13:36 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: davecramer (@davecramer) @ 2025-04-22 13:36 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

I don't have any plans currently to work on this. If you wish to provide a Pull Request I would be happy to review it.

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2026-11-16 06:53 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: abhi-555 (@abhi-555) @ 2026-11-16 06:53 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

Can you please check if this can be prioritized now?

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2026-11-16 22:06 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: davecramer (@davecramer) @ 2026-11-16 22:06 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

@abhi-555 can you re-run the test with UseServerSidePrepare=0 and BatchSize=1000 and post the rate.

^ permalink  raw  [nested|flat] 13+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2026-11-16 23:11 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
  11 siblings, 0 replies; 13+ messages in thread

From: davecramer (@davecramer) @ 2026-11-16 23:11 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <noreply+postgresql-interfaces-psqlodbc@github.com>

NM, I know what the issue is.

at the moment I am trying to fix a bunch of security issues, I can get to this after that

^ permalink  raw  [nested|flat] 13+ messages in thread


end of thread, other threads:[~2026-11-16 23:11 UTC | newest]

Thread overview: 13+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2025-01-27 10:37 [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
2025-02-01 17:11 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
2025-02-10 15:11 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
2025-02-10 16:35 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
2025-02-13 10:45 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
2025-02-17 18:23 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
2025-02-20 09:39 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
2025-02-23 11:08 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
2025-04-21 09:58 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
2025-04-22 13:36 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
2026-11-16 06:53 ` "abhi-555 (@abhi-555)" <noreply+abhi-555@github.com>
2026-11-16 22:06 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>
2026-11-16 23:11 ` "davecramer (@davecramer)" <noreply+davecramer@github.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox