postgresql-interfaces/psqlodbc GitHub issues and pull requests (mirror)  
help / color / mirror / Atom feed
[postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
10+ messages / 2 participants
[nested] [flat]

* [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-01-27 10:37  "abhi-555 (@abhi-555)" <[email protected]>
  0 siblings, 0 replies; 10+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-01-27 10:37 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

We are trying to use psqlodbc to perform ODBC batch/array operations (the operations include a mix of insert, update and delete) using the standard benchmark Tpcc load. 

We are seeing a rate of 12000 records/sec getting processed, which is a very poor number. Is there any known connection option which needs to be set OR any other way which can help us speed this performance ?

Please let me know

^ permalink  raw  reply  [nested|flat] 10+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-01 17:11  "davecramer (@davecramer)" <[email protected]>
  8 siblings, 0 replies; 10+ messages in thread

From: davecramer (@davecramer) @ 2025-02-01 17:11 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

Without knowing the exact code this is difficult to answer.

^ permalink  raw  reply  [nested|flat] 10+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-10 15:11  "abhi-555 (@abhi-555)" <[email protected]>
  8 siblings, 0 replies; 10+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-02-10 15:11 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

[Standalones.zip](https://github.com/user-attachments/files/18735771/Standalones.zip)

I have attached a standalone for batch_insert and batch_update in Standalones.zip . We are using these to detect the time taken and rate of records processed during batch insert and update simultaneously. The DDL of the table used is present in the CPP files.

We have the below summary where we have performed a comparison between the psqlodbc driver and a third party postgres driver. We are seeing significantly lower rates of processing in batch insert and update using psqlodbc driver. 

Summary of comparison

Records per batch 10000
Number of batches 1

Insert Rates
psqlodbc driver : 46190.0 records/sec
third party postgres driver : 163041.5 records/sec

Update Rates
psqlodbc driver : 26060.5 records/sec
third party postgres driver : 59786.5 records/sec

Would request you to provide us some fix which can help improve this performance
































































^ permalink  raw  reply  [nested|flat] 10+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-10 16:35  "davecramer (@davecramer)" <[email protected]>
  8 siblings, 0 replies; 10+ messages in thread

From: davecramer (@davecramer) @ 2025-02-10 16:35 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

I'd be curious to see the server logs for each. I don't need all the logs, just a small sample of the inserts.

Thanks,
Dave

^ permalink  raw  reply  [nested|flat] 10+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-13 10:45  "abhi-555 (@abhi-555)" <[email protected]>
  8 siblings, 0 replies; 10+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-02-13 10:45 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

[ServerLogComparison.zip](https://github.com/user-attachments/files/18782517/ServerLogComparison.zip)

I have provided the server logs for 100 inserts in both the drivers - psqlodbc and the third party postgres driver. Please find the details in the attached zip.

^ permalink  raw  reply  [nested|flat] 10+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-17 18:23  "davecramer (@davecramer)" <[email protected]>
  8 siblings, 0 replies; 10+ messages in thread

From: davecramer (@davecramer) @ 2025-02-17 18:23 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

OK, I can see the difference, thanks!

^ permalink  raw  reply  [nested|flat] 10+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-20 09:39  "abhi-555 (@abhi-555)" <[email protected]>
  8 siblings, 0 replies; 10+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-02-20 09:39 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

Could you please triage this issue and let us know when can we expect some fix on this?

^ permalink  raw  reply  [nested|flat] 10+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-02-23 11:08  "davecramer (@davecramer)" <[email protected]>
  8 siblings, 0 replies; 10+ messages in thread

From: davecramer (@davecramer) @ 2025-02-23 11:08 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

I'm still trying to figure out why https://github.com/postgresql-interfaces/psqlodbc/issues/92 fails, but in the meantime you could provide a PR for this one.

^ permalink  raw  reply  [nested|flat] 10+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-04-21 09:58  "abhi-555 (@abhi-555)" <[email protected]>
  8 siblings, 0 replies; 10+ messages in thread

From: abhi-555 (@abhi-555) @ 2025-04-21 09:58 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

Hi Dave, 
Could you please provide us some info on this, as to when can we expect some fix here?

^ permalink  raw  reply  [nested|flat] 10+ messages in thread

* Re: [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load
@ 2025-04-22 13:36  "davecramer (@davecramer)" <[email protected]>
  8 siblings, 0 replies; 10+ messages in thread

From: davecramer (@davecramer) @ 2025-04-22 13:36 UTC (permalink / raw)
  To: postgresql-interfaces/psqlodbc <[email protected]>

I don't have any plans currently to work on this. If you wish to provide a Pull Request I would be happy to review it.

^ permalink  raw  reply  [nested|flat] 10+ messages in thread


end of thread, other threads:[~2025-04-22 13:36 UTC | newest]

Thread overview: 10+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2025-01-27 10:37 [postgresql-interfaces/psqlodbc] issue #88: Poor performance of psqlodbc while executing ODBC array operations from TPCC load "abhi-555 (@abhi-555)" <[email protected]>
2025-02-01 17:11 ` "davecramer (@davecramer)" <[email protected]>
2025-02-10 15:11 ` "abhi-555 (@abhi-555)" <[email protected]>
2025-02-10 16:35 ` "davecramer (@davecramer)" <[email protected]>
2025-02-13 10:45 ` "abhi-555 (@abhi-555)" <[email protected]>
2025-02-17 18:23 ` "davecramer (@davecramer)" <[email protected]>
2025-02-20 09:39 ` "abhi-555 (@abhi-555)" <[email protected]>
2025-02-23 11:08 ` "davecramer (@davecramer)" <[email protected]>
2025-04-21 09:58 ` "abhi-555 (@abhi-555)" <[email protected]>
2025-04-22 13:36 ` "davecramer (@davecramer)" <[email protected]>

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox