Content-Type: multipart/alternative;
 boundary="------------ZWFTo6wo0byXYkN7OolgH1m1"
Message-ID: <ce7d9974-9b45-496d-a8b4-dae1d01bd6fa@denodo.com>
Date: Wed, 20 Mar 2024 12:30:02 +0100
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: PostGres ODBC too slow
Content-Language: en-US
To: pgsql-odbc@lists.postgresql.org
References: 
 <CAL4ovZoYjU0NiHg+aYYvzzPChjyYpFGyWt8QwDvkvt91UessZA@mail.gmail.com>
 <CADK3HHK471z_+FXxKL=SonAc8p15aHoqm7XVKsCV5O51y4_HQw@mail.gmail.com>
 <CAL4ovZrHYYROkWuY_0yn4a2Ca32xQeBL9zB9PcO9qpkPPhAVBg@mail.gmail.com>
 <CADK3HHJc-ShnErp5=b_KzNz76xdYyn1qd8SzeULun=SVBfTmOQ@mail.gmail.com>
From: =?UTF-8?Q?Jacobo_S=C3=A1nchez_L=C3=B3pez?= <jsanchez@denodo.com>
In-Reply-To: 
 <CADK3HHJc-ShnErp5=b_KzNz76xdYyn1qd8SzeULun=SVBfTmOQ@mail.gmail.com>
Archived-At: 
 <https://www.postgresql.org/message-id/ce7d9974-9b45-496d-a8b4-dae1d01bd6fa%40denodo.com>
Precedence: bulk

This is a multi-part message in MIME format.
--------------ZWFTo6wo0byXYkN7OolgH1m1
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

Hi

     Environment is also important. Are you using connecting through LAN 
or WAN?

     WAN communications  are impacted by the size of the data 
transmitted (and also for not using the network to receive data while 
processing previously obtained data). ODBC driver as far as I know does 
use text data serialization which may be bigger than other pg clients. 
Not having compression does also affect WAN communications but that is 
postgres related so other clients would be in the same boat.


Best regards

Jacobo

El 20/03/2024 a las 12:17, Dave Cramer escribió:
> HI Vedant,
>
> Can you share the SQL that is slow. We can't fix this if we don't have 
> a specific problem to look at.
>
> Dave Cramer
> www.postgres.rocks
>
>
> On Wed, 20 Mar 2024 at 02:08, vedant patel <vedantpatel297@gmail.com> 
> wrote:
>
>     Hello Dave,
>
>     We have tried the retrieval using python library psycopg2 and
>     found that it is taking less amount of time for retrieval. And
>     when we create odbc and use pyodbc it is taking a large amount of
>     time for that odbc. Along with that our main application is in
>     PowerBuilder and we need to use ODBC for that one. We checked the
>     ODBC driver with PowerBuilder and it is taking too much time.
>
>     Thanks,
>
>     On Tue, Mar 19, 2024 at 12:19 AM Dave Cramer
>     <davecramer@postgres.rocks> wrote:
>
>         Can you explain where/why you think it is too slow ?
>
>         Dave Cramer
>         www.postgres.rocks
>
>
>         On Mon, 18 Mar 2024 at 10:56, vedant patel
>         <vedantpatel297@gmail.com> wrote:
>
>             Hello There,
>
>             Recently, we've encountered some performance issues with
>             the ODBC driver provided by Postgres. Upon investigation,
>             we noticed that switching from the UNICODE to ANSI driver
>             resulted in performance improvements for some queries,
>             albeit at the expense of others.
>
>             To delve deeper into this matter, I conducted tests using
>             a Python script with the psycopg2 library, and the results
>             were significantly better. However, to address this issue
>             comprehensively, I've explored alternative ODBC drivers
>             available in the market. While some minor improvements
>             were observed in a few queries with a different driver,
>             the overall performance remains a concern.
>
>             Given your extensive experience in this area, I would
>             greatly appreciate your insights and recommendations on
>             which ODBC driver would be most suitable for our use case.
>             Any advice or suggestions you could offer would be
>             immensely helpful in resolving this performance issue.
>
>             Let me know in case of any questions or concerns.
>
>             Thanks,
>
--------------ZWFTo6wo0byXYkN7OolgH1m1
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit

<!DOCTYPE html>
<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>Hi</p>
    <p>    Environment is also important. Are you using connecting
      through LAN or WAN? <br>
    </p>
    <p>    WAN communications  are impacted by the size of the data
      transmitted (and also for not using the network to receive data
      while processing previously obtained data). ODBC driver as far as
      I know does use text data serialization which may be bigger than
      other pg clients. Not having compression does also affect WAN
      communications but that is postgres related so other clients would
      be in the same boat.<br>
    </p>
    <p>    <br>
    </p>
    <p>Best regards<br>
    </p>
    <p>Jacobo<br>
    </p>
    <div class="moz-cite-prefix">El 20/03/2024 a las 12:17, Dave Cramer
      escribió:<br>
    </div>
    <blockquote type="cite"
cite="mid:CADK3HHJc-ShnErp5=b_KzNz76xdYyn1qd8SzeULun=SVBfTmOQ@mail.gmail.com">
      <div dir="ltr">HI Vedant,
        <div><br>
        </div>
        <div>Can you share the SQL that is slow. We can't fix this if we
          don't have a specific problem to look at.</div>
        <div><br>
          <div>
            <div dir="ltr" class="gmail_signature"
              data-smartmail="gmail_signature">
              <div dir="ltr">Dave Cramer
                <div><a class="moz-txt-link-abbreviated" href="http://www.postgres.rocks">www.postgres.rocks</a></div>
              </div>
            </div>
          </div>
          <br>
        </div>
      </div>
      <br>
      <div class="gmail_quote">
        <div dir="ltr" class="gmail_attr">On Wed, 20 Mar 2024 at 02:08,
          vedant patel &lt;<a href="mailto:vedantpatel297@gmail.com"
            moz-do-not-send="true" class="moz-txt-link-freetext">vedantpatel297@gmail.com</a>&gt;
          wrote:<br>
        </div>
        <blockquote class="gmail_quote">
          <div dir="ltr">
            <div dir="ltr">
              <div><span>Hello Dave,</span></div>
              <div><span><br>
                </span></div>
              <div><span>We have tried the retrieval using python
                  library psycopg2 and found that it is taking less
                  amount of time for retrieval. And when we create odbc
                  and use pyodbc it is taking a large amount of time for
                  that odbc. Along with that our main application is in
                  PowerBuilder and we need to use ODBC for that one. We
                  checked the ODBC driver with PowerBuilder and it is
                  taking too much time.</span></div>
              <div><span><br>
                </span></div>
              <div><span>Thanks,</span><br>
              </div>
            </div>
            <br>
            <div class="gmail_quote">
              <div dir="ltr" class="gmail_attr">On Tue, Mar 19, 2024 at
                12:19 AM Dave Cramer <a class="moz-txt-link-rfc2396E" href="mailto:davecramer@postgres.rocks">&lt;davecramer@postgres.rocks&gt;</a>
                wrote:<br>
              </div>
              <blockquote class="gmail_quote">
                <div dir="ltr">Can you explain where/why you think it is
                  too slow ?
                  <div><br>
                    <div>
                      <div dir="ltr" class="gmail_signature">
                        <div dir="ltr">Dave Cramer
                          <div><a class="moz-txt-link-abbreviated" href="http://www.postgres.rocks">www.postgres.rocks</a></div>
                        </div>
                      </div>
                    </div>
                    <br>
                  </div>
                </div>
                <br>
                <div class="gmail_quote">
                  <div dir="ltr" class="gmail_attr">On Mon, 18 Mar 2024
                    at 10:56, vedant patel &lt;<a
                      href="mailto:vedantpatel297@gmail.com"
                      target="_blank" moz-do-not-send="true"
                      class="moz-txt-link-freetext">vedantpatel297@gmail.com</a>&gt;
                    wrote:<br>
                  </div>
                  <blockquote class="gmail_quote">
                    <div dir="ltr">
                      <div dir="auto">Hello There,</div>
                      <div dir="auto"><br>
                      </div>
                      <div dir="auto">Recently, we've encountered some
                        performance issues with the ODBC driver provided
                        by Postgres. Upon investigation, we noticed that
                        switching from the UNICODE to ANSI driver
                        resulted in performance improvements for some
                        queries, albeit at the expense of others.<br>
                        <br>
                        To delve deeper into this matter, I conducted
                        tests using a Python script with the psycopg2
                        library, and the results were significantly
                        better. However, to address this issue
                        comprehensively, I've explored alternative ODBC
                        drivers available in the market. While some
                        minor improvements were observed in a few
                        queries with a different driver, the overall
                        performance remains a concern.<br>
                        <br>
                        Given your extensive experience in this area, I
                        would greatly appreciate your insights and
                        recommendations on which ODBC driver would be
                        most suitable for our use case. Any advice or
                        suggestions you could offer would be immensely
                        helpful in resolving this performance issue.<br>
                        <br>
                      </div>
                      <span>
                        <div>Let me know in case of any questions or
                          concerns. </div>
                        <div><br>
                        </div>
                      </span>
                      <div dir="auto">Thanks,</div>
                    </div>
                  </blockquote>
                </div>
              </blockquote>
            </div>
          </div>
        </blockquote>
      </div>
    </blockquote>
  </body>
</html>

--------------ZWFTo6wo0byXYkN7OolgH1m1--