public inbox for [email protected]  
help / color / mirror / Atom feed
From: Ron Johnson <[email protected]>
To: Pgsql-admin <[email protected]>
Subject: Re: Performance
Date: Sun, 15 Dec 2024 21:14:53 -0500
Message-ID: <CANzqJaDAo9eLZpwbh0MJhj3RKvjhRJF4PheRUOtHRSjL9gbwBw@mail.gmail.com> (raw)
In-Reply-To: <CAEphvJPSh1Cd+NA14Q3e-1B9JH6Ebm1oLgLx93HkkTZa=EBA_g@mail.gmail.com>
References: <CAEphvJPSh1Cd+NA14Q3e-1B9JH6Ebm1oLgLx93HkkTZa=EBA_g@mail.gmail.com>

On Sun, Dec 15, 2024 at 8:22 PM Anex Hul <[email protected]> wrote:

> Hello everyone,
>
> Testing 100 million records data import from Azure blob storage to Azure
> postgresql. I did run the test 5 times and the time it took keep increasing
> for each run.
> Is there know justification for this linear increment of the time it took
> for same size of data?
>

1. What version of PG is it?  ("SELECT VERSION();" should tell you.)
2. Are you truncating the table after each test run, or deleting all
records, or appending?
3. Is the blob data stored in BYTEA column data, or are you using the
(discouraged) "Large Objects"?
4. How are you loading the blob data?

-- 
Death to <Redacted>, and butter sauce.
Don't boil me, I'm still alive.
<Redacted> lobster!


view thread (5+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected]
  Subject: Re: Performance
  In-Reply-To: <CANzqJaDAo9eLZpwbh0MJhj3RKvjhRJF4PheRUOtHRSjL9gbwBw@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox