public inbox for [email protected]
help / color / mirror / Atom feedHow long does iteration over 4-5 million rows usually take?
9+ messages / 7 participants
[nested] [flat]
* How long does iteration over 4-5 million rows usually take?
@ 2022-04-02 01:34 Shaozhong SHI <[email protected]>
2022-04-02 01:35 ` How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
2022-04-02 01:47 ` Re: How long does iteration over 4-5 million rows usually take? Adrian Klaver <[email protected]>
2022-04-02 02:18 ` Re: How long does iteration over 4-5 million rows usually take? Ron <[email protected]>
0 siblings, 3 replies; 9+ messages in thread
From: Shaozhong SHI @ 2022-04-02 01:34 UTC (permalink / raw)
To: pgsql-general <[email protected]>
I have a script running to iterate over 4-5 million rows. It keeps showing
up in red in PgAdmin. It remains active.
How long does iteration over 4-5 million rows usually take?
Regards,
David
^ permalink raw reply [nested|flat] 9+ messages in thread
* How long does iteration over 4-5 million rows usually take?
2022-04-02 01:34 How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
@ 2022-04-02 01:35 ` Shaozhong SHI <[email protected]>
2022-04-02 16:38 ` Re: How long does iteration over 4-5 million rows usually take? Steve Midgley <[email protected]>
2 siblings, 1 reply; 9+ messages in thread
From: Shaozhong SHI @ 2022-04-02 01:35 UTC (permalink / raw)
To: pgsql-sql <[email protected]>
I have a script running to iterate over 4-5 million rows. It keeps showing
up in red in PgAdmin. It remains active.
How long does iteration over 4-5 million rows usually take?
Regards,
David
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: How long does iteration over 4-5 million rows usually take?
2022-04-02 01:34 How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
2022-04-02 01:35 ` How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
@ 2022-04-02 16:38 ` Steve Midgley <[email protected]>
0 siblings, 0 replies; 9+ messages in thread
From: Steve Midgley @ 2022-04-02 16:38 UTC (permalink / raw)
To: Shaozhong SHI <[email protected]>; +Cc: pgsql-sql <[email protected]>
On Fri, Apr 1, 2022 at 6:35 PM Shaozhong SHI <[email protected]> wrote:
>
>
> I have a script running to iterate over 4-5 million rows. It keeps
> showing up in red in PgAdmin. It remains active.
>
> How long does iteration over 4-5 million rows usually take?
>
>
Please share the SQL query, schema, and sample data. If you are using a
third party script with a db connector, then the answer is much harder to
answer.
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: How long does iteration over 4-5 million rows usually take?
2022-04-02 01:34 How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
@ 2022-04-02 01:47 ` Adrian Klaver <[email protected]>
2 siblings, 0 replies; 9+ messages in thread
From: Adrian Klaver @ 2022-04-02 01:47 UTC (permalink / raw)
To: Shaozhong SHI <[email protected]>; pgsql-general <[email protected]>
On 4/1/22 18:34, Shaozhong SHI wrote:
>
> I have a script running to iterate over 4-5 million rows. It keeps
> showing up in red in PgAdmin. It remains active.
>
> How long does iteration over 4-5 million rows usually take?
Given that there is no real information provided in the problem
description there is no chance for an answer more detailed then; as long
as it takes.
>
> Regards,
>
> David
--
Adrian Klaver
[email protected]
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: How long does iteration over 4-5 million rows usually take?
2022-04-02 01:34 How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
@ 2022-04-02 02:18 ` Ron <[email protected]>
2022-04-02 13:21 ` Re: How long does iteration over 4-5 million rows usually take? Rob Sargent <[email protected]>
2 siblings, 1 reply; 9+ messages in thread
From: Ron @ 2022-04-02 02:18 UTC (permalink / raw)
To: [email protected]
On 4/1/22 20:34, Shaozhong SHI wrote:
>
> I have a script running to iterate over 4-5 million rows. It keeps
> showing up in red in PgAdmin. It remains active.
>
> How long does iteration over 4-5 million rows usually take?
What /*exactly*/ are you doing?
--
Angular momentum makes the world go 'round.
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: How long does iteration over 4-5 million rows usually take?
2022-04-02 01:34 How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
2022-04-02 02:18 ` Re: How long does iteration over 4-5 million rows usually take? Ron <[email protected]>
@ 2022-04-02 13:21 ` Rob Sargent <[email protected]>
2022-04-02 13:46 ` Aw: Re: How long does iteration over 4-5 million rows usually take? Karsten Hilbert <[email protected]>
0 siblings, 1 reply; 9+ messages in thread
From: Rob Sargent @ 2022-04-02 13:21 UTC (permalink / raw)
To: Ron <[email protected]>; +Cc: [email protected]
> On Apr 1, 2022, at 10:18 PM, Ron <[email protected]> wrote:
>
> On 4/1/22 20:34, Shaozhong SHI wrote:
>>
>> I have a script running to iterate over 4-5 million rows. It keeps showing up in red in PgAdmin. It remains active.
>>
>> How long does iteration over 4-5 million rows usually take?
4-5 million times as long as it takes to do one iteration ( if you’re doing it correctly)
^ permalink raw reply [nested|flat] 9+ messages in thread
* Aw: Re: How long does iteration over 4-5 million rows usually take?
2022-04-02 01:34 How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
2022-04-02 02:18 ` Re: How long does iteration over 4-5 million rows usually take? Ron <[email protected]>
2022-04-02 13:21 ` Re: How long does iteration over 4-5 million rows usually take? Rob Sargent <[email protected]>
@ 2022-04-02 13:46 ` Karsten Hilbert <[email protected]>
2022-04-02 14:16 ` Re: Re: How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
0 siblings, 1 reply; 9+ messages in thread
From: Karsten Hilbert @ 2022-04-02 13:46 UTC (permalink / raw)
To: Rob Sargent <[email protected]>; +Cc: Ron <[email protected]>; [email protected]
> > On Apr 1, 2022, at 10:18 PM, Ron <[email protected]> wrote:
> >
> > On 4/1/22 20:34, Shaozhong SHI wrote:
> >>
> >> I have a script running to iterate over 4-5 million rows. It keeps showing up in red in PgAdmin. It remains active.
> >>
> >> How long does iteration over 4-5 million rows usually take?
>
> 4-5 million times as long as it takes to do one iteration ( if you’re doing it correctly)
I may not take quite that long because setup/teardown times might not be needed for each iteration.
Best,
Karsten
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Re: How long does iteration over 4-5 million rows usually take?
2022-04-02 01:34 How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
2022-04-02 02:18 ` Re: How long does iteration over 4-5 million rows usually take? Ron <[email protected]>
2022-04-02 13:21 ` Re: How long does iteration over 4-5 million rows usually take? Rob Sargent <[email protected]>
2022-04-02 13:46 ` Aw: Re: How long does iteration over 4-5 million rows usually take? Karsten Hilbert <[email protected]>
@ 2022-04-02 14:16 ` Shaozhong SHI <[email protected]>
2022-04-02 14:34 ` Re: Re: How long does iteration over 4-5 million rows usually take? Benedict Holland <[email protected]>
0 siblings, 1 reply; 9+ messages in thread
From: Shaozhong SHI @ 2022-04-02 14:16 UTC (permalink / raw)
To: Karsten Hilbert <[email protected]>; +Cc: Rob Sargent <[email protected]>; Ron <[email protected]>; pgsql-general <[email protected]>
Thanks, Karsten,
I would like the information to work planning purpose.
Regards,
David
On Sat, 2 Apr 2022 at 14:47, Karsten Hilbert <[email protected]>
wrote:
> > > On Apr 1, 2022, at 10:18 PM, Ron <[email protected]> wrote:
> > >
> > > On 4/1/22 20:34, Shaozhong SHI wrote:
> > >>
> > >> I have a script running to iterate over 4-5 million rows. It keeps
> showing up in red in PgAdmin. It remains active.
> > >>
> > >> How long does iteration over 4-5 million rows usually take?
> >
> > 4-5 million times as long as it takes to do one iteration ( if you’re
> doing it correctly)
>
> I may not take quite that long because setup/teardown times might not be
> needed for each iteration.
>
> Best,
> Karsten
>
>
>
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Re: How long does iteration over 4-5 million rows usually take?
2022-04-02 01:34 How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
2022-04-02 02:18 ` Re: How long does iteration over 4-5 million rows usually take? Ron <[email protected]>
2022-04-02 13:21 ` Re: How long does iteration over 4-5 million rows usually take? Rob Sargent <[email protected]>
2022-04-02 13:46 ` Aw: Re: How long does iteration over 4-5 million rows usually take? Karsten Hilbert <[email protected]>
2022-04-02 14:16 ` Re: Re: How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
@ 2022-04-02 14:34 ` Benedict Holland <[email protected]>
0 siblings, 0 replies; 9+ messages in thread
From: Benedict Holland @ 2022-04-02 14:34 UTC (permalink / raw)
To: Shaozhong SHI <[email protected]>; +Cc: Karsten Hilbert <[email protected]>; Rob Sargent <[email protected]>; Ron <[email protected]>; pgsql-general <[email protected]>
For work planning, create a temporary table, copy from a generated data
set, and test it out. It really depends. Normally, you don't iterate in SQL
since rows are assumed to be independent. You think about SQL in terms of
sets and let application code handle the data transfers. It also really
depends on the size of your tables, indexing, joins, and more. Basically,
there isn't really an answer but it isnt hard to test.
Thanks,
Ben
On Sat, Apr 2, 2022, 10:16 AM Shaozhong SHI <[email protected]> wrote:
> Thanks, Karsten,
>
> I would like the information to work planning purpose.
>
> Regards,
>
> David
>
> On Sat, 2 Apr 2022 at 14:47, Karsten Hilbert <[email protected]>
> wrote:
>
>> > > On Apr 1, 2022, at 10:18 PM, Ron <[email protected]> wrote:
>> > >
>> > > On 4/1/22 20:34, Shaozhong SHI wrote:
>> > >>
>> > >> I have a script running to iterate over 4-5 million rows. It keeps
>> showing up in red in PgAdmin. It remains active.
>> > >>
>> > >> How long does iteration over 4-5 million rows usually take?
>> >
>> > 4-5 million times as long as it takes to do one iteration ( if you’re
>> doing it correctly)
>>
>> I may not take quite that long because setup/teardown times might not be
>> needed for each iteration.
>>
>> Best,
>> Karsten
>>
>>
>>
^ permalink raw reply [nested|flat] 9+ messages in thread
end of thread, other threads:[~2022-04-02 16:38 UTC | newest]
Thread overview: 9+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2022-04-02 01:34 How long does iteration over 4-5 million rows usually take? Shaozhong SHI <[email protected]>
2022-04-02 01:35 ` Shaozhong SHI <[email protected]>
2022-04-02 16:38 ` Steve Midgley <[email protected]>
2022-04-02 01:47 ` Adrian Klaver <[email protected]>
2022-04-02 02:18 ` Ron <[email protected]>
2022-04-02 13:21 ` Rob Sargent <[email protected]>
2022-04-02 13:46 ` Aw: Re: How long does iteration over 4-5 million rows usually take? Karsten Hilbert <[email protected]>
2022-04-02 14:16 ` Shaozhong SHI <[email protected]>
2022-04-02 14:34 ` Benedict Holland <[email protected]>
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox