From: Tom Lane <tgl@sss.pgh.pa.us>
To: David Rowley <david.rowley@2ndquadrant.com>
Cc: Andres Freund <andres@anarazel.de>
Cc: Robert Haas <robertmhaas@gmail.com>
Cc: PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Subject: Re: POC: converting Lists into arrays
Date: Sat, 25 May 2019 12:46:19 -0400
Message-ID: <31372.1558802779@sss.pgh.pa.us> (raw)
In-Reply-To: <CAKJS1f8=5GBvZp-WoWOU8aMvoELZgWMMe=p54oEAXpi_2-zCNg@mail.gmail.com>
References: <481.1551390571@sss.pgh.pa.us>
<24783.1551568303@sss.pgh.pa.us>
<20190303043424.itzy3ge52xrkpmpr@alap3.anarazel.de>
<437.1551637744@sss.pgh.pa.us>
<CA+TgmoZM4c=v0ifR++i09JFtNtnqTq_HkFmbFjwWqbUJffOLmA@mail.gmail.com>
<12684.1551723095@sss.pgh.pa.us>
<20190304190612.vgqqsowzkrh22623@alap3.anarazel.de>
<26464.1551734920@sss.pgh.pa.us>
<20190304221101.hdg4vj5fo4eewh3b@alap3.anarazel.de>
<CAKJS1f-pNfoUJrmU8vgD1WrKLqs9WxOVLQ0RpSWu9h6W9RnypA@mail.gmail.com>
<20190304235402.nod3gbotk2qtd4nh@alap3.anarazel.de>
<CAKJS1f-yS201hAAmnxcLb2aeTYNZ_A9R1JNXF6hTVXjhHYN7rQ@mail.gmail.com>
<1131.1551746172@sss.pgh.pa.us>
<14626.1558745627@sss.pgh.pa.us>
<CAKJS1f8=5GBvZp-WoWOU8aMvoELZgWMMe=p54oEAXpi_2-zCNg@mail.gmail.com>
David Rowley <david.rowley@2ndquadrant.com> writes:
> If we're doing an API break for this, wouldn't it be better to come up
> with something that didn't have to shuffle list elements around every
> time one is deleted?
Agreed that as long as there's an API break anyway, we could consider
more extensive changes for this use-case. But ...
> For example, we could have a foreach_delete() that instead of taking a
> pointer to a ListCell, it took a ListDeleteIterator which contained a
> ListCell pointer and a Bitmapset, then just have a macro that marks a
> list item as deleted (list_delete_current(di)) and have a final
> cleanup at the end of the loop.
... I'm not quite sold on this particular idea. The amount of added
bitmapset manipulation overhead seems rather substantial in comparison
to the memmove work saved. It might win for cases involving very
long lists with many entries being deleted in one operation, but
I don't think that's a common scenario for us. It's definitely a
loss when there's just one item to be deleted, which I think is a
common case. (Of course, callers expecting that could just not
use this multi-delete API.)
> Or maybe we should worry about having the list in an inconsistent
> state during the loop? e.g if the list is getting passed into a
> function call to do something.
Not following that? If I understand your idea correctly, the list
doesn't actually get changed until the cleanup step. If we pass it to
another operation that independently deletes some members meanwhile,
that's trouble; but it'd be trouble for the existing code, and for my
version of the patch too.
FWIW, I don't really see a need to integrate this idea into the
loop logic as such. You could just define it as "make a bitmap
of the list indexes to delete, then call
"list = list_delete_multi(list, bitmapset)". It would be
helpful perhaps if we provided official access to the current
list index that the foreach macro is maintaining internally.
regards, tom lane
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-hackers@postgresql.org
Cc: tgl@sss.pgh.pa.us, david.rowley@2ndquadrant.com, andres@anarazel.de, robertmhaas@gmail.com, pgsql-hackers@lists.postgresql.org
Subject: Re: POC: converting Lists into arrays
In-Reply-To: <31372.1558802779@sss.pgh.pa.us>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox