public inbox for [email protected]
help / color / mirror / Atom feedFrom: Tomas Vondra <[email protected]>
To: Thomas Munro <[email protected]>
Cc: Melanie Plageman <[email protected]>
Cc: Heikki Linnakangas <[email protected]>
Cc: Andres Freund <[email protected]>
Cc: Pg Hackers <[email protected]>
Cc: Nazir Bilal Yavuz <[email protected]>
Subject: Re: BitmapHeapScan streaming read user and prelim refactoring
Date: Sat, 30 Mar 2024 00:40:01 +0100
Message-ID: <[email protected]> (raw)
In-Reply-To: <CA+hUKGKxPEh4oUtz_9fij=DdrJRWejbf1r0qWyqpSxUe2tu3VA@mail.gmail.com>
References: <[email protected]>
<20240323002607.abegehmmjyxrnmm2@liskov>
<[email protected]>
<20240324173833.rdtw42aur2q5hhb2@liskov>
<[email protected]>
<CAAKRu_Yzm6ae-Njj9DHwk0bbFC6QpzbjB=aY39civtpsUYgORQ@mail.gmail.com>
<[email protected]>
<CAAKRu_ZS016J_qhs=BnCsteYYC0HgYpAbZB8mDZBvFdy_VD1MQ@mail.gmail.com>
<20240325160709.qjo6txzu6zjxzkqy@liskov>
<20240327193750.3mlcmzqondpj27xe@liskov>
<[email protected]>
<CA+hUKGJtm_gkmW_h_02-Q9ZRcG3yOx2uzVqbCTfz7YPnTfs+DA@mail.gmail.com>
<[email protected]>
<CA+hUKGKVT1DpFG_k7xAm_6Mepeg0U76XwRPh+gx9nAGvUzZOwA@mail.gmail.com>
<CA+hUKG+QcN9AfW+v5isNMEBJr34VPOWifyC-LX=tLN4Ddh_Srw@mail.gmail.com>
<[email protected]>
<CA+hUKGKxPEh4oUtz_9fij=DdrJRWejbf1r0qWyqpSxUe2tu3VA@mail.gmail.com>
On 3/29/24 22:39, Thomas Munro wrote:
> ...
>
>> I don't recall seeing a system with disabled readahead, but I'm
>> sure there are cases where it may not really work - it clearly can't
>> work with direct I/O, ...
>
> Right, for direct I/O everything is slow right now including seq scan.
> We need to start asynchronous reads in the background (imagine
> literally just a bunch of background "I/O workers" running preadv() on
> your behalf to get your future buffers ready for you, or equivalently
> Linux io_uring). That's the real goal of this project: restructuring
> so we have the information we need to do that, ie teach every part of
> PostgreSQL to predict the future in a standard and centralised way.
> Should work out better than RA heuristics, because we're not just
> driving in a straight line, we can turn corners too.
>
>> ... but I've also not been very successful with
>> prefetching on ZFS.
>
> posix_favise() did not do anything in OpenZFS before 2.2, maybe you
> have an older version?
>
Sorry, I meant the prefetch (readahead) built into ZFS. I may be wrong
but I don't think the regular RA (in linux kernel) works for ZFS, right?
I was wondering if we could use this (posix_fadvise) to improve that,
essentially by issuing fadvise even for sequential patterns. But now
that I think about that, if posix_fadvise works since 2.2, maybe RA
works too now?)
regards
--
Tomas Vondra
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company
view thread (21+ messages) latest in thread
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]
Subject: Re: BitmapHeapScan streaming read user and prelim refactoring
In-Reply-To: <[email protected]>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox