pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Justin Pryzby <pryzby@telsasoft.com>
To: Patrick Mulrooney <mulroony@gmail.com>
Cc: pgsql-performance@lists.postgresql.org
Subject: Re: Increasing parallelism of queries while using file fdw and partitions
Date: Wed, 19 Dec 2018 00:51:49 -0600
Message-ID: <20181219065149.GF8042@telsasoft.com> (raw)
In-Reply-To: <aea30799-809c-f027-1a4b-0c03c7efa3f6@gmail.com>
References: <aea30799-809c-f027-1a4b-0c03c7efa3f6@gmail.com>

On Tue, Dec 18, 2018 at 08:39:36PM -0800, Patrick Mulrooney wrote:
> Wondering if anyone had any thoughts on how to tweak my setup to get it to
> read many files at once instead of one at a time when using file fdw and
> partitions.

I found this:

https://www.postgresql.org/docs/current/parallel-safety.html
|The following operations are always parallel restricted.
|Scans of foreign tables, unless the foreign data wrapper has an IsForeignScanParallelSafe API which indicates otherwise.

https://github.com/ergo70/vcf_fdw/blob/master/vcf_fdw/__init__.py
=> has no such API marker, since it's couple years old, same as multicorn.

Justin




view thread (3+ messages)  latest in thread

Message-ID: <20181219065149.GF8042@telsasoft.com>
Permalink:  ../20181219065149.GF8042@telsasoft.com/
Also on:    postgresql.org/message-id/20181219065149.GF8042@telsasoft.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: pryzby@telsasoft.com, mulroony@gmail.com, pgsql-performance@lists.postgresql.org
  Subject: Re: Increasing parallelism of queries while using file fdw and partitions
  In-Reply-To: <20181219065149.GF8042@telsasoft.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox