public inbox for [email protected]
help / color / mirror / Atom feedFrom: Toshiba via PostgreSQL Announce <[email protected]>
To: PostgreSQL Announce <[email protected]>
Subject: High-Performance SQL Cluster Engine PGSpider 4.0.0 released
Date: Tue, 26 Dec 2023 16:33:14 +0000
Message-ID: <170360839495.1876498.14419640536238258785@wrigleys.postgresql.org> (raw)
We have just released PGSpider v4.0.0.
This version is based on PostgreSQL 16 and fixed some bugs.
PGSpider is High-Performance SQL Cluster Engine for distributed big data.
PGSpider can access a number of data sources using Foreign Data Wrapper(FDW) and retrieves the distributed data source vertically.
Usage of PGSpider is the same as PostgreSQL. You can use any client applications such as libpq and psql.
PGSpider supports following features :
Multi-Tenant :
User can get records in multi tables by one SQL easily. If there are tables with similar schema in each data source, PGSpider can view them as a single virtual table: We call it as Multi-Tenant table.
About an insertion for Multi-tenant table, data is inserted into data sources distributedly by round robin algorithm (This specification was improved from the previous version).
Parallel processing :
PGSpider executes queries and fetches results from child nodes in parallel.
PGSpider expands Multi-Tenant table to child tables, creates new threads for each child table to access corresponding data source.
Pushdown :
WHERE clause, aggregation functions, SQL function in the target list are pushed down to child nodes.
JOIN is also pushed down if all tables in a query are located in a single data source.
Pushdown to Multi-tenant tables occur error when AVG, STDDEV and VARIANCE are used. PGSPider improves this error, PGSpider can execute them. JOIN also pushed down if all tables in a query are located in a single data source.
This is developed by Toshiba Digital Innovation Technology Center.
Please see the repository for details, and tell us feedback.
Source repository : [https://github.com/pgspider/pgspider](https://github.com/pgspider/pgspider)
Best Regards,
TAIGA Katayama
view thread (4+ messages)
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected]
Subject: Re: High-Performance SQL Cluster Engine PGSpider 4.0.0 released
In-Reply-To: <170360839495.1876498.14419640536238258785@wrigleys.postgresql.org>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox