From: Holger Jakobs <holger@jakobs.com>
To: pgsql-admin@lists.postgresql.org, Lucio Chiessi <lucio.chiessi@trustly.com>
To: Raj kumar <rajkumar820999@gmail.com>
Cc: Pgsql-admin <pgsql-admin@lists.postgresql.org>
Subject: Re: Load 500 GB test data with Large objects and different types
Date: Thu, 16 Feb 2023 22:03:53 +0100
Message-ID: <B99F6B60-C662-4C5A-AAF2-A40057A4CDBA@jakobs.com> (raw)
In-Reply-To: <CADoTbHVCTX8YhrBeDN2KbyZm9kyTXGygP+pE9AfJA6NmGo01BQ@mail.gmail.com>
References: <CACxU--XLg61GPNkzzxfpgOu9oHLHKJHACNOUFAoVwN5P=jFELw@mail.gmail.com>
<CADoTbHVCTX8YhrBeDN2KbyZm9kyTXGygP+pE9AfJA6NmGo01BQ@mail.gmail.com>
Converting int values to timestamp is possible with PostgreSQL's functions.
The already mentioned generate_series() can generate timestamp values directly.
So you can choose.
What do you mean by large objects? Large binary values can be saved as bytea type or as large objects separate from tables.
Am 16. Februar 2023 21:02:44 GMT+01:00 schrieb Lucio Chiessi <lucio.chiessi@trustly.com>:
>Hi Raj. You can use the generate_series() function to create millions of
>rows and do an insert from this select.
>I'm used to using it in my test data generation.
>
>*Lucio Chiessi*
>
>Senior Database Administrator
>
>Trustly, Inc.
>
>M: +55 27 996360276
>
><https://www.linkedin.com/company/trustly/;
><https://www.facebook.com/trustly; <https://twitter.com/Trustly;
>
><https://www.linkedin.com/company/trustly/;
><https://www.facebook.com/trustly; <https://twitter.com/Trustly;
>
><https://www.trustly.net/;
>
>PayWith*MyBank®* is now part of *Trustly*
>
>
>On Thu, Feb 16, 2023 at 3:46 PM Raj kumar <rajkumar820999@gmail.com> wrote:
>
>> Hi,
>>
>> What is the easy/best way to load 500gb of data for testing purpose with
>> flexible data types
>> 1) Timestamp Datetime
>> 2) Blob Large Objects
>> 3) Different data types.
>>
>> I tried pgbench and sysbench which only gives int and varchar types.
>>
>> Thanks,
>> Raj Kumar Narendiran.
>>
>
>--
>Please read our privacy policy here
><https://www.trustly.net/about-us/privacy-policy; on how we process your
>personal data in accordance with the General Data Protection Regulation
>(EU) 2016/679 (the “GDPR”) and other applicable data protection legislation
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: holger@jakobs.com, lucio.chiessi@trustly.com, rajkumar820999@gmail.com, pgsql-admin@lists.postgresql.org
Subject: Re: Load 500 GB test data with Large objects and different types
In-Reply-To: <B99F6B60-C662-4C5A-AAF2-A40057A4CDBA@jakobs.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox