Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pSlQI-0005p3-8l for pgsql-admin@arkaria.postgresql.org; Thu, 16 Feb 2023 21:04:10 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1pSlQF-0006Ll-FG for pgsql-admin@arkaria.postgresql.org; Thu, 16 Feb 2023 21:04:07 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pSlQE-0006Lc-SL for pgsql-admin@lists.postgresql.org; Thu, 16 Feb 2023 21:04:07 +0000 Received: from jakobs.com ([85.214.83.89] helo=rs.plausibolo.de) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pSlQ7-0002d3-FQ for pgsql-admin@lists.postgresql.org; Thu, 16 Feb 2023 21:04:05 +0000 Received: from localhost (localhost [127.0.0.1]) by rs.plausibolo.de (Postfix) with ESMTP id 378D2380484; Thu, 16 Feb 2023 22:03:56 +0100 (CET) Received: from rs.plausibolo.de ([127.0.0.1]) by localhost (h2367442.stratoserver.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7c7HXjXH-PwV; Thu, 16 Feb 2023 22:03:56 +0100 (CET) Received: from [127.0.0.1] (unknown [102.52.178.59]) by rs.plausibolo.de (Postfix) with ESMTPSA id A6C3E3803E0; Thu, 16 Feb 2023 22:03:55 +0100 (CET) Date: Thu, 16 Feb 2023 22:03:53 +0100 From: Holger Jakobs To: pgsql-admin@lists.postgresql.org, Lucio Chiessi , Raj kumar CC: Pgsql-admin Subject: Re: Load 500 GB test data with Large objects and different types User-Agent: K-9 Mail for Android In-Reply-To: References: Message-ID: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=----WPBYRVIKXORUG8XBDN6J218WD11SRE Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk ------WPBYRVIKXORUG8XBDN6J218WD11SRE Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Converting int values to timestamp is possible with PostgreSQL's functions= =2E The already mentioned generate_series() can generate timestamp values dire= ctly=2E So you can choose=2E What do you mean by large objects? Large binary values can be saved as byt= ea type or as large objects separate from tables=2E Am 16=2E Februar 2023 21:02:44 GMT+01:00 schrieb Lucio Chiessi : >Hi Raj=2E You can use the generate_series() function to create millions = of >rows and do an insert from this select=2E >I'm used to using it in my test data generation=2E > >*Lucio Chiessi* > >Senior Database Administrator > >Trustly, Inc=2E > >M: +55 27 996360276 > > > > > > > > > >PayWith*MyBank=C2=AE* is now part of *Trustly* > > >On Thu, Feb 16, 2023 at 3:46 PM Raj kumar wr= ote: > >> Hi, >> >> What is the easy/best way to load 500gb of data for testing purpose wit= h >> flexible data types >> 1) Timestamp Datetime >> 2) Blob Large Objects >> 3) Different data types=2E >> >> I tried pgbench and sysbench which only gives int and varchar types=2E >> >> Thanks, >> Raj Kumar Narendiran=2E >> > >--=20 >Please read our privacy policy here=20 > on how we process y= our=20 >personal data in accordance with the General Data Protection Regulation= =20 >(EU) 2016/679 (the =E2=80=9CGDPR=E2=80=9D) and other applicable data prot= ection legislation ------WPBYRVIKXORUG8XBDN6J218WD11SRE Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable Converting int values to timestamp is possible wit= h PostgreSQL's functions=2E

The already mentioned generate_series() = can generate timestamp values directly=2E

So you can choose=2E
What do you mean by large objects? Large binary values can be saved as by= tea type or as large objects separate from tables=2E


Am 16=2E Februar 2023 21:02:44 GMT+01:00 schrieb Lucio Chi= essi <lucio=2Echiessi@trustly=2Ecom>:
Hi Raj=2E  You can use the generate_series() functio= n to create millions of rows and do an insert from this select=2E
I'm u= sed to using it in my test data generation=2E

<= div>

Lucio Chiessi= =

Senior Database Administrator

Trustly, Inc=2E

M: +55 27 9= 96360276

  

    

PayWithMyBank=C2=AE is now part of = Trustly



On Thu, Feb 16, 202= 3 at 3:46 PM Raj kumar <ra= jkumar820999@gmail=2Ecom> wrote:
Hi, 

What is the easy/best way t= o load 500gb of data for testing purpose with flexible data types
1) Timestamp Datetime
2) Blob Large Ob= jects 
3) Different data types=2E

I tried pgbench and sysbench which on= ly gives int and varchar types=2E

Thanks,
Raj Kumar Narendiran=2E

Plea= se read our privacy policy here on how = we process your personal data in accordance with the General Data Protec= tion Regulation (EU) 2016/679 (the =E2=80=9CGDPR=E2=80=9D) and other appli= cable data protection legislation ------WPBYRVIKXORUG8XBDN6J218WD11SRE--