Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rL4lJ-005yrs-CW for pgsql-general@arkaria.postgresql.org; Wed, 03 Jan 2024 17:10:37 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1rL4lI-006jeQ-11 for pgsql-general@arkaria.postgresql.org; Wed, 03 Jan 2024 17:10:36 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rL4lH-006jeH-Lq for pgsql-general@lists.postgresql.org; Wed, 03 Jan 2024 17:10:35 +0000 Received: from out5-smtp.messagingengine.com ([66.111.4.29]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rL4lF-00FMnT-7L for pgsql-general@lists.postgresql.org; Wed, 03 Jan 2024 17:10:35 +0000 Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 662665C01F0; Wed, 3 Jan 2024 12:10:31 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Wed, 03 Jan 2024 12:10:31 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aklaver.com; h= cc:content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm1; t=1704301831; x=1704388231; bh=zcdS6757rAaNRTxQ7/3T+lXGcm1H7EsPR8fhHvybKZc=; b= Qdt7TkFFErWnL3Kkx7uC9rCegMZKw2KuTOl/Q/dVHWvipthZ/dSKNDSzcA/LOdAu HxRWVCeZbGMUbwJJ++4iwz7YD+uvVhF2KcpEmPWUwjKCj3YXmXAs+iBV3EhBpQRQ igXJWS2rU9uTF1fGqh+VvD4lLe7pMJdQ2w5ZPFnYVA1r286Vn4NZW1TQOxz1y3pe jMmRFkqvl+DMfAyT16cRHt9EuGlIRgGpoB26ERCci7yxRjxbDaozPM4ku5Bxq8jW XuRrKhEtNDlhSp1BKJwbEolkl+DLANkzByoM98X1hxY84NCzr1rvo4gDFpNpwupI H2eSZ6ZA+vMlTlfrDWQOXA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1704301831; x= 1704388231; bh=zcdS6757rAaNRTxQ7/3T+lXGcm1H7EsPR8fhHvybKZc=; b=Z FVjE11DgZz5b6oHrAEYIcfcUP2WNaSk4dFIsR/TlqSZVq4bp278jYzJMfXWcnHfe KyCe5A0Zhgx5hCN8EmvJvh5XGMAjHsP+27FnfUSxPxg3jDJ8YcDJUxc5Kmi2IKBZ +k6GYryZP8xOaiukPiPKtp9LwnnXoR4BmpdxLskuqL2+aUCn5dw8ZwVk1EdSDXqq WMrkNVwGw0SOiiqA6wn0O8Tg88pGUowj5DsCqJ/gJp0B1E96tGTskmy08VnMQrWf CS+ahzwtcZfGXccqlKwYhcEA9/HyT8zFPk7iAsYaQWBMG4OjF94jF4cf5ap2SRTf JsAKCLA7SnGg0Zvkdg+ZQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrvdeghedgleekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefkffggfgfuvfhfhfgjtgfgsehtje ertddtvdejnecuhfhrohhmpeetughrihgrnhcumfhlrghvvghruceorggurhhirghnrdhk lhgrvhgvrhesrghklhgrvhgvrhdrtghomheqnecuggftrfgrthhtvghrnhepiedvhfeihe ehgeeuieeljeeitedtjeehudegfeelkedvleekhedtgfeiffefkedunecuvehluhhsthgv rhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomheprggurhhirghnrdhklhgrvh gvrhesrghklhgrvhgvrhdrtghomh X-ME-Proxy: Feedback-ID: i76984098:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Wed, 3 Jan 2024 12:10:30 -0500 (EST) Message-ID: <42a39fc7-e5e1-4ee7-ab9e-a2da4bf5209f@aklaver.com> Date: Wed, 3 Jan 2024 09:10:30 -0800 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Sample data generator for performance testing Content-Language: en-US To: arun chirappurath , pgsql-general@lists.postgresql.org References: From: Adrian Klaver In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 1/2/24 23:23, arun chirappurath wrote: > Hi All, > > Do we have any open source tools which can be used to create sample data > at scale from our postgres databases? > Which considers data distribution and randomness Is this for all tables in the database or a subset? Does it need to deal with foreign key relationships? What are the sizes of the existing data and what size sample data do you want to produce? > > Regards, > Arun -- Adrian Klaver adrian.klaver@aklaver.com