Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1ncrrL-0005n2-B0 for pgsql-sql@arkaria.postgresql.org; Fri, 08 Apr 2022 16:53:20 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1ncrrK-0006Ux-7C for pgsql-sql@arkaria.postgresql.org; Fri, 08 Apr 2022 16:53:18 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1ncrqj-0002Ah-PC for pgsql-sql@lists.postgresql.org; Fri, 08 Apr 2022 16:52:41 +0000 Received: from mailtransmit04.runbox.com ([2a0c:5a00:149::25]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1ncrqg-00043E-6R for pgsql-sql@lists.postgresql.org; Fri, 08 Apr 2022 16:52:40 +0000 Received: from mailtransmit03.runbox ([10.9.9.163] helo=aibo.runbox.com) by mailtransmit04.runbox.com with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.93) (envelope-from ) id 1ncrqb-003Fg8-FL for pgsql-sql@lists.postgresql.org; Fri, 08 Apr 2022 18:52:33 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=runbox.com; s=selector2; h=Content-Type:MIME-Version:Message-ID:Date:Subject:In-Reply-To :References:To:From; bh=uPK1+CHstENjO04EdX7C3/9RHeWEZuqfj7VPgMhQfrw=; b=Ajiol Agdtrxx2GHVkfDrjlmM9qvFeDf9ZVV9i5Si/8Tc97q6Gp10DNcsx5Jq16rt1ZGWfYEKfoRbIUCxep PqRTaOTT18L3JaNfNY+1rRJ/le/J0uZuQnSSSeIU4S1a2f8bIaz5zhgrSgDYP8DK9Z7VPV4tKrbG4 xgtQLSJVM1rAowG5Z3ZOFzsShADkFP4k9HYB+s1PdDe+gK6Tm2q7yZehERpZ7dJWTitv1BT1OuRgs xiW7/dDEJhAzBtlTwqjBlL8IDuuDC7OVy9Qc4x5Lm4S/rFopXPwB3VMH1Q8/tEEyGSWNIFNjGmOQr 6jnj/9pRQs6RXQxW19KVpheMvtevg==; Received: from [10.9.9.72] (helo=submission01.runbox) by mailtransmit03.runbox with esmtp (Exim 4.86_2) (envelope-from ) id 1ncrqb-0000xd-22 for pgsql-sql@lists.postgresql.org; Fri, 08 Apr 2022 18:52:33 +0200 Received: by submission01.runbox with esmtpsa [Authenticated ID (300526)] (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) id 1ncrqT-0003KH-FS for pgsql-sql@lists.postgresql.org; Fri, 08 Apr 2022 18:52:25 +0200 From: "Mike Sofen" To: "'pgsql-sql'" References: In-Reply-To: Subject: RE: Long running processes and commit writing to disk Date: Fri, 8 Apr 2022 09:52:23 -0700 Message-ID: <02f801d84b69$06336370$129a2a50$@runbox.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_02F9_01D84B2E.59D59CE0" X-Mailer: Microsoft Outlook 16.0 Thread-Index: AQGl8ncKu1TYrZZ5pEoz71gksRj6IQIITsO4rTqpi3A= Content-Language: en-us List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk This is a multipart message in MIME format. ------=_NextPart_000_02F9_01D84B2E.59D59CE0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable From: Shaozhong SHI Sent: Friday, April 08, = 2022 9:39 AM When long running processes got disrupted, one may not see any expected = result. How to make sure that the result of each operation is saved to disk in a = loop? Regards, David =20 =20 Simple: don=E2=80=99t use a database =E2=80=93 you=E2=80=99re asking to = violate ACID. =20 =20 A database=E2=80=99s power comes from set-based operations. = You=E2=80=99re asking to do single row operations. Use a = spreadsheet...or a plain text file and treat it like a log. =20 Mike ------=_NextPart_000_02F9_01D84B2E.59D59CE0 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable

From: Shaozhong SHI = <shishaozhong@gmail.com> =C2=A0=C2=A0Sent: Friday, April = 08, 2022 9:39 AM

When long running processes got disrupted, = one may not see any expected result.

How to make sure that the = result of each operation is saved to disk in a = loop?

Regards,

David

 

 

Simple:=C2=A0 don=E2=80=99t use a database =E2=80=93 = you=E2=80=99re asking to violate ACID.=C2=A0

 

A = database=E2=80=99s power comes from set-based operations.=C2=A0 = You=E2=80=99re asking to do single row operations.=C2=A0 Use a = spreadsheet...or a plain text file and treat it like a = log.

 

Mike

------=_NextPart_000_02F9_01D84B2E.59D59CE0--