Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lYeSt-0005V2-Ut for pgsql-hackers@arkaria.postgresql.org; Tue, 20 Apr 2021 00:42:08 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1lYeSs-0001nC-TQ for pgsql-hackers@arkaria.postgresql.org; Tue, 20 Apr 2021 00:42:06 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lYeSs-0001mw-Hn for pgsql-hackers@lists.postgresql.org; Tue, 20 Apr 2021 00:42:06 +0000 Received: from mail-ej1-x636.google.com ([2a00:1450:4864:20::636]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1lYeSn-0000Q8-Ie for pgsql-hackers@postgresql.org; Tue, 20 Apr 2021 00:42:05 +0000 Received: by mail-ej1-x636.google.com with SMTP id sd23so47022982ejb.12 for ; Mon, 19 Apr 2021 17:42:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bowt-ie.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=RK4sC/5cIoqN6qNGasn1qFwXCJlJ04hkAT3K602xYkw=; b=bTi+xuHhj0VJT1SYWWNNNl/X36EjhzY5tfcUqOl2wDQ4glUCNcqipmekVS77W32t5d e/yO/zqYHs1Y9E2VHDDdXM29TGXYkj/QaZn9cRBC59wmIrKEsmtneghsHui9P2/W/hXE d6x3ZPi8fEyL+Ca6gjleL28LkO7jOzoOi195L6xtjHP7v2F5Y8pf2n6gxkH6Ga3YW9JM UNrxo7Tn66h8eik8OzeTjCiTkemeCNCOh/YYp3v5ZzefuN0z4fLtS6pSlZYcgz8SM4Hr 3H+dHYyYbvBESe7NSZCWNZGTqUKKfxkCVsxn7AiZsibplr6Jwda0e5ybsz+74zJJlWCi s9eA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=RK4sC/5cIoqN6qNGasn1qFwXCJlJ04hkAT3K602xYkw=; b=bzhKNWZ+izXQ3lQLWotVvZXL3fwsn7rbgkVyLOwrRWJzfdN1cprhnB/PaHb1UCC4IY Bf+r2PBzqBpJAyYsIkmjceOAt8ZgDidN4b/1cRLcoqEDCBXuaD+cc/LsON3fRVuag3lP 9RI++9f6fX3iJuWq/nTNdQIAIcM9Lcl6mTashLA7NrpBgEFEVDj2Eu0K4pl2Zj5SzpAv gT+sBu6vG/wr88CFLBGdgIHQCztVtl0cJq34WnlM0EJyQnR2kyLRiI3ce9FWjMqvjJX/ rRu5lLPtejnbaSZJ9QSxE/Fk6UTE/3oOlN6BcY92PbEYCK7ZqUef/gXsp4J9omnjjhBy dI8Q== X-Gm-Message-State: AOAM5321kg8EFwVpjesKcMzzpGsPOP5poEDCuxU2k3SiHGdywFinVn2M 6ibXEJSZpCHi/txR8bDG2yY/A30kztniBYZDLcnEsQ== X-Google-Smtp-Source: ABdhPJxeQTC9NcgCYXGDOE/nwtvXaT2aS61P/JSKqDt9p54nrxWG0oafiegLHQPAxjdJgOHrj2kgLriYjsM1kOO99Bg= X-Received: by 2002:a17:906:3385:: with SMTP id v5mr24818473eja.539.1618879318887; Mon, 19 Apr 2021 17:41:58 -0700 (PDT) MIME-Version: 1.0 References: <2ECBBCA0-4D8D-4841-8872-4A5BBDC063D2@amazon.com> <20210420000917.GA30205@momjian.us> In-Reply-To: <20210420000917.GA30205@momjian.us> From: Peter Geoghegan Date: Mon, 19 Apr 2021 17:41:42 -0700 Message-ID: Subject: Re: partial heap only tuples To: Bruce Momjian Cc: "Bossart, Nathan" , "pgsql-hackers@postgresql.org" , "McAlister, Grant" , "Mlodgenski, Jim" , "Nasby, Jim" , "Hsu, John" Content-Type: text/plain; charset="UTF-8" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Mon, Apr 19, 2021 at 5:09 PM Bruce Momjian wrote: > > A diversity of strategies with fallback behavior is sometimes the best > > strategy. Don't underestimate the contribution of rare and seemingly > > insignificant adverse events. Consider the lifecycle of the data over > > That is an intersting point --- we often focus on optimizing frequent > operations, but preventing rare but expensive-in-aggregate events from > happening is also useful. Right. Similarly, we sometimes focus on adding an improvement, overlooking more promising opportunities to subtract a disimprovement. Apparently this is a well known tendency: https://www.scientificamerican.com/article/our-brain-typically-overlooks-this-brilliant-problem-solving-strategy/ I believe that it's particularly important to consider subtractive approaches with a complex system. This has sometimes worked well for me as a conscious and deliberate strategy. -- Peter Geoghegan