Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1vQRfL-007gjv-0P for pgsql-hackers@arkaria.postgresql.org; Tue, 02 Dec 2025 14:47:44 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.96) (envelope-from ) id 1vQRfK-008KKX-0Y for pgsql-hackers@arkaria.postgresql.org; Tue, 02 Dec 2025 14:47:42 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1vQRfJ-008KKO-2Y for pgsql-hackers@lists.postgresql.org; Tue, 02 Dec 2025 14:47:42 +0000 Received: from lahtoruutu.iki.fi ([185.185.170.37]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1vQRfG-002lGr-2i for pgsql-hackers@lists.postgresql.org; Tue, 02 Dec 2025 14:47:41 +0000 Received: from [10.0.2.15] (unknown [130.41.208.2]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange x25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: hlinnaka) by lahtoruutu.iki.fi (Postfix) with ESMTPSA id 4dLNsZ5YBdz49Q10; Tue, 02 Dec 2025 16:47:30 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iki.fi; s=lahtoruutu; t=1764686851; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lByQYJUyQR0b3AgqpyXS9Ccdb7Mf3x3RnM+Cqd4DAJY=; b=lvY2COi0thMBRffq02oEAvZBnRzpmJviTGwCmH4Ys27q3xxK4i0hUM7MiNtgpx5DnaXyEv 7XQAEcLWsyTFjuR8DtFwmB2rC4Ra6//aCnvvOzYYj/ntnlNa5EuDnSphT0hLQU0Zyo6bgk z4D7m5rlCKI7zOKX3zUFClPJxXGK0EaGK11fKwmLzzyNg27iPZcbO+LmTWRB3pCW1Hnywf 3BHu/LcieGJ8JCTxLFhPmMw7LVWOhrcCwInZSMRsaO0RvBUv1nt16EBblnwXink9Qk732v gI2p9dJxz1f/6YeffyP5R9Wlp0dYPGL4dRcjPGaH+SZaQrJ7XRom9rXXBxopuw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=iki.fi; s=lahtoruutu; t=1764686851; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lByQYJUyQR0b3AgqpyXS9Ccdb7Mf3x3RnM+Cqd4DAJY=; b=c43h1GQGkO7WgbBZlnGoN3lqZp7eMggozbIX7yjoSO7qWpD41EmJKAu0qIlz7Pye1nTa9L SzLdTlNz0aOUbOowkz04Ir+o+ijKuItq99MyodVZ2p1EluSUh10Om3WoMAy86Zz8cSKDsH imOkZ9jNzBKsOagVKfsjxE47JrjLWKn3RZ/ZvtLp84DsLMaM56i1STNUrKNHqIy5oIz41X hKIP3mMm8sij2uik1sgteWgyDIFhinlhUHKFKbTGUeMhtD5x6U+Abwmw3zGQKKOmubM59X VqO2j3zXor+abXpLmSTvcNL/eRuAi2jF9nrMRgP7dfQrbVAvCjZ5iD0jCATJKQ== ARC-Authentication-Results: i=1; ORIGINATING; auth=pass smtp.auth=hlinnaka smtp.mailfrom=hlinnaka@iki.fi ARC-Seal: i=1; a=rsa-sha256; d=iki.fi; s=lahtoruutu; cv=none; t=1764686851; b=feGcTdiCToVDWEMgpBS/Ujf8nofmppj4kjzTHyJJR5jEH52hE1EtVqYFw+GSkwDyTj62nY otWO46U58m6C3c6iMWDSkuZpRgP5838dARup9vRzQO5hGHqVRo5rL+59jySJorwF/rWL1b xz8NwwzD/tBh9GcEOUE30O7tMMu98g03elovoiwxKCt2xAU3n1p/Uzp5/yOpBXSQDZT6QL 0jVJt2gFc5VKsCsmuLwwfaOeY9C4YN77WLvlUcrb78rq4nm8zTnwCyzZcuia1Mc5TKkCKs 6gV7jo/sCMJbuV01Jx7s+7zxB2Vwx0eyYj9nqbQGkdBaj8IM7F/F2jiMeGdItA== Message-ID: <52227f05-51aa-40c4-8f83-9c79fff16175@iki.fi> Date: Tue, 2 Dec 2025 16:47:29 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: POC: make mxidoff 64 bits To: Alexander Korotkov Cc: Maxim Orlov , Alvaro Herrera , wenhui qiu , Postgres hackers , Ashutosh Bapat References: <2bc58592-9d74-4af0-bdd1-1a88e8683f7c@iki.fi> <36531c0e-292c-409d-bbc7-a252cf6e910a@iki.fi> <54aa8f65-f0e4-4464-b543-e0399c1cab1e@iki.fi> <4a9dda70-0af7-41a4-9636-b168f2fc48ef@iki.fi> <46cc45e9-fddd-44bc-bcb3-96889aafd921@iki.fi> <6c298bc4-7029-4c1d-bf16-3e094842ce32@iki.fi> <9ee6324a-44fc-42fb-bf8e-7c3b53395588@iki.fi> Content-Language: en-US From: Heikki Linnakangas In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 02/12/2025 16:11, Alexander Korotkov wrote: > I'd like to raise the question about compression again. You have > fairly criticized non-deterministic compression, but what do you think > about deterministic one that I've proposed [1]. I understand that > multixact offsets are subject of growth and their limit is not > removed. However, it's still several extra gigabytes for multixact > offsets, which we could save. It felt overly complicated to my taste. And decoding/encoding the whole chunk on every access seems expensive. Maybe it's cheap enough that it doesn't matter in practice, but some performance testing would at least be in order. But I'd love to find a simpler scheme to begin with. Storing one "base" offset per page, as Maxim did in [1], feels about right to me. Except for the non-deterministic nature of how it gets set in that patch, and what I referred to as a "frighteningly clever encoding scheme". Perhaps we could set the base offset in ExtendMultiXactOffset() already? [1] https://www.postgresql.org/message-id/CACG%3DezbPUASDL1eJ%2Bc-ZkJMwRPukvp3EL0q1vSUa1h%2BfnX8y3g%40mail.gmail.com - Heikki