Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1YlMtI-0004FN-NN for pgsql-hackers@arkaria.postgresql.org; Thu, 23 Apr 2015 19:34:28 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1YlMtG-0006SL-UZ for pgsql-hackers@arkaria.postgresql.org; Thu, 23 Apr 2015 19:34:26 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1YlMsu-000605-Us for pgsql-hackers@postgresql.org; Thu, 23 Apr 2015 19:34:05 +0000 Received: from mail-bl2on0081.outbound.protection.outlook.com ([65.55.169.81] helo=na01-bl2-obe.outbound.protection.outlook.com) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1YlMsr-0001hm-Fa for pgsql-hackers@postgresql.org; Thu, 23 Apr 2015 19:34:02 +0000 Received: from BLUPR11MB0675.namprd11.prod.outlook.com (25.163.216.145) by BLUPR11MB0578.namprd11.prod.outlook.com (25.163.125.149) with Microsoft SMTP Server (TLS) id 15.1.148.16; Thu, 23 Apr 2015 19:33:59 +0000 Authentication-Results: gmail.com; dkim=none (message not signed) header.d=none; Received: from decina.local (70.113.16.71) by BLUPR11MB0675.namprd11.prod.outlook.com (25.163.216.145) with Microsoft SMTP Server (TLS) id 15.1.148.15; Thu, 23 Apr 2015 19:33:53 +0000 Message-ID: <5539491C.6040405@BlueTreble.com> Date: Thu, 23 Apr 2015 14:33:48 -0500 From: Jim Nasby User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Petr Jelinek , Andres Freund , , Robert Haas CC: Bruce Momjian , Sawada Masahiko , Greg Stark , PostgreSQL-development , Jeff Janes Subject: Re: Reducing tuple overhead References: <20150423162429.GG3055@alap3.anarazel.de> <553921B1.7080204@2ndquadrant.com> In-Reply-To: <553921B1.7080204@2ndquadrant.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [70.113.16.71] X-ClientProxiedBy: BLUPR05CA0065.namprd05.prod.outlook.com (10.141.20.35) To BLUPR11MB0675.namprd11.prod.outlook.com (25.163.216.145) X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:; SRVR:BLUPR11MB0675; UriScan:; BCL:0; PCL:0; RULEID:; SRVR:BLUPR11MB0578; X-Forefront-Antispam-Report: BMV:1; SFV:NSPM; SFS:(10009020)(6009001)(24454002)(377454003)(479174004)(51704005)(23746002)(62966003)(122386002)(99136001)(54356999)(2950100001)(64126003)(92566002)(36756003)(4001350100001)(77156002)(87266999)(15975445007)(40100003)(65816999)(5001770100001)(50986999)(46102003)(42186005)(33656002)(66066001)(47776003)(83506001)(50466002)(65806001)(87976001)(86362001)(65956001)(80316001)(19580395003)(76176999)(4580500001)(85282002)(336755003)(18886065003); DIR:OUT; SFP:1101; SCL:1; SRVR:BLUPR11MB0675; H:decina.local; FPR:; SPF:None; MLV:sfv; LANG:en; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(5002010)(5005006); SRVR:BLUPR11MB0675; BCL:0; PCL:0; RULEID:; SRVR:BLUPR11MB0675; X-Forefront-PRVS: 0555EC8317 X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Apr 2015 19:33:53.8629 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR11MB0675 X-OriginatorOrg: bluetreble.com X-Pg-Spam-Score: -2.1 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 4/23/15 11:45 AM, Petr Jelinek wrote: > On 23/04/15 18:24, Andres Freund wrote: >> Whether that's feasible complexity wise is debatable, but it's certainly >> possible. >> >> >> I do wonder what, in realistic cases, is actually the bigger contributor >> to the overhead. The tuple header or the padding we liberally add in >> many cases... >> > > The logical ordering patch + auto optimizations of column layout on > table creation/rewrite might help partially there. > > But what seems to be clear is that we need more in depth analysis of > what really contributes most to the tuple size in various use-cases and > then we can debate what we can do about it. Also, what Robert posted was that while we started at something like 15%-30% larger, we ended the test at 80% larger. That makes me think that the bigger win is not in reducing tuple size but tackling bloat. -- Jim Nasby, Data Architect, Blue Treble Consulting Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers