Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1edltx-0004rS-9z for pgsql-committers@arkaria.postgresql.org; Mon, 22 Jan 2018 23:53:21 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1edltv-0007DE-U6 for pgsql-committers@arkaria.postgresql.org; Mon, 22 Jan 2018 23:53:19 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1edltv-0007D4-PL for pgsql-committers@lists.postgresql.org; Mon, 22 Jan 2018 23:53:19 +0000 Received: from sss.pgh.pa.us ([66.207.139.130]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1edltt-0000A2-1A for pgsql-committers@postgresql.org; Mon, 22 Jan 2018 23:53:19 +0000 Received: from sss1.sss.pgh.pa.us (localhost [127.0.0.1]) by sss.pgh.pa.us (8.14.4/8.14.4) with ESMTP id w0MNrAUO024385; Mon, 22 Jan 2018 18:53:10 -0500 From: Tom Lane To: Thomas Munro cc: Andres Freund , pgsql-committers Subject: Re: pgsql: Add parallel-aware hash joins. In-reply-to: <21339.1516633310@sss.pgh.pa.us> References: <20171221092940.gbxcszbzsr5khsfr@alap3.anarazel.de> <20171221095550.d3e7xhoakcowhu5b@alap3.anarazel.de> <20171222082203.fl6rpzlqnm4h7h6h@alap3.anarazel.de> <30219.1514428346@sss.pgh.pa.us> <4503.1514435195@sss.pgh.pa.us> <21339.1516633310@sss.pgh.pa.us> Comments: In-reply-to Tom Lane message dated "Mon, 22 Jan 2018 10:01:50 -0500" MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----- =_aaaaaaaaaa0" Content-ID: <24106.1516664928.0@sss.pgh.pa.us> Date: Mon, 22 Jan 2018 18:53:10 -0500 Message-ID: <24384.1516665190@sss.pgh.pa.us> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk ------- =_aaaaaaaaaa0 Content-Type: text/plain; charset="us-ascii" Content-ID: <24106.1516664928.1@sss.pgh.pa.us> I wrote: > Anyway, it looks like we should write off these longfin timings as > ambient noise :-( Here's a possibly more useful graph of regression test timings over the last year. I pulled this from the buildfarm database: it is the reported runtime for the "installcheck-C" step in each successful build of HEAD on dromedary, going back to Jan. 2017. I picked dromedary because I know that that machine hasn't gotten any software updates nor is there anything else very interesting going on on it. I dropped three or four obvious outlier reports (possibly those ran during the machine's nightly backup cron job). The reported runtime is only precise to 1s, and a couple seconds jitter is hardly surprising, so there's a good deal of noise. Still, it's possible to discern when I put some effort into test runtime reduction back in April, and it can be seen that things have gotten notably slower since the beginning of November. regards, tom lane ------- =_aaaaaaaaaa0 Content-Type: image/png; name="dromedary-times.png" Content-ID: <24106.1516664928.2@sss.pgh.pa.us> Content-Description: dromedary-times.png Content-Transfer-Encoding: base64 iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAMAAAACDyzWAAABKVBMVEX///8AAACgoKD/AAAAwAAA gP/AAP8A7u7AQADu7gAgIMD/wCAAgECggP+AQAD/gP8AwGAAwMAAYIDAYIAAgABA/4AwYICAYABA QEBAgAAAAICAYBCAYGCAYIAAAMAAAP8AYADjsMBAwIBgoMBgwABgwKCAAACAAIBgIIBgYGAgICAg QEAgQIBggCBggGBggICAgEAggCCAgICgoKCg0ODAICAAgIDAYACAwODAYMDAgADAgGD/QAD/QECA wP//gGD/gIDAoADAwMDA/8D/AAD/AP//gKDAwKD/YGAA/wD/gAD/oACA4OCg4OCg/yDAAADAAMCg ICCgIP+AIACAICCAQCCAQICAYMCAYP+AgADAwAD/gED/oED/oGD/oHD/wMD//wD//4D//8BUJrxz AAATiUlEQVR4nO3di3bjqBJAUbT4/3+e6UhA8ZIAIUq2z7l9VxJbKr127Djda2wMERERERERERER ERHR77Zt4sO2HV8SrWnz8syuEIG0sG0H5z4AkFYnn4K3zYjn4I2os9sANyMBxgve/KK+1NDo+zvU MXBwD8d2pHmHJxzz3B2cANAAcOIeArChZoB3m/6z5fsHTp/48kMeEHM8c7sn8OhpHICvm/jyQ367 GPr2APi6Gh4Uuh43Kgtfz9jkL3zP1rrzMAbA16UIMH0RuWW3AvD7WwSwYVEA/l7iFZ5xr/A2/7dO /sMW7nOLxL+MiFc32ctFE82Kh/klC3/pnyxS2nrnAY+ttmTaDya8yQ/blt14LJ3faPwvKsIiJSXy t2hFw8Xft9U+iMn2qviI556/qdN+MPmAJ76Sv/iSD2jpkn6KfLiSD5wVgMmTbXiYi5cs7JJffviI R1dcMO0HqwBsvTGfIgHmmxLriWX8jWcAwz0A/KKurBU/7IsKBMUnyManYPl8PvYU3HnEg+utmPaL RU9tpvgqInl+FavKz+JFxOpiO/l9cgvxM399X3LbXQc8ttqSadTV+NOgZgD8ju78GKYaAEk1AJJq ACTVAEiqAZBUAyCpBkBSDYCkGgBJNQCSagAk1QBIqgGQVAMgqQZAUg2ApBoASTUAkmoAJNUASKoB kFQDIKkGQFINgKQaAEk1AJJqACTVAEh3steLnAdAuhMASTUAkmoAJNUASKoBkFQDIKmmAtD/B9Xd f4g9/OfZ7+4OfVgaAMP7nmTvDwHAX0sBoH8jPOPfs+nGNPrs9J6Cd3zZe0R96rsF0Fg2+tDZKBf3 HjnJO4YZHgF/r1sA/3XnERCApA4weQoe3g/6zBQAxm9eZ3gR8tOpPAKumkbvD4CkGgBJNQCSagAk 1QBIqgGQNLMAJM0ASKoBkFQDIKkGQFINgKQaAEk1AJJqACTVAEiqAZBUs4dA++/PkEIA0o0ASKoB kFQDIKkGQFINgKQaAEk1AJJqACTVAEiqATDJDp0EGsqmAEdOPgBpNADmAXBhAMwD4MIAmAfAhQEw D4ALA2AeABcGwDwALgyAeQBcGADzALgwAOYBcGEAzAPgwgCYB8CFATAPgAsDYB4AFwbAPAAuDIB5 AFwYAPMAuC4b/hm0BeARANelB3B/g+BXvl8wANelBnB78TumA3BdWgB3dAD8+ZSfgv/wbe6Dv0c+ ISsEwMnVzuffK+C/P39fHRY7z/4oF/ezn0Do7hmYNjUATu5RgP+68wjIU/D3B8C+ADi5FwLcjmdu fg3zC70Q4LppAwFwcgDsygJwcgDsCoCzA2BXAJwdALsC4OwA2BUAZwfArgA4LRt9yO4EYDEATguA IwFwWgAcCYDTAuBIAJwWAEcC4LQAOBIAp9UH0P+vOwBSMQCOBMBpAXAkAE4LgCMBcFoAHAmA0zoD aAFYCYDTAuBIAJwWAEcC4LQAOBIApwXAkQA4LQCOBMBpXQL8xw+ASQCcFgBHAuC0ADgSAKcFwJEA OC0AjvTFAFcfmPX/0jTf9CFv/7AvYY9/lNodAD8kAK6f1h8A520PgAMBcN72ADgQAOdtD4ADAXDe 9gA4EADnbQ+AAwFw3vYAOBAA520PgAMBcN72ADgQAOdtD4ADfTPAses7tKl9e9Y4gMnfC1sA1gLg lE3t2wNgfwCcsql9ewDsD4BTNrVvD4D9AXDKpvbtAbA/AE7Z1L49APYHwCmb2rcHwP4AOGVT+/be DjC8a/B73rAagFM2tW/v5QDFO6ZPmDYpAE7Z1L69TwH4pndMB+CUTe3b+xSARjwKxhyXZwE4Mrl4 QwrQhm/vnd0EgPe4hLVf8zMgAIcmF29oBWgkwIFukQHgugCYrlh8Ch6dNicADk0u3vB6gMevYcyb XoQAcGhy8Yb3A3x+WncAHJpcvAGAAwFwaHLxhgSgTQFaA8AsAA5NLt4AwIEAODS5eAMABwLg0OTi DQAcCIBDk4s3AHCgnwAYjvD8WJvPhI0XtQAcDoByhebJAJwVAOUKzZMBOCsAyhWaJ3cCtACsBUC5 QvPkDoDWAPAkAMoVmiffBvj3B4A3zsIHtAqgLQK0JgZoAFgKgHKF5skAnBUA5QrNkwE4KwDKFZon 9wG0BoC1AChXaJ78EwCPvXv2Zeq7AY7smtBms9922NOR9myjEbnjNynmQGaO51nr77LGbdzvQgZw 9MoCcFmfAdA0AHSLAzDbCACTVVcADJ8PBMBlfTBAawDYEgCzVQF4BEAAFgPgsgBYCoDLAmApAC7r KwC6X1QDsLwRACarzgHoFgPgeQDMVl0AcL/3AwD6f8j4QO5s75t4p8KR3fIXeADgwaY2V/z/HKD1 xAB4Nt4AsLC5KQBNeRIAo/EGgIXNAfAIgAAsBsBlAbAUAJcFwFKLAFoAfgxA2wrQHEsaA0AAVja3 AODxKQABWNgcAPcACMByAFwWAEstA+ibukE/f9/IFwKUfxG2/4nurKy1b86WAdogx/rREqAVAG0b wOGHFgAu62MAmgTgyd6JzwdPOgCXBcBSAFwWAEsBcFkALAXAZQGw1HqAj+gIAJ/7Vc/d3gPQBoDW Xxu3ioMnP1b3Tg7tPbY9AC4LgKUWvV8wABcCtD8BsO8d0wEIwHIAXBYAS00AKJ6Dt+gJOeybPWDc AHi6mjuPDuCLBAovZy8oq2uXAVp3p9uAjTdkqgBtClA8MByn0F+xpwGWufStvR2PgsdtxSWXATT+ 5I9t44k+EqBpAzijW6+CG5+CAbh/BsBCK34GBOD+2csB2s8C2PFrGADunwGw0IpfRANw/wyAhb4O 4PXCa3sIoDVPATQJwIdPJgAfDoDnAfDhAHgeAB/ucwAGdQAsDTm9E4AArE6zvQCLS7wNYMuFsX45 d7G7NmCqAG0AeJxPcV6tOx8pQHvsjbsc5gRgKv6xFgI0KwA2LDwnJYDmKYBuF3OAzwbAwQA4JwAO BsA5AXAwAM4JgIMBcE4AHGw9QCsAmhaAFoB/ARCA9QA4GADnBMDBPh2gBWA1ALqVAXhrWnKERYCl 4wsXyl4s6JdLJk87a/VBZU35wWUAL44pXtmdueM8CoCOmJXLuRWLAK1/HS3FeY2/ATB6nHLLpAHQ r7wQ4LGIWwWAyb0ABGDvNAD65QBYC4CnfSDAY1MABCAAGwLgaXMBiut7MV2s8iRAGwS6RQAIQLEy AO9MA6BfDoC1AHgaAAF4tiAAAXgyLZyaNoCBXQYwX9EYMXA2QH8degAmuvzljESIY7PFg4/HOStW AHRwjHcUkzLh274E0KZDvx3g8fmzAE18pr4GoImtJADdTWJ0C8BkqHz0LCx+cppmBMBSAARgfC8A ZwM0lwDds/CzAbAUAAEY3wtAAPZPawBYZNML8DidhUmjXQO0EwAmP3EVx6U/rnUDtHITVowDoDEV NgAM4wB4YxoADQCvAmApAJrjx00A+psA2ADQAlBkTXxoEuDx2QlAeT1zufutNpy/RoBt51MC9BD9 obg9qq0U9i8cjKAk9l6smO2+ewrMAdoUoL0G6Ke5+34GoPs8B2huA0weRfJJPfekS70MoAmk5GPf AeXg53erF6Dc47UBsLYUAJcEwNpSpwDlD3PZSv4GAF4HwNpSAFwSAGtLAXBJjwJMDq0ZoDtzcu2V AO1TAE10RoYBWgnQa/QE3fRrgG45AB63+fUACMDLNbf9zarlGwYDsDAGgGfNeMf02rTvBWgNACd1 H2D9HdMBeOwkAOvdfwo24lHwj6M7M9mh+RN63ONOgksCdGfPhkl+rvEXtgegeDi6ONHiyvUBjG+T G/NHYMNc/70YDXePlwFaBWBqqwpQPAK/DGD86NW9speX/AwYAIrFJUB/EnsAirnywpZ37qsAmgyg ++7z23GPtVcAo+/baJNqAbCwJADXNeNFCAD9fgGwt7s/A5r8RQgAw9cAvOqBX0QDMHwNwKt+DOBx fZ8BaFOAAUoDwFijW7MKUO6PB2j9sYcTDED/BQABmAXAwpIAXBcAC0sCcF0ALCwJwHU9AfA4xOi4 TgD6s+dPiFvOXy4rVw8fOwCmI86OQmzaBojuQtkywPyYBUAbA7QSoP+m8NNNOH55Mm1YuRmgP0/R Qj8BMFHgTmx4SJsCsNIFwItz/hRA0w0w+W52yySn1u+j2LzbXsDm10oB1r6L1wTAwtoAXBcAC2sP Acx2aRlA635OBeAwQAtAAM6aBkC/EwC8bD5Ad+raAJoyQOvPvLslAphf7bhzgMacrGrGAZp4lw6A NuCsAXRC3PSwfA/AaPMRQAtAAAKwHAALawNwXQAsrD0E0KgBNACU0wAYdgKAl00HKC+eqAgwkDJB XHSxwiJ3AMaTygBttLg/But33FGUAB0S47+VbJiVAAxLhOOId85PjwC61f0eTANYOVtrewjgvy/S R4jspv32CKD85hRs3JJngrKNpduw4cKpADSnAN2jrATopmR7Wz76K4B+5dL10QqA+SqfCzA+ZADK xgH6SwHAyvEVjgqAAARgSwDMVwHgwp4B+PdFF0B/xsQldWpigGYUoFhpPkBragDd9s0VwH1UCeDV 8RWOKgJo5DcfAOMACMCp04YAGgAaAM6ZNh+gnwfAyvEVjgqAAARgSw/8XfBjAE1w1ARQTmkAKO71 mzIlgIdBAdDdIgD6e+QxOoCBmMdongBoA0Bx8N8PsGcV+UDgL1+4HnJJKehi6DHamPjch40WVpFX aB7AY51wBNHDUhmgW8ydjfODLR5VAJwBjE+SdgAM0+WnUwEaAFYDYJguPwXgogAYpstPAbgoAIbp 8lMALupVAK24fAoAbfhUAAzfEDFAx2cEoJEAwy7afSfmA/R7lp8k7QCYTwfgwgCYTwfgwgCYTwfg wgCYTwfgwr4UoH8Bay8A+qFWXLJjrV2JBBhuFwBt7Ob4WAfo1q4A9FsF4JJp4QQXTkhKp+NSCICF c38K0H/ZB9A/IJp4vXTHxDAPMOxWWKP1u61yBupn9VUBEICqARCAqgEQgKoBEICqvRtgelsvwOj1 ZHx/WHAUYJBWAmjsAEAzDaABYGMABODgmrX3C+4LgAAcW7H6jul9fRLAIBCAswIgAFW7+xT8Z3CT t3VOfAhgBKgM0Apm/jPjLSUA3ZcVgG6slWsWAboNGOv27WcBDnCRK3t9tx4BHykCWLzf1AG6CYeQ COAuyE0Rj31urF+wsmWTAjQJwNIKnUc/vpJC6k/BjwRAAKp2A6D1EwC4IvVfwzwSAH8A4PPTxgMg AFULnCoAPSwh1Zp+gG4DEqDpBnj2e4D6zecBUDMAAlA1AAJQtXGANkwA4IoACEDVvhegOQfoTMUA bRFgWCoGGF5lB4AHQgA29p0AzcUFkAD3r/abxUoRwCDa2Hi0Tb6wtv3aB4A/HAABqBoArwFa95x+ zJ0G0D8b/3AABKBqAASgagCUr0JvAnSvf5t3EYAABKBuAASgagC8BmgeA8ivYQAIQN0ACEDVvhbg ae5vNY7fvojb5ac/DWNVAASgagAEoGoABKBqAASgagAEoGoABKBqAASgagAEoGoABKBqAASgar8J 0JUCLN1LjwZAAKoGQACqBkAAqgZAAKoGQACqBkAAqgZAAKoGQACqBkAAqgZAAKoGwNF7aUoAHL2X pgTA0XtpSgAcvZemBMDRe2lKABy9l6YEwNF7aUo33rD6752Cjw93pykFQPVukTneMX3SNIUAqN4d Mv/wba98x/TWAKjefYBGPArGHN8fAFW7ycWv+7k/A54HwAUBsB4AFzROZmeXPAVP2KP3BMAF3QVo PvpFyHkAXNBv/yL6PAAuCID1ALggANYD4IIAWA+ACwJgPQAuCID1ALggANYD4IIASKoBkFQDIKkG QFINgKQaAEk1AJJqACTVAEiqAZBUAyCpBkBSDYCkGgBJNQCSagAk1QBIqgGQVAMgqQZAUg2ApBoA STUAkmoAJNUASKoBkFQDIKkGQFINgKQaAEk1AJJqACTVAEiqAZBUAyCpBkBSDYCkGgBJNQCSapMB vtzz+wdOn/jyQx4Xs237OwXH7xcMwLdNfPkh3xPz/9rJO6bH47abX9SXGhp9f4c6Bg7u4diONO/w hGOeu4O3ADp8AJy3hwDs6MC3SYBEfd3z96dv8k9+RE0dAKe/9CBqaWcHQFLqYHfvaZyIiIiIiIjo rR2veN0LX/9F9M8RxH2nN3ZMi19pl6f1DGzZ50cGTj/mhnnh1xX5em2H3LIv7Ze4PK3plyn+r97c p5u4I1rEZGcgu7FjWv73zfm07oFXu9d3vNcn4ZFjbphn/MW/vCK1gQ370nGJi9PiG2vFC4frGB1t cl/1xo5p8a3laX27lzzk3B7YcBK6d7HlmFvm7V+0XJHawIZ96bjEZc7xTp+0zwuWw5C/ixrfV7xx YFr0PFef1jxQOpwy8OwkPL2LF/Pi6zt2yCfnf+ASF6eJGwvnTEzblzL1I5P3FW8cmRZfjPI03YEt x9s10X91PvFyXsNuXw1MvxnuXeLKtHBjds7kOBMmFB860/vqN3ZNkzdXpikPbDjeJ3bxel77blcH il3qPOSOacVv1+LOpRuL1uvYu/ZpDSdAeWDDSXhkFxvm9QEsDhwG2D4tO4fF3IN69CSemZf3Xd3Y Ns1E65WnqQ+8PAlP7GLDvPBUd3lFTgZe7kvXJc6nJTcSERERERERERERET3Xf45RAZrRpl27AAAA AElFTkSuQmCC ------- =_aaaaaaaaaa0--