Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sHL2o-006Dmc-Du for pgsql-hackers@arkaria.postgresql.org; Wed, 12 Jun 2024 10:17:31 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1sHL2m-00G8ir-Ih for pgsql-hackers@arkaria.postgresql.org; Wed, 12 Jun 2024 10:17:29 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sHL2m-00G8hX-3g for pgsql-hackers@lists.postgresql.org; Wed, 12 Jun 2024 10:17:29 +0000 Received: from mail-qt1-x835.google.com ([2607:f8b0:4864:20::835]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1sHL2i-000wIX-QV for pgsql-hackers@postgresql.org; Wed, 12 Jun 2024 10:17:27 +0000 Received: by mail-qt1-x835.google.com with SMTP id d75a77b69052e-4405e343dd8so11469121cf.1 for ; Wed, 12 Jun 2024 03:17:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dunslane-net.20230601.gappssmtp.com; s=20230601; t=1718187443; x=1718792243; darn=postgresql.org; h=content-transfer-encoding:in-reply-to:autocrypt:content-language :from:references:cc:to:subject:user-agent:mime-version:date :message-id:from:to:cc:subject:date:message-id:reply-to; bh=Vxw9jIVoXp2TP5gxFexYrNN6xEA4t9LpHYa6Urb+LSE=; b=KUmg4b0f7kJxKA//fhJolcnY3T48xSDrIYFifoBIm9Nj1GkVuj9PL5HFa17rXVWE8N VaZiLwsv0IlXTa2pVeyvAIRiyLOiohgxqcZmU1QND2IlOzhurU/QlYvu4q97p9K/NfTg r2Y91KusdXj51yV0Ais5o3uzhfes3GK07Z4SlKFenTSflgj93x884DJy/fYhTxgw8Rzg frwHkWVXnRRPC7UIa3dHvUqNn6CmmLZBbp/zbEIJI1NkpKfKZ0ggY0P+NxMmn7u7R4lt Mw4r2J+RSf2ckDw8IOlfQCsZeQBuY7EEDlcLNr38Gaq4gVXN8/BLNDzHpQ3qzywSHk/f +5qQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1718187443; x=1718792243; h=content-transfer-encoding:in-reply-to:autocrypt:content-language :from:references:cc:to:subject:user-agent:mime-version:date :message-id:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Vxw9jIVoXp2TP5gxFexYrNN6xEA4t9LpHYa6Urb+LSE=; b=GwJXHaQidJYFYEcE38c/POTqjnYIyOigMlMxOEf8DPESXYz3bjXrc7/djWqMLVL1Z/ fWUXf00QC/0OTwaLcQRnvRQs71C8FOkjDA3TFv+8grTN8bC9fdNIeynnNHhnvt7dok5W ZWFT4EVHbAZ8bZeoLEIPusEAPry2vlEQpHzbHN7glrrSmSau5qXwdTCbUeb87ZOZ6ooK QbEjbf9g65ZwC3KStkyavd/DL5qp++r49Y1fv9zE/5+aoSvKW2K6BhmaRCuoaq2E0JtT wuKW2l/EiQlqt/n7WkPRwUy6JrK9C3zRHDeDnKL9cSlluhRETn0QkbdA2VIOXijc5y9f 0aAw== X-Forwarded-Encrypted: i=1; AJvYcCVKm9AJaSGoO7nnMxxT6mKPiGRmPqPeP0TJnNTK/6NxAcM0BeyEZeDtXnvGwiK6hiDLqywVRnpILGmzWO0SGKPFeErLZ/ckO+532/W/ X-Gm-Message-State: AOJu0YyC7cxK8lOO9o2tPbPRk4P9EPC9LYxebJQpSEqXfgTv6vZuvPBN zdG61OSrvFLHanR8n7MM1XfTLpVcEb3Y1BOOfCB6mYM2kRIS0imvH9imDFaOcN4= X-Google-Smtp-Source: AGHT+IGbeZqSOy8iNh3GOrOwF8+PXIakcN1DEe4HcWuHX/QwKzAPUmsTEKgIRjXq7af2pNL04ac2uA== X-Received: by 2002:ac8:5a15:0:b0:441:46e8:1901 with SMTP id d75a77b69052e-4415abf4d61mr14909751cf.31.1718187443397; Wed, 12 Jun 2024 03:17:23 -0700 (PDT) Received: from ?IPV6:2605:a601:9180:9800::2bb? ([2605:a601:9180:9800::2bb]) by smtp.googlemail.com with ESMTPSA id d75a77b69052e-44116b8f334sm20906791cf.6.2024.06.12.03.17.22 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 12 Jun 2024 03:17:22 -0700 (PDT) Message-ID: <65ba359b-9a0e-4116-83fa-ce3b8cdb01ad@dunslane.net> Date: Wed, 12 Jun 2024 06:17:21 -0400 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: RFC: adding pytest as a supported test framework To: Noah Misch , Andres Freund Cc: Jacob Champion , PostgreSQL Hackers References: <20240610200411.byj6sv2vpgol6wcf@awork3.anarazel.de> <00c5efe6-1abb-42f8-a9a7-ed3a055c4b92@dunslane.net> <20240611014911.khxuai5fy2ssbmiw@awork3.anarazel.de> <20240611234829.9d@rfd.leadboat.com> From: Andrew Dunstan Content-Language: en-US Autocrypt: addr=andrew@dunslane.net; keydata= xsBNBE7KWFkBCAClridxur2AIc7eW2AR7izbfp3EnNefie2HbLF0izW5Ik5UjX2HBXBx4syI gY6b0ugohXrr274+baoAlvSbq6cAoQuEVrk5IZFzt20b1Xkx65FwGSEj526yiKLocqkJceSq Xr9xcA5SGY+FZv441chh5SU92v4q6z+6LPpoHOh97ptAVXZYNTtU0LevyvD5lja0TzbvJm6C eFXitJfnm1pLEr0DGJCR/iUOl/N62Kh4855zZC7NHIjQHPOvV5Stz/l5ilDhvGVk+xkXFPys SjZoUr1rXhYLpiyi5sR0X9FHXT0KnGuz1F5ERO7ZTLSSQ6fJwPj6gOk9K+vvoKvoeql5ABEB AAHNJEFuZHJldyBEdW5zdGFuIDxhbmRyZXdAZHVuc2xhbmUubmV0PsLAmwQTAQgARQIbAwIX gAIZAQULCQgHAgMiAgEGFQoJCAsCBBYCAwECHgcWIQTkPlhGHfx8v0RpFaWZ+n/LWfw7gQUC ZFlxxwUJGVGAbgAKCRCZ+n/LWfw7gXikB/9ZdcUy6CTBFIIuL/bVsc1eLEW/gJBjJBF6HxNY xgEkAgXAp4Lg4A5U+QB9GouFr7+GYxF0BU4hzoGhNPUWltxnHdMWP8nC/38LAqgMi8L/bbsm HW5YPBdWYaAZAPJQVfOAgjTbRUb26KSprpyrrJKW0ZmrZfjhNPcQ72jpWzoPLQqx2X6B0fru 1jq+cBh8lb6r1mJTim1T3JIn+F/v5VpdQS+EL8xqsHkfzKjIPsW3CIXpkypSk6saA55Rkkbl 26AW8ftPVB0Q6Lnn6FLt9CP0MGNixBQ55yq8r1K+nCBvCCjvQjM8RDm0UUum0WNl+ifQgTLO E8TWEnwVtkBf+3QWzsBNBE7KWFkBCADRnOM0FCzsYW6jtncg+dWIagjUZpvaClmqn/sJluLa Q3v1VXMQJzYs3eC1gh386W+XBwLRpDj3jzH81lX+p73Re3d3oJW7X+ffsxuzu5ZVdMUkqBYo nkAbKxr6gyJ12F/+JkUVzLcoTN+d/7YsQvUVi7NaKH8mJgjz112O4fUe3p9wfAaFa0RXHc5S GPzRTYRRlv/XZBIho4J2tkZOnteZJZ+GbxQVlINt6fd8P6al3MWOvpP/ExJPguEfjOsO6Njy xjo3WfpD4lHMOR/Oc3/8mScEF84rF2jXbsFgelWnbPWAvXY+pD0dXOFRkagGmC/viwBDqq5b 5tk76kKmUbZxABEBAAHCwHwEGAEIACYCGwwWIQTkPlhGHfx8v0RpFaWZ+n/LWfw7gQUCZFlx 5wUJGVGAjgAKCRCZ+n/LWfw7gf+iB/4g8CPY5jihf5r/8EsoIGe2H+dpVmpPF8YGBzTIvCz/ fQoOq8AX/pE76QEuFnFZWfjw+wgBXgCVmkox2Eflkk6z4ND3pcwGZ6CfCxTQCDk/dij+2DQ4 6bmDCy/sBgcbz9mTpoLC11HLoPae6YN9nBNQRZDcEFEu54OaVOqlIdbA6m+POIBCXZdHOFc0 WoDTgxHRzC1jgQNidyd6tKqcsVJs0dzF0oKTmFFmUAqTdJO12LBuNA1rlqrR3EtpYk8B/wtS 5dIMD7Q8hwQpL+4C6GNpb6ZKnPkLi47pDOLhz2qBrqN+rqUEsT3YnExYpzj5yOBi+FlmV1Hw 49QYe1sn2ZPs In-Reply-To: <20240611234829.9d@rfd.leadboat.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 2024-06-11 Tu 19:48, Noah Misch wrote: > On Mon, Jun 10, 2024 at 06:49:11PM -0700, Andres Freund wrote: >> On 2024-06-10 16:46:56 -0400, Andrew Dunstan wrote: >>> On 2024-06-10 Mo 16:04, Andres Freund wrote: >>>> Just for context for the rest the email: I think we desperately need to move >>>> off perl for tests. The infrastructure around our testing is basically >>>> unmaintained and just about nobody that started doing dev stuff in the last 10 >>>> years learned perl. >>> As for what up and coming developers learn, they mostly don't learn C >>> either, and that's far more critical to what we do. >> C is a a lot more useful to to them than perl. And it's actually far more >> widely known these days than perl. > If we're going to test in a non-Perl language, I'd pick C over Python. There > would be several other unlikely-community-choice languages I'd pick over > Python (C#, Java, C++). We'd need a library like today's Perl > PostgreSQL::Test to make C-language tests nice, but the same would apply to > any new language. Indeed. We've invested quite a lot of effort on that infrastructure. I guess people can learn from what we've done so a second language might be easier to support. (Java would be my pick from your unlikely set, but I can see the attraction of Python.) > > I also want the initial scope to be the new language coexisting with the > existing Perl tests. If a bulk translation ever happens, it should happen > long after the debut of the new framework. That said, I don't much trust a > human-written bulk language translation to go through without some tests > accidentally ceasing to test what they test in Perl today. +1 cheers andrew -- Andrew Dunstan EDB: https://www.enterprisedb.com