Message-ID: <ac048790-dc72-4306-9397-9fab8fc79a46@dunslane.net>
Date: Tue, 11 Jun 2024 12:13:30 -0400
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
From: Andrew Dunstan <andrew@dunslane.net>
Content-Language: en-US
Subject: Keeping track of buildfarm animals' personality
Autocrypt: addr=andrew@dunslane.net; keydata=
 xsBNBE7KWFkBCAClridxur2AIc7eW2AR7izbfp3EnNefie2HbLF0izW5Ik5UjX2HBXBx4syI
 gY6b0ugohXrr274+baoAlvSbq6cAoQuEVrk5IZFzt20b1Xkx65FwGSEj526yiKLocqkJceSq
 Xr9xcA5SGY+FZv441chh5SU92v4q6z+6LPpoHOh97ptAVXZYNTtU0LevyvD5lja0TzbvJm6C
 eFXitJfnm1pLEr0DGJCR/iUOl/N62Kh4855zZC7NHIjQHPOvV5Stz/l5ilDhvGVk+xkXFPys
 SjZoUr1rXhYLpiyi5sR0X9FHXT0KnGuz1F5ERO7ZTLSSQ6fJwPj6gOk9K+vvoKvoeql5ABEB
 AAHNJEFuZHJldyBEdW5zdGFuIDxhbmRyZXdAZHVuc2xhbmUubmV0PsLAmwQTAQgARQIbAwIX
 gAIZAQULCQgHAgMiAgEGFQoJCAsCBBYCAwECHgcWIQTkPlhGHfx8v0RpFaWZ+n/LWfw7gQUC
 ZFlxxwUJGVGAbgAKCRCZ+n/LWfw7gXikB/9ZdcUy6CTBFIIuL/bVsc1eLEW/gJBjJBF6HxNY
 xgEkAgXAp4Lg4A5U+QB9GouFr7+GYxF0BU4hzoGhNPUWltxnHdMWP8nC/38LAqgMi8L/bbsm
 HW5YPBdWYaAZAPJQVfOAgjTbRUb26KSprpyrrJKW0ZmrZfjhNPcQ72jpWzoPLQqx2X6B0fru
 1jq+cBh8lb6r1mJTim1T3JIn+F/v5VpdQS+EL8xqsHkfzKjIPsW3CIXpkypSk6saA55Rkkbl
 26AW8ftPVB0Q6Lnn6FLt9CP0MGNixBQ55yq8r1K+nCBvCCjvQjM8RDm0UUum0WNl+ifQgTLO
 E8TWEnwVtkBf+3QWzsBNBE7KWFkBCADRnOM0FCzsYW6jtncg+dWIagjUZpvaClmqn/sJluLa
 Q3v1VXMQJzYs3eC1gh386W+XBwLRpDj3jzH81lX+p73Re3d3oJW7X+ffsxuzu5ZVdMUkqBYo
 nkAbKxr6gyJ12F/+JkUVzLcoTN+d/7YsQvUVi7NaKH8mJgjz112O4fUe3p9wfAaFa0RXHc5S
 GPzRTYRRlv/XZBIho4J2tkZOnteZJZ+GbxQVlINt6fd8P6al3MWOvpP/ExJPguEfjOsO6Njy
 xjo3WfpD4lHMOR/Oc3/8mScEF84rF2jXbsFgelWnbPWAvXY+pD0dXOFRkagGmC/viwBDqq5b
 5tk76kKmUbZxABEBAAHCwHwEGAEIACYCGwwWIQTkPlhGHfx8v0RpFaWZ+n/LWfw7gQUCZFlx
 5wUJGVGAjgAKCRCZ+n/LWfw7gf+iB/4g8CPY5jihf5r/8EsoIGe2H+dpVmpPF8YGBzTIvCz/
 fQoOq8AX/pE76QEuFnFZWfjw+wgBXgCVmkox2Eflkk6z4ND3pcwGZ6CfCxTQCDk/dij+2DQ4
 6bmDCy/sBgcbz9mTpoLC11HLoPae6YN9nBNQRZDcEFEu54OaVOqlIdbA6m+POIBCXZdHOFc0
 WoDTgxHRzC1jgQNidyd6tKqcsVJs0dzF0oKTmFFmUAqTdJO12LBuNA1rlqrR3EtpYk8B/wtS
 5dIMD7Q8hwQpL+4C6GNpb6ZKnPkLi47pDOLhz2qBrqN+rqUEsT3YnExYpzj5yOBi+FlmV1Hw
 49QYe1sn2ZPs
To: PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Archived-At: <https://www.postgresql.org/message-id/ac048790-dc72-4306-9397-9fab8fc79a46%40dunslane.net>
Precedence: bulk

Way back in 2004 there was discussion of how we wanted to differentiate 
buildfarm animals. We were flying blind to a large extent, as we didn't 
have many similar things to compare to. We settled on {OS-name, 
OS-version, Compiler-name, Compiler-version}. The idea was that the 
names would be invariant but we would allow for OS and compiler upgrades.

There are two problems with this system, and have been since the get-go. 
First, owners forget to run the upgrade-personalty.pl script when the 
upgrade the OS and./or compiler. Second, there is no standardization of 
the names. Complaints about these surfaced (again) at the Vancouver 
unconference session about the buildfarm's future.

It was suggested that we should have the buildfarm client collect 
information and report it in a piece of JSON which the server would then 
use to update the personality table automatically. However, there are 
some issues.

First there are issues of the source of information. And second there is 
what information to extract from the source.

Let's take the simple case. On Linux this is fairly straightforward in 
most cases. We can extract the "ID" and "VERSION_ID" attributes from 
/etc/os-release, and we can get the compiler version with  gcc--version 
or clang --version, and get the version number out of the first line. I 
think I'd strip out the vendor string, so it would just be something 
like "13.2.1".

On windows, systeminfo gives you this sort of information:

OS Name: Microsoft Windows Server 2019 Datacenter

I guess by analogy with Linux we'd say that the OS Name is "Windows 
Server" and the version just "2019".

cl /? shows you a version line we could similarly parse to get something 
like 19.40.33808. We might want a way to tie that back to a particular 
version of VS, but it would do for now.

For msys2 and cygwin we can get the version by calling "cygcheck 
--version". These two are complicated by the fact that they are virtual 
environments.

I don't have information about other OSs or compilers.

For now I'm intending just to collect the information and see what gaps 
we have, before I start automating personality update.

If you have information about an OS or Compiler that's used in the 
buildfarm that I haven't listed, please let me know.


cheers


andrew

--
Andrew Dunstan
EDB: https://www.enterprisedb.com