Content-Type: multipart/alternative;
 boundary="------------k0J5ImgFvpoUPgAh8uPAMtKS"
Message-ID: <0531a465-1fc3-4dcf-bf03-76a4407a2105@dunslane.net>
Date: Mon, 29 Jun 2026 12:22:18 -0400
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: hake failing on pgsql-Git kinda "random"
To: Mark Wong <markwkm@gmail.com>, Olaf Bohlen <olbohlen@eenfach.de>
Cc: buildfarm-members@lists.postgresql.org
References: <2F0B1C7F-A27D-42E2-A303-CC99D1E43CD0@eenfach.de>
 <akKTIQs-5grW0bts@ltdrgnflg2>
From: Andrew Dunstan <andrew@dunslane.net>
Content-Language: en-US
Autocrypt: addr=andrew@dunslane.net; keydata=
 xsBNBE7KWFkBCAClridxur2AIc7eW2AR7izbfp3EnNefie2HbLF0izW5Ik5UjX2HBXBx4syI
 gY6b0ugohXrr274+baoAlvSbq6cAoQuEVrk5IZFzt20b1Xkx65FwGSEj526yiKLocqkJceSq
 Xr9xcA5SGY+FZv441chh5SU92v4q6z+6LPpoHOh97ptAVXZYNTtU0LevyvD5lja0TzbvJm6C
 eFXitJfnm1pLEr0DGJCR/iUOl/N62Kh4855zZC7NHIjQHPOvV5Stz/l5ilDhvGVk+xkXFPys
 SjZoUr1rXhYLpiyi5sR0X9FHXT0KnGuz1F5ERO7ZTLSSQ6fJwPj6gOk9K+vvoKvoeql5ABEB
 AAHNJEFuZHJldyBEdW5zdGFuIDxhbmRyZXdAZHVuc2xhbmUubmV0PsLAlwQTAQgAQQIbAwIX
 gAIZAQULCQgHAwUVCgkICwUWAgMBAAIeBRYhBOQ+WEYd/Hy/RGkVpZn6f8tZ/DuBBQJoGNGd
 BQkdEO8nAAoJEJn6f8tZ/DuBq74H/jkTR4Zi3stbw+xC7v2u3QozssK7MYPL2AsVfh7OealS
 h182fiWXpfvmmAB7WUHbhk9GC2RAOnHI/2d2jgKaMLAHsGYOT0YopTVIwRY43fCw/mK67yxc
 wmDcX+zyKfLaivNbf5A7QPLNwda98bEAMSJ8Sn652Uc6cA8t3uKGsVzbRBQOoYzjgvBCfSrE
 9ql3PDNg0l4BfAqabd2f70ZUm9VAMEPrgv/v2xI7M2XiL4g5BVmqLCOwxLM8RMCotCuoweUr
 VO43DeBCIDwLxotMJKvGWDjBzQYlU1NPUAtNcz/gN9ITUe1VUGjyvGj4u1lxBOcQQUw7l1+T
 5moZ4iZxXzvOwE0ETspYWQEIANGc4zQULOxhbqO2dyD51YhqCNRmm9oKWaqf+wmW4tpDe/VV
 cxAnNizd4LWCHfzpb5cHAtGkOPePMfzWVf6nvdF7d3eglbtf59+zG7O7llV0xSSoFiieQBsr
 GvqDInXYX/4mRRXMtyhM353/tixC9RWLs1oofyYmCPPXXY7h9R7en3B8BoVrRFcdzlIY/NFN
 hFGW/9dkEiGjgna2Rk6e15kln4ZvFBWUg23p93w/pqXcxY6+k/8TEk+C4R+M6w7o2PLGOjdZ
 +kPiUcw5H85zf/yZJwQXzisXaNduwWB6Vads9YC9dj6kPR1c4VGRqAaYL++LAEOqrlvm2Tvq
 QqZRtnEAEQEAAcLAfAQYAQgAJgIbDBYhBOQ+WEYd/Hy/RGkVpZn6f8tZ/DuBBQJoGNI2BQkd
 EODdAAoJEJn6f8tZ/DuBfw0IAKTsfD40teP/pp+bsLLMSxPXUYrrprTj7WFB5v61p6dkpSr/
 qXmMlyahdxQFaPmfVgVirB1Vk/kHiWNnnGjfUV9nB2Zg9LI0Xb9/ts3LsUiRWXzG3tkMY6XL
 vsVOxW4XFRND9l2q+WW93aZ1DZl+fqWfYgMvsusFRhmGFOKTRfKPta2Pkv+AhA24N4+PrR5p
 bU4k2MO8PAGiK8eaYKGFG1bHKuAvoDoF7WXJ3FHxuWqLnKEt4dfOLm5pAe3zq1Lt6q8azT9i
 QWGpSAK5vQUWQHBHpiDjdPeqKZ6HiAXIIKfSmb+jrvXBqoP+D6/K7rUjG2aXiRtTIAXms9sm
 VRu7cmw=
In-Reply-To: <akKTIQs-5grW0bts@ltdrgnflg2>
Archived-At: 
 <https://www.postgresql.org/message-id/0531a465-1fc3-4dcf-bf03-76a4407a2105%40dunslane.net>
Precedence: bulk

This is a multi-part message in MIME format.
--------------k0J5ImgFvpoUPgAh8uPAMtKS
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit


On 2026-06-29 Mo 11:45 AM, Mark Wong wrote:
> Hi!
>
> On Mon, Jun 29, 2026 at 03:06:32PM +0200, Olaf Bohlen wrote:
>> Hi,
>>
>> I'm running the hake animal and after a server loss in April, everything should go smooth again. But now I have the problem that at random times hake failes in pgsql-Git. It works for days, and then out of the blue it stops.
>>
>> I have the following in my crontab:
>>
>> $ crontab -l | egrep -v "^#"
>> 15 3,10,16,21 * * * ( cd /export/home/elmer/c20x && PATH=/usr/gnu/bin:$PATH ./run_branches.pl --run-all --verbose >/export/home/elmer/c20x/cron.out 2>&1 )
>>
>> and the cron.out says:
>>
>> $ cat cron.out
>> Mon Jun 29 10:15:02 2026: buildfarm run for hake:REL_14_STABLE starting
>> hake:REL_14_STABLE [10:15:03] checking out source ...
>> Missing checked out branch bf_REL_14_STABLE:
>> fatal: not a git repository (or any of the parent directories): .git
>> hake:REL_14_STABLE [10:15:10] failed at stage pgsql-Git
>> Mon Jun 29 10:15:10 2026: buildfarm run for hake:REL_15_STABLE starting
>> hake:REL_15_STABLE [10:15:10] checking out source ...
>> Missing checked out branch bf_REL_15_STABLE:
>> fatal: not a git repository (or any of the parent directories): .git
>> hake:REL_15_STABLE [10:15:13] failed at stage pgsql-Git
>> Mon Jun 29 10:15:13 2026: buildfarm run for hake:REL_16_STABLE starting
>> hake:REL_16_STABLE [10:15:13] checking out source ...
>> Missing checked out branch bf_REL_16_STABLE:
>> fatal: not a git repository (or any of the parent directories): .git
>> hake:REL_16_STABLE [10:15:16] failed at stage pgsql-Git
>> Mon Jun 29 10:15:16 2026: buildfarm run for hake:REL_17_STABLE starting
>> hake:REL_17_STABLE [10:15:16] checking out source ...
>> Missing checked out branch bf_REL_17_STABLE:
>> fatal: not a git repository (or any of the parent directories): .git
>> hake:REL_17_STABLE [10:15:19] failed at stage pgsql-Git
>> Mon Jun 29 10:15:19 2026: buildfarm run for hake:REL_18_STABLE starting
>> hake:REL_18_STABLE [10:15:19] checking out source ...
>> Missing checked out branch bf_REL_18_STABLE:
>> fatal: not a git repository (or any of the parent directories): .git
>> hake:REL_18_STABLE [10:15:21] failed at stage pgsql-Git
>> Mon Jun 29 10:15:22 2026: buildfarm run for hake:HEAD starting
>> hake:HEAD          [10:15:22] checking out source ...
>> Missing checked out branch bf_HEAD:
>> fatal: not a git repository (or any of the parent directories): .git
>> hake:HEAD          [10:15:24] failed at stage pgsql-Git
>>
>> Once I delete the buildroot directory it starts working again for some days.
>>
>> Does anyone here has seen the same or an idea?
> I get that a lot on a number of the VM's I use with POWER and ARM.
> Andrew Dunstan has suggested I set "use_vpath => true".  I think that
> has helped...
>

Yes, that should help things. There also a patch not yet released that 
tries to avoid moving the .git directory and use git archive instead. 
See 
<https://github.com/PGBuildFarm/client-code/commit/2199960efbeaf60ce17a6f2ec28826f96eb621a8>

It's probably time for me to make a new release.

cheers

andrew

--
Andrew Dunstan
EDB:https://www.enterprisedb.com

--------------k0J5ImgFvpoUPgAh8uPAMtKS
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 7bit

<!DOCTYPE html>
<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 2026-06-29 Mo 11:45 AM, Mark Wong
      wrote:<br>
    </div>
    <blockquote type="cite" cite="mid:akKTIQs-5grW0bts@ltdrgnflg2">
      <pre wrap="" class="moz-quote-pre">Hi!

On Mon, Jun 29, 2026 at 03:06:32PM +0200, Olaf Bohlen wrote:
</pre>
      <blockquote type="cite">
        <pre wrap="" class="moz-quote-pre">Hi,

I'm running the hake animal and after a server loss in April, everything should go smooth again. But now I have the problem that at random times hake failes in pgsql-Git. It works for days, and then out of the blue it stops.

I have the following in my crontab:

$ crontab -l | egrep -v "^#"                     
15 3,10,16,21 * * * ( cd /export/home/elmer/c20x &amp;&amp; PATH=/usr/gnu/bin:$PATH ./run_branches.pl --run-all --verbose &gt;/export/home/elmer/c20x/cron.out 2&gt;&amp;1 )

and the cron.out says:

$ cat cron.out                                             
Mon Jun 29 10:15:02 2026: buildfarm run for hake:REL_14_STABLE starting
hake:REL_14_STABLE [10:15:03] checking out source ...
Missing checked out branch bf_REL_14_STABLE:
fatal: not a git repository (or any of the parent directories): .git
hake:REL_14_STABLE [10:15:10] failed at stage pgsql-Git
Mon Jun 29 10:15:10 2026: buildfarm run for hake:REL_15_STABLE starting
hake:REL_15_STABLE [10:15:10] checking out source ...
Missing checked out branch bf_REL_15_STABLE:
fatal: not a git repository (or any of the parent directories): .git
hake:REL_15_STABLE [10:15:13] failed at stage pgsql-Git
Mon Jun 29 10:15:13 2026: buildfarm run for hake:REL_16_STABLE starting
hake:REL_16_STABLE [10:15:13] checking out source ...
Missing checked out branch bf_REL_16_STABLE:
fatal: not a git repository (or any of the parent directories): .git
hake:REL_16_STABLE [10:15:16] failed at stage pgsql-Git
Mon Jun 29 10:15:16 2026: buildfarm run for hake:REL_17_STABLE starting
hake:REL_17_STABLE [10:15:16] checking out source ...
Missing checked out branch bf_REL_17_STABLE:
fatal: not a git repository (or any of the parent directories): .git
hake:REL_17_STABLE [10:15:19] failed at stage pgsql-Git
Mon Jun 29 10:15:19 2026: buildfarm run for hake:REL_18_STABLE starting
hake:REL_18_STABLE [10:15:19] checking out source ...
Missing checked out branch bf_REL_18_STABLE:
fatal: not a git repository (or any of the parent directories): .git
hake:REL_18_STABLE [10:15:21] failed at stage pgsql-Git
Mon Jun 29 10:15:22 2026: buildfarm run for hake:HEAD starting
hake:HEAD          [10:15:22] checking out source ...
Missing checked out branch bf_HEAD:
fatal: not a git repository (or any of the parent directories): .git
hake:HEAD          [10:15:24] failed at stage pgsql-Git

Once I delete the buildroot directory it starts working again for some days.

Does anyone here has seen the same or an idea?
</pre>
      </blockquote>
      <pre wrap="" class="moz-quote-pre">
I get that a lot on a number of the VM's I use with POWER and ARM.
Andrew Dunstan has suggested I set "use_vpath =&gt; true".  I think that
has helped...

</pre>
    </blockquote>
    <p><br>
    </p>
    <p>Yes, that should help things. There also a patch not yet released
      that tries to avoid moving the .git directory and use git archive
      instead. See
<a class="moz-txt-link-rfc2396E" href="https://github.com/PGBuildFarm/client-code/commit/2199960efbeaf60ce17a6f2ec28826f96eb621a8">&lt;https://github.com/PGBuildFarm/client-code/commit/2199960efbeaf60ce17a6f2ec28826f96eb621a8&gt;</a></p>
    <p>It's probably time for me to make a new release.</p>
    <p><span style="white-space: pre-wrap">
</span></p>
    <p><span style="white-space: pre-wrap">cheers</span></p>
    <p><span style="white-space: pre-wrap">
</span></p>
    <p><span style="white-space: pre-wrap">andrew</span></p>
    <pre class="moz-signature"
    signature-switch-id="d0437855-2267-4610-80b3-83167ec45b0b" cols="72">--
Andrew Dunstan
EDB: <a class="moz-txt-link-freetext" href="https://www.enterprisedb.com">https://www.enterprisedb.com</a>
</pre>
  </body>
</html>

--------------k0J5ImgFvpoUPgAh8uPAMtKS--