Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mmBFm-0003b2-Hj for pgsql-www@arkaria.postgresql.org; Sun, 14 Nov 2021 08:52:46 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1mmBFj-0006ri-M1 for pgsql-www@arkaria.postgresql.org; Sun, 14 Nov 2021 08:52:43 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mmBFj-0006rZ-EA for pgsql-www@lists.postgresql.org; Sun, 14 Nov 2021 08:52:43 +0000 Received: from imp.madness.at ([2a02:16a8:dc41::218]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mmBFg-0007yl-LS for pgsql-www@lists.postgresql.org; Sun, 14 Nov 2021 08:52:42 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=kaltenbrunner.cc; s=20190215; h=Content-Transfer-Encoding:Content-Type: In-Reply-To:MIME-Version:Date:Message-ID:References:To:From:Subject:Sender: Reply-To:Cc:Content-ID:Content-Description; bh=EvBkw3u0d4MZKKwxip5CxCLGlgxVRJYoQvvR0UaZFAc=; b=KmBfzdq13bARcTjXM6sHh4sa2K 2FHzuAN+KATtRAgplZ2WEJGfEtAgRnVvXjtFqjJ2iZQQCezoi6fGZ2UHMvJUJ52t9bFQeISITEoiN /9JjAtsv4ktIAd1m2agntWC8LK/8DPya0XLHIUFyBMm5l27B0Zv2qjIs10SPFXLwF6+zd1M3V41+O 7b7KFfFprSVEiMxcj9yDh0z+12iDJ/n+g27T+zzI6qUhYt6Jmr3IfobOJKBFVc04RGaYch+i11kFk 5wNRSo2xuIrjQBicVOQ9VSLqVwNhVJKPjA3iDUZ2hyriei+IXHyN4SShrRBq2g4GjRkGZeiDXtFg0 NN/aLMmw==; Received: from [83.215.245.171] (helo=[192.168.8.98]) by imp.madness.at with esmtpsa (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1mmBFd-0008Nt-F7 for pgsql-www@lists.postgresql.org; Sun, 14 Nov 2021 09:52:39 +0100 Subject: Re: service outage on panora.postgresql.org From: Stefan Kaltenbrunner To: PostgreSQL WWW References: <4eba3256-fbb0-8a44-21cb-9566b8a564b0@kaltenbrunner.cc> Message-ID: Date: Sun, 14 Nov 2021 09:52:36 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 11/13/21 11:29 PM, Stefan Kaltenbrunner wrote: > On 11/13/21 10:46 PM, Stefan Kaltenbrunner wrote: >> Hi all! >> >> We are currently experiencing an outage of one of our >> vmhosts(panora.postgresql.org) which is affecting the following >> production services(among some internal systems): >> >> brekka.postgresql.org (aka buildfarm.postgresql.org) >> >> >> We are working on the issue but atm I have not ETA for a solution >> because it is not entirely clear what the actual issue is (other than >> that the box has no working network atm). > > to be more specific on this - those systems lost IPv4 connectivity but > are still reachable over IPv6 but also all services are impaired by > being unable to connect to any IPv4 host(inkluding DNS). services should be back for now - root cause is still somewhat unclear and we will likely need a few more reboots of the box in the next few days to nail this down... Sorry for the inconvenience :/ Stefan