Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1s3txm-00GV66-AF for pgsql-bugs@arkaria.postgresql.org; Mon, 06 May 2024 08:44:46 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1s3txj-00BgvL-M7 for pgsql-bugs@arkaria.postgresql.org; Mon, 06 May 2024 08:44:44 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1s3txj-00BgvD-C5 for pgsql-bugs@lists.postgresql.org; Mon, 06 May 2024 08:44:44 +0000 Received: from mx0b-00134001.pphosted.com ([205.220.172.129]) by magus.postgresql.org with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1s3txg-001oUz-Fy for pgsql-bugs@lists.postgresql.org; Mon, 06 May 2024 08:44:43 +0000 Received: from pps.filterd (m0267962.ppops.net [127.0.0.1]) by mx0a-00134001.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 445MtQo8023840; Mon, 6 May 2024 08:44:35 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiver.com; h= from:to:cc:date:message-id:references:in-reply-to:content-type :content-transfer-encoding:mime-version:subject; s=mail; bh=rL0/ q1lIf/DkIaXrkOVtXRHtqdxe0hMNGQ3DpwTnFj4=; b=KI5Uz9Xu46TocEfgONKL ue95VabwRA91jYa0l7SiPTXBYrzQQQ6dyKQDUhR6a9nwaRkCQ/EDuAemwTOkeUOe NzA8OcUrZ8VJ6Uib3WOVA1pNvN4IsnY7brv9n8RtT08Ks9U9SFHTTGfM0KX4yRg/ zIksTCNPtFe8qgYgy3IW9dLHI38d7ylvDRyKl+4+TIAvfnIsWdi/AA3GpoEgpiYj ghbuIvdwyCXwCXIP3evvg6sOAR1F7Dq38FdDPXbcSnm04NwF+DaFVQOGniWhjyKj K7LTASZDHhHZeN+JUHdwCT/4QTfodohPzpF9XYvawsq10GDW8CijpJnsyypNwqGD TQ== Received: from opammb1267.comp.optiver.com ([195.246.114.78]) by mx0a-00134001.pphosted.com (PPS) with ESMTPS id 3xwavphcn8-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 06 May 2024 08:44:35 +0000 (GMT) Received: from opammb1267.comp.optiver.com (100.68.11.12) by opammb1267.comp.optiver.com (100.68.11.12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1118.26; Mon, 6 May 2024 10:44:34 +0200 Received: from opammb1267.comp.optiver.com ([fe80::5b6f:1976:98cd:68a7]) by opammb1267.comp.optiver.com ([fe80::5b6f:1976:98cd:68a7%13]) with mapi id 15.02.1118.026; Mon, 6 May 2024 10:44:34 +0200 From: Floris Van Nee To: Andres Freund CC: Tom Lane , "pgsql-bugs@lists.postgresql.org" Thread-Topic: [External] Re: error "can only drop stats once" brings down database [External] Thread-Index: AQHaZC2BJX3cZ68Gf0SnR3ukCGL5orGGQZEwgALhs4CAAGv+AIAAxH3g Date: Mon, 6 May 2024 08:44:34 +0000 Message-ID: <40d6f8b377e446dc860d8b2c02fc9d99@Optiver.com> References: <215498.1708454947@sss.pgh.pa.us> <8e5cb534706a4f43bd74405c8fd91437@Optiver.com> <20240505160915.6boysum4f34siqct@awork3.anarazel.de> <20240505223546.6yvjzgqifuoiii3e@awork3.anarazel.de> In-Reply-To: <20240505223546.6yvjzgqifuoiii3e@awork3.anarazel.de> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [100.68.31.121] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: RE: error "can only drop stats once" brings down database X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1011,Hydra:6.0.650,FMLib:17.11.176.26 definitions=2024-05-06_04,2024-05-03_02,2023-05-22_02 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk >=20 > Could you confirm that you have a) a lot of oid assignments b) your start= up > process was running for a long time by the time of the crash? >=20 Thanks Andres. Both higher than average I guess, although it depends on wha= t is considered 'a lot' and 'a long time'. The startup process was running = for a few months. There are ~500k entries in pg_class, of which most are (T= imescale) partitions. However, even with this number of items in pg_class I= would't expect wraparound to happen frequently? These are not dropped/recr= eated. I've monitored "select count(*) from pg_class" for a while to see if= it changes often, and while there are changes during the day (likely tempo= rary tables being created), it also doesn't nearly happen at a frequency th= at will get us to a wraparound quickly. Oids aren't just consumed by pg_class though. And I do see system oid growi= ng quickly (when doing CREATE TABLE twice with a minute in between, then ch= ecking the oid difference of the table). I don't know how to investigate th= e cause of this. What would be the best way to check what could be consumin= g these oids so quickly? -Floris