Received: from malur.postgresql.org ([2a02:16a8:dc51::56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1fYK2O-0006yQ-F0 for pgsql-hackers@arkaria.postgresql.org; Wed, 27 Jun 2018 23:39:48 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1fYK2N-0003Jp-5G for pgsql-hackers@arkaria.postgresql.org; Wed, 27 Jun 2018 23:39:47 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1fYK2M-0003Ji-Qh for pgsql-hackers@lists.postgresql.org; Wed, 27 Jun 2018 23:39:46 +0000 Received: from mail-io0-x22e.google.com ([2607:f8b0:4001:c06::22e]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1fYK2J-0001FT-8L for pgsql-hackers@postgresql.org; Wed, 27 Jun 2018 23:39:46 +0000 Received: by mail-io0-x22e.google.com with SMTP id k16-v6so3477004ioa.8 for ; Wed, 27 Jun 2018 16:39:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:subject:message-id:mime-version:content-disposition :user-agent; bh=4AK7hLrUr5CvqcP+XmxHmbmOmrVxKKOk6OGctGvrBdI=; b=q4cyxtrQEWdU6YxgVJDU0Z2F54ijkuk7B0JW0n3Nk3ifs0n724QgLRO7w9gyxPJrN5 o8oXGx3xcFyKFvJpVeuh647a/jQ70eRp2DQB99Wx8HD9jFPaB4okCXmxfBOjv++w4WjF nXmirF6bGAq8jA3gXxQWegPuVntdCcJ0u8LGrfNNlgr/21v9hmz3O3TduMJGorVQU91p XjClJ79Qy/o1yeLAGg5OXQbmojoW3WYfjYR96DWR/fWlh+G9yUKM7xAxvanhcY0UEURV 6W0IwYbPSTe1ctSiajgSU7FbHUH58o7OB67MA/mWz2lOtyTpcoGROGjBToq9LSv9YXEB VUNw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:subject:message-id:mime-version :content-disposition:user-agent; bh=4AK7hLrUr5CvqcP+XmxHmbmOmrVxKKOk6OGctGvrBdI=; b=fbfEDw+NeM51W9GdAbhPMDzTflUq7VtfixvRM4QBHluFHriCGfjMpkYlbotut6ONFQ m7UkN1EBxDS/T8JOV7+xPkiadjVSbZhC+slD9rvS2J/Zgl5fzmGXB2TY6m7NyMdmVAm9 TJLMX3L46wzY/kuinT3am3DWWpRJulhai9q5N5iuEsVjpEnaw6f7p80i3oseim9At2zP 7MIXn5aMxImVuBVszWGysqHJb71av8jzz1y1Wlyfkiv09Ol1cVeFKT8tLqxSuCen6WJY fdVYIIUllTpE0Z6vS6HsG9e1lEvB0MiSf22y5KyWB8rXSy2SpMYP9uYGWM73mWG/BROS 1G2g== X-Gm-Message-State: APt69E1g6IhjIi45ywo3DuuwxInuQTGjEV8Z4HYxmr5EcznLDVqPJjju 5r2qVGShGcBMySHgzpK+6T7xXy5bKQM= X-Google-Smtp-Source: AAOMgpfH1zODYQDWYrKTAF6CKdJZAOECTLdMuQJYkiVIlWXYxgeDJ4xuyX3Naktd/1LAV2i6HlN6YA== X-Received: by 2002:a6b:f711:: with SMTP id k17-v6mr6566961iog.219.1530142781141; Wed, 27 Jun 2018 16:39:41 -0700 (PDT) Received: from pryzbyj (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id 192-v6sm3460030itl.41.2018.06.27.16.39.40 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 27 Jun 2018 16:39:40 -0700 (PDT) Received: by pryzbyj (Postfix, from userid 1000) id 5CD1E80203D; Wed, 27 Jun 2018 18:39:39 -0500 (CDT) Date: Wed, 27 Jun 2018 18:39:39 -0500 From: Justin Pryzby To: PostgreSQL Hackers Subject: ENOSPC FailedAssertion("!(RefCountErrors == 0)" Message-ID: <20180627233939.GA10276@telsasoft.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.23 (2014-03-12) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk While grepping logs, I came across this crash, which I caused while adding many indices in a test environment. I don't know that there's any reason to believe one way or the other if this is specific to running on pg11b1. < 2018-06-17 11:38:45.465 CDT pryzbyj >FATAL: the database system is in recovery mode < 2018-06-17 11:38:45.466 CDT pryzbyj >FATAL: the database system is in recovery mode < 2018-06-17 11:38:45.468 CDT >FATAL: could not extend file "base/17379/38665798": No space left on device < 2018-06-17 11:38:45.468 CDT >HINT: Check free disk space. < 2018-06-17 11:38:45.468 CDT >CONTEXT: WAL redo at 2AA/239676B8 for Heap/INSERT+INIT: off 1 < 2018-06-17 11:38:45.468 CDT >WARNING: buffer refcount leak: [2366] (rel=base/17379/38665798, blockNum=1241, flags=0x8a000000, refcount=1 1) TRAP: FailedAssertion("!(RefCountErrors == 0)", File: "bufmgr.c", Line: 2523) Unfortunately, I have neither a core nor stacktrace to share, as the DB was (until after running out of space) on the same FS as /var :( Jun 17 11:38:42 localhost abrt[30526]: Aborting dump: only 30MiB is available on /var/spool/abrt Jun 17 11:38:45 localhost abrt[1261]: Aborting dump: only 16MiB is available on /var/spool/abrt Not sure how useful it's to crash test ENOSPC (although I see there's continuing patches for this case). Justin