X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 042765370A for ; Tue, 5 Apr 2005 15:27:12 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 59100-05 for ; Tue, 5 Apr 2005 14:27:08 +0000 (GMT) Received: from rproxy.gmail.com (rproxy.gmail.com [64.233.170.205]) by svr1.postgresql.org (Postfix) with ESMTP id A4A5E537E0 for ; Tue, 5 Apr 2005 15:27:07 +0100 (BST) Received: by rproxy.gmail.com with SMTP id a41so1479743rng for ; Tue, 05 Apr 2005 07:27:12 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=Yiw+DcmYwYosxUAqBESFojOjpSjtqv6bh94GLjLRBBaCzZ0mMXon03TNN1ZSHKeVcNs8ztjrUrj1/DZ9hDA23lY28Gke1589WNwE1krVJOY1S8mLQ58oezmVuILrqsfcsxKwuhKEtuYuNfrj8ayVhaIsdjM7Ywe3gS3R/aAwbqg= Received: by 10.38.160.52 with SMTP id i52mr6341392rne; Tue, 05 Apr 2005 07:27:10 -0700 (PDT) Received: by 10.38.207.41 with HTTP; Tue, 5 Apr 2005 07:27:10 -0700 (PDT) Message-ID: <59d991c4050405072746774c61@mail.gmail.com> Date: Tue, 5 Apr 2005 10:27:10 -0400 From: Christopher Petrilli Reply-To: Christopher Petrilli To: Tom Lane Subject: Re: Sustained inserts per sec ... ? Cc: Greg Stark , jd@commandprompt.com, "Marc G. Fournier" , pgsql-performance@postgresql.org In-Reply-To: <59d991c405040421164aeea3fb@mail.gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit References: <20050401140421.P18194@ganymede.hub.org> <59d991c40504040648457808e9@mail.gmail.com> <26454.1112629979@sss.pgh.pa.us> <59d991c405040409094e7bbd17@mail.gmail.com> <26669.1112631807@sss.pgh.pa.us> <59d991c40504041846bc39a6@mail.gmail.com> <5217.1112668589@sss.pgh.pa.us> <87y8bxophw.fsf@stark.xeocode.com> <7438.1112673460@sss.pgh.pa.us> <59d991c405040421164aeea3fb@mail.gmail.com> X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.316 tagged_above=0 required=5 tests=AWL, DNS_FROM_RFC_ABUSE, RCVD_BY_IP X-Spam-Level: X-Archive-Number: 200504/85 X-Sequence-Number: 11482 On Apr 5, 2005 12:16 AM, Christopher Petrilli wrote: > Looking at preliminary results from running with shared_buffers at > 16000, it seems this may be correct. Performance was flatter for a > BIT longer, but slammed right into the wall and started hitting the > 3-30 second range per COPY. I've restarted the run, with fsync turned > on (fdatasync), and we'll see. > > My fear is that it's some bizarre situation interacting with both > issues, and one that might not be solvable. Does anyone else have > much experience with this sort of sustained COPY? Well, here's the results: http://www.amber.org/~petrilli/diagrams/pgsql_copy500_comparison.png The red is the run with shared_buffers turned up, but fsync off. The blue is the run with shared_buffers turned up, but fsync on. Note that it hits the wall sooner. Unfortunately, my brain is fried, and not sure what that means! Chris -- | Christopher Petrilli | petrilli@gmail.com