X-Original-To: pgsql-general@postgresql.org Received: from spampd.localdomain (postgresql.org [64.49.215.8]) by postgresql.org (Postfix) with ESMTP id B6DF9476022 for ; Sat, 10 May 2003 11:58:50 -0400 (EDT) Received: from w3matter.com (weightlossfriends.com [66.246.13.45]) by postgresql.org (Postfix) with SMTP id 0E3804758F1 for ; Sat, 10 May 2003 11:58:49 -0400 (EDT) Received: (qmail 16300 invoked from network); 10 May 2003 15:58:49 -0000 Received: from pool-162-84-215-56.ny5030.east.verizon.net (HELO did-it.com) (162.84.215.56) by 0 with SMTP; 10 May 2003 15:58:49 -0000 Message-ID: <3EBD228A.8000901@did-it.com> Date: Sat, 10 May 2003 12:02:18 -0400 From: Ericson Smith User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.3b) Gecko/20030404 Minotaur/0.1a X-Accept-Language: en-us, en MIME-Version: 1.0 To: Adam Siegel Cc: pgsql-hackers@postgresql.org, pgsql-performance@postgresql.org, pgsql-general@postgresql.org Subject: Re: realtime data inserts References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, hits=-35.1 required=5.0 tests=BAYES_01,EMAIL_ATTRIBUTION,IN_REP_TO,RCVD_IN_OSIRUSOFT_COM, REFERENCES,REPLY_WITH_QUOTES,USER_AGENT_MOZILLA_UA version=2.50 X-Spam-Level: X-Spam-Checker-Version: SpamAssassin 2.50 (1.173-2003-02-20-exp) X-Archive-Number: 200305/322 X-Sequence-Number: 41977 Had the same problem recently... Format your data like a pg text dump into a file and then... COPY (a,b,c) FROM stdin; 1 2 3 4 5 6 \. psql I have realtime data flowing at a rate of 500, 512 byte packets per second. >I want to log the info in a database table with two other columns, one for a >timestamp and one for a name of the packet. The max rate I can achieve is >350 inserts per second on a sun blade 2000. The inserts are grouped in a >transaction and I commit every 1200 records. I am storing the binary data >in a bytea. I am using the libpq conversion function. Not sure if that is >slowing me down. But I think it is the insert not the conversion. > >Any thoughts on how to achive this goal? > > >---------------------------(end of broadcast)--------------------------- >TIP 4: Don't 'kill -9' the postmaster > >