X-Original-To: pgsql-general@postgresql.org Received: from spampd.localdomain (postgresql.org [64.49.215.8]) by postgresql.org (Postfix) with ESMTP id C4DF0475F00; Sat, 10 May 2003 11:18:20 -0400 (EDT) Received: from news.hub.org (news.hub.org [64.49.215.80]) by postgresql.org (Postfix) with ESMTP id 57C114758F1; Sat, 10 May 2003 11:18:15 -0400 (EDT) Received: by news.hub.org (Postfix, from userid 8) id 3C38143A89E; Sat, 10 May 2003 11:18:15 -0400 (EDT) From: "Adam Siegel" X-Newsgroups: comp.databases.postgresql.hackers, comp.databases.postgresql.performance, comp.databases.postgresql.questions Subject: realtime data inserts Date: Sat, 10 May 2003 11:25:16 -0400 Organization: Hub.Org Networking Services (http://www.hub.org) Lines: 12 Message-ID: X-Complaints-To: usenet@news.hub.org X-Newsreader: Microsoft Outlook Express 6.00.2800.1158 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165 To: pgsql-hackers@postgresql.org, pgsql-performance@postgresql.org, pgsql-general@postgresql.org X-Spam-Status: No, hits=-6.6 required=5.0 tests=BAYES_01 version=2.50 X-Spam-Level: X-Spam-Checker-Version: SpamAssassin 2.50 (1.173-2003-02-20-exp) X-Archive-Number: 200305/320 X-Sequence-Number: 41975 I have realtime data flowing at a rate of 500, 512 byte packets per second. I want to log the info in a database table with two other columns, one for a timestamp and one for a name of the packet. The max rate I can achieve is 350 inserts per second on a sun blade 2000. The inserts are grouped in a transaction and I commit every 1200 records. I am storing the binary data in a bytea. I am using the libpq conversion function. Not sure if that is slowing me down. But I think it is the insert not the conversion. Any thoughts on how to achive this goal?