From: Fernando Hevia <fhevia@ip-tel.com.ar>
To: 'dforums' <dforums@vieonet.com>
To: 'Scott Marlowe' <scott.marlowe@gmail.com>
To: pgsql-performance@postgresql.org
Subject: Re: Distant mirroring
Date: Mon, 11 Aug 2008 12:35:22 -0300
Message-ID: <00d701c8fbc7$de381460$8f01010a@iptel.com.ar> (raw)
In-Reply-To: <48A04C17.3030005@vieonet.com>
References: <489DD403.6010101@vieonet.com>
<dcc563d10808091229n78d88637tb9b26fd204f77c9d@mail.gmail.com>
<48A04C17.3030005@vieonet.com>
> -----Mensaje original-----
> De: pgsql-performance-owner@postgresql.org
> [mailto:pgsql-performance-owner@postgresql.org] En nombre de dforums
> Enviado el: Lunes, 11 de Agosto de 2008 11:27
> Para: Scott Marlowe; pgsql-performance@postgresql.org
> Asunto: Re: [PERFORM] Distant mirroring
>
> Houlala
>
> I got headache !!!
>
> So please help...........;;
>
> "Assuming they all happen from 9 to 5 and during business
> days only, that's about 86 transactions per second. Well
> within the realm of a single mirror set to keep up if you
> don't make your db work real fat."
>
> OK i like, But my reality is that to make an insert of a
> table that have
> 27 millions of entrance it took 200 ms.
> so it took between 2 minutes and 10 minutes to treat 3000
> records and dispatch/agregate in other tables. And I have for
> now 20000 records every 3 minutes.
>
You must try to partition that table. It should considerably speed up your
inserts.
>
> So I need a solution to be able to 1st supporting more
> transaction, secondly I need to secure the data, and being
> able to load balancing the charge.
>
> Please, give me any advise or suggestion that can help me.
>
Have you taken into consideration programming a solution on BerkeleyDB? Its
an API that provides a high-performance non-SQL database. With such a
solution you could achieve several thousands tps on a much smaller hardware.
You could use non-work hours to dump your data to Postgres for SQL support
for reporting and such.
Regards,
Fernando
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: fhevia@ip-tel.com.ar, dforums@vieonet.com, scott.marlowe@gmail.com
Subject: Re: Distant mirroring
In-Reply-To: <00d701c8fbc7$de381460$8f01010a@iptel.com.ar>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox