pg.ddx.io pgsql-benchmarks@postgresql.org mailing list archive
help / color / mirror / Atom feedTetra-bytes database / large indexes needs
4+ messages / 4 participants
[nested] [flat]
* Tetra-bytes database / large indexes needs
@ 2003-05-22 08:38 Jean-Michel POURE <jm.poure@freesurf.fr>
0 siblings, 2 replies; 4+ messages in thread
From: Jean-Michel POURE @ 2003-05-22 08:38 UTC (permalink / raw)
To: pgsql-benchmarks; pgsql-hackers@postgresql.org
Dear all,
A friend of mine needs to import and query a very large amount of data, coming
from real-time acquisition systems. The database is growing fast, several
Tetra-bytes a day.
What is the advancement of the community in the field of very large databases?
Could you point out to me some useful information, techdocs, etc...?
Are there working groups, private fundings in this precise field?
Also, in Brussels, at FOSDEM, I met a very brilliant Russian student
interested in large indexing technologies. Could he possibly contact me?
Best regards,
Jean-Michel POURE
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: [HACKERS] Tetra-bytes database / large indexes needs
@ 2003-05-22 19:50 Hannu Krosing <hannu@tm.ee>
parent: Jean-Michel POURE <jm.poure@freesurf.fr>
1 sibling, 1 reply; 4+ messages in thread
From: Hannu Krosing @ 2003-05-22 19:50 UTC (permalink / raw)
To: jm.poure@freesurf.fr; +Cc: pgsql-benchmarks; pgsql-hackers@postgresql.org
Jean-Michel POURE kirjutas N, 22.05.2003 kell 11:38:
> Dear all,
>
> A friend of mine needs to import and query a very large amount of data, coming
> from real-time acquisition systems.
What kind of querying does he need ?
You could check out Telegraph for continuous queries
http://telegraph.cs.berkeley.edu/
> The database is growing fast, several
> Tetra-bytes a day.
if you mean terabytes TB then 1 TB/day ~= 12.7 MB/sec, just about as
fast as you can write on an average ide drive if you do nothing else, or
what can come in over a 100 base T ethernet.
even in ide disks (the biggest available disks apiece) you have to add 5
disks a day just to store the incoming 1TB/day.
> What is the advancement of the community in the field of very large databases?
> Could you point out to me some useful information, techdocs, etc...?
no ;)
> Are there working groups, private fundings in this precise field?
dunno..
You are possibly on the verge of impossible ?
If you can hardly write down the data due to physical constraints
(memory and bus speeds) , it is very hard to also query it, unless you
deploy some terribly clever techniques which extract and compress your
data before it even gets to your DB ;)
Perhaps you (or your friend) are after filtering and not queries at all
?
--------------
Hannu
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: [HACKERS] Tetra-bytes database / large indexes needs
@ 2003-05-22 22:16 Sailesh Krishnamurthy <sailesh@cs.berkeley.edu>
parent: Hannu Krosing <hannu@tm.ee>
0 siblings, 0 replies; 4+ messages in thread
From: Sailesh Krishnamurthy @ 2003-05-22 22:16 UTC (permalink / raw)
To: Hannu Krosing <hannu@tm.ee>; +Cc: jm.poure@freesurf.fr; pgsql-benchmarks; pgsql-hackers@postgresql.org
>>>>> "Hannu" == Hannu Krosing <hannu@tm.ee> writes:
Hannu> You are possibly on the verge of impossible ?
Eeep .. it's because of his data rates that I stayed quiet :-)
--
Pip-pip
Sailesh
http://www.cs.berkeley.edu/~sailesh
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: [HACKERS] Tetra-bytes database / large indexes needs
@ 2003-05-23 07:14 Antonis Antoniou <a.antoniou@albourne.com>
parent: Jean-Michel POURE <jm.poure@freesurf.fr>
1 sibling, 0 replies; 4+ messages in thread
From: Antonis Antoniou @ 2003-05-23 07:14 UTC (permalink / raw)
To: jm.poure@freesurf.fr; +Cc: pgsql-benchmarks; pgsql-hackers@postgresql.org
Jean-Michel POURE wrote:
>Dear all,
>
>A friend of mine needs to import and query a very large amount of data, coming
>from real-time acquisition systems. The database is growing fast, several
>Tetra-bytes a day.
>
>What is the advancement of the community in the field of very large databases?
>Could you point out to me some useful information, techdocs, etc...?
>
>Are there working groups, private fundings in this precise field?
>
>Also, in Brussels, at FOSDEM, I met a very brilliant Russian student
>interested in large indexing technologies. Could he possibly contact me?
>
>
>
I don't know why but as I was reading this I remembered Frank Sinatra's
song "Fly Me To The Moon".
Fly me to the moon
Let me play among the stars
Let me see what spring is like
On a-Jupiter and Mars
In other words, hold my Tera_hand
In other words, baby, Tera_kiss me
:-)
^ permalink raw reply [nested|flat] 4+ messages in thread
end of thread, other threads:[~2003-05-23 07:14 UTC | newest]
Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2003-05-22 08:38 Tetra-bytes database / large indexes needs Jean-Michel POURE <jm.poure@freesurf.fr>
2003-05-22 19:50 ` Hannu Krosing <hannu@tm.ee>
2003-05-22 22:16 ` Sailesh Krishnamurthy <sailesh@cs.berkeley.edu>
2003-05-23 07:14 ` Antonis Antoniou <a.antoniou@albourne.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox