pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedApache Logging to PostgreSQL
5+ messages / 3 participants
[nested] [flat]
* Apache Logging to PostgreSQL
@ 2007-12-29 22:53 Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 12:32 ` Re: Apache Logging to PostgreSQL H. Hall <hhall1001@reedyriver.com>
0 siblings, 1 reply; 5+ messages in thread
From: Matthew T. O'Connor @ 2007-12-29 22:53 UTC (permalink / raw)
To: pgsql-admin
Hello, I've been looking into having apache log to postgresql, and it
isn't clear to me what the best way to set this up is. The options that
I see so far are:
1) Apache Pipe Logging: This seems simple enough, but I'm not sure what
tool I would as the logging process?
2) pgLOGd: This isn't actively maintained anymore and apparently doesn't
work with PG8.x
3) pglogger: Hasn't been updated since 2004, don't know if it's
production quality or not.
4) pglogger Apache Module: Also hasn't been updated since 04.
Doesn't anyone have any experience / advice for me?
Thanks,
Matt
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Apache Logging to PostgreSQL
2007-12-29 22:53 Apache Logging to PostgreSQL Matthew T. O'Connor <matthew@zeut.net>
@ 2007-12-30 12:32 ` H. Hall <hhall1001@reedyriver.com>
2007-12-30 15:57 ` Re: Apache Logging to PostgreSQL Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 18:09 ` Re: Apache Logging to PostgreSQL Søren Laursen <sl@scrooge.dk>
0 siblings, 2 replies; 5+ messages in thread
From: H. Hall @ 2007-12-30 12:32 UTC (permalink / raw)
To: Matthew T. O'Connor <matthew@zeut.net>; pgsql-admin
Matthew T. O'Connor wrote:
> Hello, I've been looking into having apache log to postgresql, and it
> isn't clear to me what the best way to set this up is. The options
> that I see so far are:
>
> 1) Apache Pipe Logging: This seems simple enough, but I'm not sure
> what tool I would as the logging process?
>
> 2) pgLOGd: This isn't actively maintained anymore and apparently
> doesn't work with PG8.x
>
> 3) pglogger: Hasn't been updated since 2004, don't know if it's
> production quality or not.
>
> 4) pglogger Apache Module: Also hasn't been updated since 04.
>
> Doesn't anyone have any experience / advice for me?
>
> Thanks,
>
> Matt
Here's an article that might interest you:
Datamining Apache Logs with PostgreSQL
You can find it at:
http://www.onlamp.com/pub/a/onlamp/2005/03/03/pg_datamining.html
--cheers
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster
>
>
>
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Apache Logging to PostgreSQL
2007-12-29 22:53 Apache Logging to PostgreSQL Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 12:32 ` Re: Apache Logging to PostgreSQL H. Hall <hhall1001@reedyriver.com>
@ 2007-12-30 15:57 ` Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 17:48 ` Re: Apache Logging to PostgreSQL H. Hall <hhall1001@reedyriver.com>
1 sibling, 1 reply; 5+ messages in thread
From: Matthew T. O'Connor @ 2007-12-30 15:57 UTC (permalink / raw)
To: H. Hall <hhall1001@reedyriver.com>; +Cc: pgsql-admin
>> Hello, I've been looking into having apache log to postgresql, and it
>> isn't clear to me what the best way to set this up is. The options
>> that I see so far are:
>>
>> 1) Apache Pipe Logging: This seems simple enough, but I'm not sure
>> what tool I would as the logging process?
>>
>> 2) pgLOGd: This isn't actively maintained anymore and apparently
>> doesn't work with PG8.x
>>
>> 3) pglogger: Hasn't been updated since 2004, don't know if it's
>> production quality or not.
>>
>> 4) pglogger Apache Module: Also hasn't been updated since 04.
>>
>> Doesn't anyone have any experience / advice for me?
> Here's an article that might interest you:
>
> You can find it at:
> http://www.onlamp.com/pub/a/onlamp/2005/03/03/pg_datamining.html
Yeah, I came across this article already, but the thing that it doesn't
address is the best way to get the log data into PG realtime, he does a
manual import of the data which I don't want to do.
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Apache Logging to PostgreSQL
2007-12-29 22:53 Apache Logging to PostgreSQL Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 12:32 ` Re: Apache Logging to PostgreSQL H. Hall <hhall1001@reedyriver.com>
2007-12-30 15:57 ` Re: Apache Logging to PostgreSQL Matthew T. O'Connor <matthew@zeut.net>
@ 2007-12-30 17:48 ` H. Hall <hhall1001@reedyriver.com>
0 siblings, 0 replies; 5+ messages in thread
From: H. Hall @ 2007-12-30 17:48 UTC (permalink / raw)
To: Matthew T. O'Connor <matthew@zeut.net>; pgsql-admin
Matthew T. O'Connor wrote:
>
>>> Hello, I've been looking into having apache log to postgresql, and
>>> it isn't clear to me what the best way to set this up is. The
>>> options that I see so far are:
>>>
>>> 1) Apache Pipe Logging: This seems simple enough, but I'm not sure
>>> what tool I would as the logging process?
>>>
>>> 2) pgLOGd: This isn't actively maintained anymore and apparently
>>> doesn't work with PG8.x
>>>
>>> 3) pglogger: Hasn't been updated since 2004, don't know if it's
>>> production quality or not.
>>>
>>> 4) pglogger Apache Module: Also hasn't been updated since 04.
>>>
>>> Doesn't anyone have any experience / advice for me?
>> Here's an article that might interest you:
>>
>> You can find it at:
>> http://www.onlamp.com/pub/a/onlamp/2005/03/03/pg_datamining.html
>
> Yeah, I came across this article already, but the thing that it
> doesn't address is the best way to get the log data into PG realtime,
> he does a manual import of the data which I don't want to do.
>
>
Hmm. Since you already know about Apache's Piped Logs, how hard is it
to put it all together? Or are you looking for a pre-built solution?
Don't blame you for not wanting to reinvent the wheel. Maybe someone
else has a suggestion.
cheers,
HH
------------
>
> ---------------------------(end of broadcast)---------------------------
> TIP 3: Have you checked our extensive FAQ?
>
> http://www.postgresql.org/docs/faq
>
> --------------------------------
> Spam/Virus scanning by CanIt Pro
>
> For more information see
> http://www.kgbinternet.com/SpamFilter.htm
>
> To control your spam filter, log in at
> http://filter.kgbinternet.com
>
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Apache Logging to PostgreSQL
2007-12-29 22:53 Apache Logging to PostgreSQL Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 12:32 ` Re: Apache Logging to PostgreSQL H. Hall <hhall1001@reedyriver.com>
@ 2007-12-30 18:09 ` Søren Laursen <sl@scrooge.dk>
1 sibling, 0 replies; 5+ messages in thread
From: Søren Laursen @ 2007-12-30 18:09 UTC (permalink / raw)
To: pgsql-admin
Hi,
I got pglogd running on postgresql 8.1.4 a debian sarge installation. I had
to compile it myself and my apache2 configuration look like this.
LogFormat "%t %D %>s %b %m %v %h \"%U\" \"%{Referer}i\" \"%{User-agent}i\"
\"%r\" %l %u" pglogd
CustomLog "/var/log/apache2/pglogd_fifo" pglogd
For a logtime ago I made some programs that can dump the tables in a format
that awstats can read and compute.
Regards,
Søren Laursen
-----Oprindelig meddelelse-----
Fra: pgsql-admin-owner@postgresql.org
[mailto:pgsql-admin-owner@postgresql.org] På vegne af H. Hall
Sendt: 30. december 2007 13:33
Til: Matthew T. O'Connor; pgsql-admin@postgresql.org
Emne: Re: [ADMIN] Apache Logging to PostgreSQL
Matthew T. O'Connor wrote:
> Hello, I've been looking into having apache log to postgresql, and it
> isn't clear to me what the best way to set this up is. The options
> that I see so far are:
>
> 1) Apache Pipe Logging: This seems simple enough, but I'm not sure
> what tool I would as the logging process?
>
> 2) pgLOGd: This isn't actively maintained anymore and apparently
> doesn't work with PG8.x
>
> 3) pglogger: Hasn't been updated since 2004, don't know if it's
> production quality or not.
>
> 4) pglogger Apache Module: Also hasn't been updated since 04.
>
> Doesn't anyone have any experience / advice for me?
>
> Thanks,
>
> Matt
Here's an article that might interest you:
Datamining Apache Logs with PostgreSQL
You can find it at:
http://www.onlamp.com/pub/a/onlamp/2005/03/03/pg_datamining.html
--cheers
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster
>
>
>
---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings
^ permalink raw reply [nested|flat] 5+ messages in thread
end of thread, other threads:[~2007-12-30 18:09 UTC | newest]
Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2007-12-29 22:53 Apache Logging to PostgreSQL Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 12:32 ` H. Hall <hhall1001@reedyriver.com>
2007-12-30 15:57 ` Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 17:48 ` H. Hall <hhall1001@reedyriver.com>
2007-12-30 18:09 ` Søren Laursen <sl@scrooge.dk>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox