pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Apache Logging to PostgreSQL
5+ messages / 3 participants
[nested] [flat]

* Apache Logging to PostgreSQL
@ 2007-12-29 22:53  Matthew T. O'Connor <matthew@zeut.net>
  0 siblings, 1 reply; 5+ messages in thread

From: Matthew T. O'Connor @ 2007-12-29 22:53 UTC (permalink / raw)
  To: pgsql-admin

Hello, I've been looking into having apache log to postgresql, and it 
isn't clear to me what the best way to set this up is.  The options that 
I see so far are:

1) Apache Pipe Logging:  This seems simple enough, but I'm not sure what 
tool I would as the logging process?

2) pgLOGd: This isn't actively maintained anymore and apparently doesn't 
work with PG8.x

3) pglogger:  Hasn't been updated since 2004, don't know if it's 
production quality or not.

4) pglogger Apache Module:  Also hasn't been updated since 04.

Doesn't anyone have any experience / advice for me?

Thanks,

Matt




^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Apache Logging to PostgreSQL
@ 2007-12-30 12:32  H. Hall <hhall1001@reedyriver.com>
  parent: Matthew T. O'Connor <matthew@zeut.net>
  0 siblings, 2 replies; 5+ messages in thread

From: H. Hall @ 2007-12-30 12:32 UTC (permalink / raw)
  To: Matthew T. O'Connor <matthew@zeut.net>; pgsql-admin

Matthew T. O'Connor wrote:
> Hello, I've been looking into having apache log to postgresql, and it 
> isn't clear to me what the best way to set this up is.  The options 
> that I see so far are:
>
> 1) Apache Pipe Logging:  This seems simple enough, but I'm not sure 
> what tool I would as the logging process?
>
> 2) pgLOGd: This isn't actively maintained anymore and apparently 
> doesn't work with PG8.x
>
> 3) pglogger:  Hasn't been updated since 2004, don't know if it's 
> production quality or not.
>
> 4) pglogger Apache Module:  Also hasn't been updated since 04.
>
> Doesn't anyone have any experience / advice for me?
>
> Thanks,
>
> Matt
Here's an article that might interest you:


       Datamining Apache Logs with PostgreSQL

You can find it at: 
http://www.onlamp.com/pub/a/onlamp/2005/03/03/pg_datamining.html

--cheers

>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster
>
>
>




^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Apache Logging to PostgreSQL
@ 2007-12-30 15:57  Matthew T. O'Connor <matthew@zeut.net>
  parent: H. Hall <hhall1001@reedyriver.com>
  1 sibling, 1 reply; 5+ messages in thread

From: Matthew T. O'Connor @ 2007-12-30 15:57 UTC (permalink / raw)
  To: H. Hall <hhall1001@reedyriver.com>; +Cc: pgsql-admin


>> Hello, I've been looking into having apache log to postgresql, and it 
>> isn't clear to me what the best way to set this up is.  The options 
>> that I see so far are:
>>
>> 1) Apache Pipe Logging:  This seems simple enough, but I'm not sure 
>> what tool I would as the logging process?
>>
>> 2) pgLOGd: This isn't actively maintained anymore and apparently 
>> doesn't work with PG8.x
>>
>> 3) pglogger:  Hasn't been updated since 2004, don't know if it's 
>> production quality or not.
>>
>> 4) pglogger Apache Module:  Also hasn't been updated since 04.
>>
>> Doesn't anyone have any experience / advice for me?
> Here's an article that might interest you:
>
> You can find it at: 
> http://www.onlamp.com/pub/a/onlamp/2005/03/03/pg_datamining.html 

Yeah, I came across this article already, but the thing that it doesn't 
address is the best way to get the log data into PG realtime, he does a 
manual import of the data which I don't want to do.





^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Apache Logging to PostgreSQL
@ 2007-12-30 17:48  H. Hall <hhall1001@reedyriver.com>
  parent: Matthew T. O'Connor <matthew@zeut.net>
  0 siblings, 0 replies; 5+ messages in thread

From: H. Hall @ 2007-12-30 17:48 UTC (permalink / raw)
  To: Matthew T. O'Connor <matthew@zeut.net>; pgsql-admin

Matthew T. O'Connor wrote:
>
>>> Hello, I've been looking into having apache log to postgresql, and 
>>> it isn't clear to me what the best way to set this up is.  The 
>>> options that I see so far are:
>>>
>>> 1) Apache Pipe Logging:  This seems simple enough, but I'm not sure 
>>> what tool I would as the logging process?
>>>
>>> 2) pgLOGd: This isn't actively maintained anymore and apparently 
>>> doesn't work with PG8.x
>>>
>>> 3) pglogger:  Hasn't been updated since 2004, don't know if it's 
>>> production quality or not.
>>>
>>> 4) pglogger Apache Module:  Also hasn't been updated since 04.
>>>
>>> Doesn't anyone have any experience / advice for me?
>> Here's an article that might interest you:
>>
>> You can find it at: 
>> http://www.onlamp.com/pub/a/onlamp/2005/03/03/pg_datamining.html 
>
> Yeah, I came across this article already, but the thing that it 
> doesn't address is the best way to get the log data into PG realtime, 
> he does a manual import of the data which I don't want to do.
>
>
Hmm.  Since you already know about Apache's Piped Logs, how hard is it 
to put it all together? Or are you looking for a pre-built solution? 
Don't blame you for not wanting to reinvent the wheel. Maybe someone 
else has a suggestion.

cheers,
HH
------------
>
> ---------------------------(end of broadcast)---------------------------
> TIP 3: Have you checked our extensive FAQ?
>
>               http://www.postgresql.org/docs/faq
>
> --------------------------------
> Spam/Virus scanning by CanIt Pro
>
> For more information see
> http://www.kgbinternet.com/SpamFilter.htm
>
> To control your spam filter, log in at
> http://filter.kgbinternet.com
>




^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Apache Logging to PostgreSQL
@ 2007-12-30 18:09  Søren Laursen <sl@scrooge.dk>
  parent: H. Hall <hhall1001@reedyriver.com>
  1 sibling, 0 replies; 5+ messages in thread

From: Søren Laursen @ 2007-12-30 18:09 UTC (permalink / raw)
  To: pgsql-admin

Hi, 

I got pglogd running on postgresql 8.1.4 a debian sarge installation. I had
to compile it myself and my apache2 configuration look like this.
LogFormat "%t %D %>s %b %m %v %h \"%U\" \"%{Referer}i\" \"%{User-agent}i\"
\"%r\" %l %u" pglogd
CustomLog "/var/log/apache2/pglogd_fifo" pglogd

For a logtime ago I made some programs that can dump the tables in a format
that awstats can read and compute.


Regards,

Søren Laursen

-----Oprindelig meddelelse-----
Fra: pgsql-admin-owner@postgresql.org
[mailto:pgsql-admin-owner@postgresql.org] På vegne af H. Hall
Sendt: 30. december 2007 13:33
Til: Matthew T. O'Connor; pgsql-admin@postgresql.org
Emne: Re: [ADMIN] Apache Logging to PostgreSQL

Matthew T. O'Connor wrote:
> Hello, I've been looking into having apache log to postgresql, and it 
> isn't clear to me what the best way to set this up is.  The options 
> that I see so far are:
>
> 1) Apache Pipe Logging:  This seems simple enough, but I'm not sure 
> what tool I would as the logging process?
>
> 2) pgLOGd: This isn't actively maintained anymore and apparently 
> doesn't work with PG8.x
>
> 3) pglogger:  Hasn't been updated since 2004, don't know if it's 
> production quality or not.
>
> 4) pglogger Apache Module:  Also hasn't been updated since 04.
>
> Doesn't anyone have any experience / advice for me?
>
> Thanks,
>
> Matt
Here's an article that might interest you:


       Datamining Apache Logs with PostgreSQL

You can find it at: 
http://www.onlamp.com/pub/a/onlamp/2005/03/03/pg_datamining.html

--cheers

>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster
>
>
>


---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings




^ permalink  raw  reply  [nested|flat] 5+ messages in thread


end of thread, other threads:[~2007-12-30 18:09 UTC | newest]

Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2007-12-29 22:53 Apache Logging to PostgreSQL Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 12:32 ` H. Hall <hhall1001@reedyriver.com>
2007-12-30 15:57   ` Matthew T. O'Connor <matthew@zeut.net>
2007-12-30 17:48     ` H. Hall <hhall1001@reedyriver.com>
2007-12-30 18:09   ` Søren Laursen <sl@scrooge.dk>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox