pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
[Autovacuum] Issue to understand some logs
9+ messages / 3 participants
[nested] [flat]

* [Autovacuum] Issue to understand some logs
@ 2012-12-17 15:57  Baptiste LHOSTE <blhoste@alaloop.com>
  0 siblings, 1 reply; 9+ messages in thread

From: Baptiste LHOSTE @ 2012-12-17 15:57 UTC (permalink / raw)
  To: pgsql-admin

Hi everybody,

I have trouble understanding some logs of postgreSQL.

Here you can find a log from the auto-vacuum process :

2012-12-17 16:38:58 CET LOG:  automatic vacuum of table "flows.public.agg_t344_outgoing_a41_src_net_and_dst_net_f5": index scans: 0
	pages: 0 removed, 59820 remain
	tuples: 0 removed, 5801752 remain
	system usage: CPU 0.93s/0.95u sec elapsed 423.07 sec

I am right to conclude that there is 5801752 available tuples in the previous table ?

If true, I am very confused because our table can not exceed 2592000 tuples (We delete old ones).

To be sure I tried to run the following query to count availables tuples :

select count(*) from agg_t344_outgoing_a41_src_net_and_dst_net_f5;
  count  
---------
 2584398
(1 row)

Can someone give me a clue ?

Best regards,

Baptiste.

--- 
Baptiste LHOSTE 
blhoste@alaloop.com 

ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart 
Téléphone : +33 (0) 5 59 41 51 10 
www.alaloop.com 



-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



^ permalink  raw  reply  [nested|flat] 9+ messages in thread

* Re: [Autovacuum] Issue to understand some logs
@ 2012-12-17 16:02  Guillaume Lelarge <guillaume@lelarge.info>
  parent: Baptiste LHOSTE <blhoste@alaloop.com>
  0 siblings, 1 reply; 9+ messages in thread

From: Guillaume Lelarge @ 2012-12-17 16:02 UTC (permalink / raw)
  To: Baptiste LHOSTE <blhoste@alaloop.com>; +Cc: pgsql-admin

On Mon, 2012-12-17 at 16:57 +0100, Baptiste LHOSTE wrote:
> Hi everybody,
> 
> I have trouble understanding some logs of postgreSQL.
> 
> Here you can find a log from the auto-vacuum process :
> 
> 2012-12-17 16:38:58 CET LOG:  automatic vacuum of table "flows.public.agg_t344_outgoing_a41_src_net_and_dst_net_f5": index scans: 0
> 	pages: 0 removed, 59820 remain
> 	tuples: 0 removed, 5801752 remain
> 	system usage: CPU 0.93s/0.95u sec elapsed 423.07 sec
> 
> I am right to conclude that there is 5801752 available tuples in the previous table ?
> 
> If true, I am very confused because our table can not exceed 2592000 tuples (We delete old ones).
> 
> To be sure I tried to run the following query to count availables tuples :
> 
> select count(*) from agg_t344_outgoing_a41_src_net_and_dst_net_f5;
>   count  
> ---------
>  2584398
> (1 row)
> 
> Can someone give me a clue ?
> 

It could be dead rows, still visible for other transactions.


-- 
Guillaume
http://blog.guillaume.lelarge.info
http://www.dalibo.com



-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



^ permalink  raw  reply  [nested|flat] 9+ messages in thread

* Re: [Autovacuum] Issue to understand some logs
@ 2012-12-17 16:10  Baptiste LHOSTE <blhoste@alaloop.com>
  parent: Guillaume Lelarge <guillaume@lelarge.info>
  0 siblings, 1 reply; 9+ messages in thread

From: Baptiste LHOSTE @ 2012-12-17 16:10 UTC (permalink / raw)
  To: Guillaume Lelarge <guillaume@lelarge.info>; +Cc: pgsql-admin


> It could be dead rows, still visible for other transactions.

Ok but in this case, why the automatic vacuum task of the autovacuum process does not delete theses dead rows ? 

Best regards,

Baptiste

--- 
Baptiste LHOSTE 
blhoste@alaloop.com 

ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart 
Téléphone : +33 (0) 5 59 41 51 10 
www.alaloop.com 


-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



^ permalink  raw  reply  [nested|flat] 9+ messages in thread

* Re: [Autovacuum] Issue to understand some logs
@ 2012-12-17 16:18  Guillaume Lelarge <guillaume@lelarge.info>
  parent: Baptiste LHOSTE <blhoste@alaloop.com>
  0 siblings, 1 reply; 9+ messages in thread

From: Guillaume Lelarge @ 2012-12-17 16:18 UTC (permalink / raw)
  To: Baptiste LHOSTE <blhoste@alaloop.com>; +Cc: pgsql-admin

On Mon, 2012-12-17 at 17:10 +0100, Baptiste LHOSTE wrote:
> > It could be dead rows, still visible for other transactions.
> 
> Ok but in this case, why the automatic vacuum task of the autovacuum process does not delete theses dead rows ? 
> 

As I said, because they are still visible to other transactions. Try to
see if you have long-lasting transactions.


-- 
Guillaume
http://blog.guillaume.lelarge.info
http://www.dalibo.com



-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



^ permalink  raw  reply  [nested|flat] 9+ messages in thread

* Re: [Autovacuum] Issue to understand some logs
@ 2012-12-17 16:35  Baptiste LHOSTE <blhoste@alaloop.com>
  parent: Guillaume Lelarge <guillaume@lelarge.info>
  0 siblings, 2 replies; 9+ messages in thread

From: Baptiste LHOSTE @ 2012-12-17 16:35 UTC (permalink / raw)
  To: Guillaume Lelarge <guillaume@lelarge.info>; +Cc: pgsql-admin


>As I said, because they are still visible to other transactions. Try to
>see if you have long-lasting transactions.

How can I do that ? I check running query in pg_stat_activity, but there is no query on that table.

Best regards,

Baptiste.

--- 
Baptiste LHOSTE 
blhoste@alaloop.com 

ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart 
Téléphone : +33 (0) 5 59 41 51 10 
www.alaloop.com 



-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



^ permalink  raw  reply  [nested|flat] 9+ messages in thread

* Re: [Autovacuum] Issue to understand some logs
@ 2012-12-17 16:40  Baptiste LHOSTE <blhoste@alaloop.com>
  parent: Baptiste LHOSTE <blhoste@alaloop.com>
  1 sibling, 0 replies; 9+ messages in thread

From: Baptiste LHOSTE @ 2012-12-17 16:40 UTC (permalink / raw)
  To: Guillaume Lelarge <guillaume@lelarge.info>; +Cc: pgsql-admin


I run a select on the pg_stat_all_tables and it returns that there is 0 n_dead_tup.

I am really confused.

Best regards,

Baptiste.

--- 
Baptiste LHOSTE 
blhoste@alaloop.com 

ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart 
Téléphone : +33 (0) 5 59 41 51 10 
www.alaloop.com 


-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



^ permalink  raw  reply  [nested|flat] 9+ messages in thread

* Re: [Autovacuum] Issue to understand some logs
@ 2012-12-17 17:01  Tom Lane <tgl@sss.pgh.pa.us>
  parent: Baptiste LHOSTE <blhoste@alaloop.com>
  1 sibling, 1 reply; 9+ messages in thread

From: Tom Lane @ 2012-12-17 17:01 UTC (permalink / raw)
  To: Baptiste LHOSTE <blhoste@alaloop.com>; +Cc: Guillaume Lelarge <guillaume@lelarge.info>; pgsql-admin

Baptiste LHOSTE <blhoste@alaloop.com> writes:
>> As I said, because they are still visible to other transactions. Try to
>> see if you have long-lasting transactions.

> How can I do that ? I check running query in pg_stat_activity, but there is no query on that table.

Does "select * from pg_prepared_xacts" find anything?

			regards, tom lane


-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



^ permalink  raw  reply  [nested|flat] 9+ messages in thread

* Re: [Autovacuum] Issue to understand some logs
@ 2012-12-17 17:26  Baptiste LHOSTE <blhoste@alaloop.com>
  parent: Tom Lane <tgl@sss.pgh.pa.us>
  0 siblings, 1 reply; 9+ messages in thread

From: Baptiste LHOSTE @ 2012-12-17 17:26 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Guillaume Lelarge <guillaume@lelarge.info>; pgsql-admin


> Does "select * from pg_prepared_xacts" find anything?

Yes indeed, so I rollback our old prepared transactions.

I will check tomorrow, and I will let you know.

Best regards,

Baptiste.

--- 
Baptiste LHOSTE 
blhoste@alaloop.com 

ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart 
Téléphone : +33 (0) 5 59 41 51 10 
www.alaloop.com 



-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



^ permalink  raw  reply  [nested|flat] 9+ messages in thread

* Re: [Autovacuum] Issue to understand some logs
@ 2012-12-19 08:34  Baptiste LHOSTE <blhoste@alaloop.com>
  parent: Baptiste LHOSTE <blhoste@alaloop.com>
  0 siblings, 0 replies; 9+ messages in thread

From: Baptiste LHOSTE @ 2012-12-19 08:34 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Guillaume Lelarge <guillaume@lelarge.info>; pgsql-admin

Thanks both of you for your help.

The autovacuum process did the work yesterday.

Best regards,

Baptiste

--- 
Baptiste LHOSTE 
blhoste@alaloop.com 

ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart 
Téléphone : +33 (0) 5 59 41 51 10 
www.alaloop.com 



-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



^ permalink  raw  reply  [nested|flat] 9+ messages in thread


end of thread, other threads:[~2012-12-19 08:34 UTC | newest]

Thread overview: 9+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:10   ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:18     ` Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:35       ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:40         ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 17:01         ` Tom Lane <tgl@sss.pgh.pa.us>
2012-12-17 17:26           ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-19 08:34             ` Baptiste LHOSTE <blhoste@alaloop.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox