pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feed[Autovacuum] Issue to understand some logs
9+ messages / 3 participants
[nested] [flat]
* [Autovacuum] Issue to understand some logs
@ 2012-12-17 15:57 Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
0 siblings, 1 reply; 9+ messages in thread
From: Baptiste LHOSTE @ 2012-12-17 15:57 UTC (permalink / raw)
To: pgsql-admin
Hi everybody,
I have trouble understanding some logs of postgreSQL.
Here you can find a log from the auto-vacuum process :
2012-12-17 16:38:58 CET LOG: automatic vacuum of table "flows.public.agg_t344_outgoing_a41_src_net_and_dst_net_f5": index scans: 0
pages: 0 removed, 59820 remain
tuples: 0 removed, 5801752 remain
system usage: CPU 0.93s/0.95u sec elapsed 423.07 sec
I am right to conclude that there is 5801752 available tuples in the previous table ?
If true, I am very confused because our table can not exceed 2592000 tuples (We delete old ones).
To be sure I tried to run the following query to count availables tuples :
select count(*) from agg_t344_outgoing_a41_src_net_and_dst_net_f5;
count
---------
2584398
(1 row)
Can someone give me a clue ?
Best regards,
Baptiste.
---
Baptiste LHOSTE
blhoste@alaloop.com
ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart
Téléphone : +33 (0) 5 59 41 51 10
www.alaloop.com
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: [Autovacuum] Issue to understand some logs
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
@ 2012-12-17 16:02 ` Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:10 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
0 siblings, 1 reply; 9+ messages in thread
From: Guillaume Lelarge @ 2012-12-17 16:02 UTC (permalink / raw)
To: Baptiste LHOSTE <blhoste@alaloop.com>; +Cc: pgsql-admin
On Mon, 2012-12-17 at 16:57 +0100, Baptiste LHOSTE wrote:
> Hi everybody,
>
> I have trouble understanding some logs of postgreSQL.
>
> Here you can find a log from the auto-vacuum process :
>
> 2012-12-17 16:38:58 CET LOG: automatic vacuum of table "flows.public.agg_t344_outgoing_a41_src_net_and_dst_net_f5": index scans: 0
> pages: 0 removed, 59820 remain
> tuples: 0 removed, 5801752 remain
> system usage: CPU 0.93s/0.95u sec elapsed 423.07 sec
>
> I am right to conclude that there is 5801752 available tuples in the previous table ?
>
> If true, I am very confused because our table can not exceed 2592000 tuples (We delete old ones).
>
> To be sure I tried to run the following query to count availables tuples :
>
> select count(*) from agg_t344_outgoing_a41_src_net_and_dst_net_f5;
> count
> ---------
> 2584398
> (1 row)
>
> Can someone give me a clue ?
>
It could be dead rows, still visible for other transactions.
--
Guillaume
http://blog.guillaume.lelarge.info
http://www.dalibo.com
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: [Autovacuum] Issue to understand some logs
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
@ 2012-12-17 16:10 ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:18 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
0 siblings, 1 reply; 9+ messages in thread
From: Baptiste LHOSTE @ 2012-12-17 16:10 UTC (permalink / raw)
To: Guillaume Lelarge <guillaume@lelarge.info>; +Cc: pgsql-admin
> It could be dead rows, still visible for other transactions.
Ok but in this case, why the automatic vacuum task of the autovacuum process does not delete theses dead rows ?
Best regards,
Baptiste
---
Baptiste LHOSTE
blhoste@alaloop.com
ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart
Téléphone : +33 (0) 5 59 41 51 10
www.alaloop.com
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: [Autovacuum] Issue to understand some logs
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:10 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
@ 2012-12-17 16:18 ` Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:35 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
0 siblings, 1 reply; 9+ messages in thread
From: Guillaume Lelarge @ 2012-12-17 16:18 UTC (permalink / raw)
To: Baptiste LHOSTE <blhoste@alaloop.com>; +Cc: pgsql-admin
On Mon, 2012-12-17 at 17:10 +0100, Baptiste LHOSTE wrote:
> > It could be dead rows, still visible for other transactions.
>
> Ok but in this case, why the automatic vacuum task of the autovacuum process does not delete theses dead rows ?
>
As I said, because they are still visible to other transactions. Try to
see if you have long-lasting transactions.
--
Guillaume
http://blog.guillaume.lelarge.info
http://www.dalibo.com
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: [Autovacuum] Issue to understand some logs
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:10 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:18 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
@ 2012-12-17 16:35 ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:40 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 17:01 ` Re: [Autovacuum] Issue to understand some logs Tom Lane <tgl@sss.pgh.pa.us>
0 siblings, 2 replies; 9+ messages in thread
From: Baptiste LHOSTE @ 2012-12-17 16:35 UTC (permalink / raw)
To: Guillaume Lelarge <guillaume@lelarge.info>; +Cc: pgsql-admin
>As I said, because they are still visible to other transactions. Try to
>see if you have long-lasting transactions.
How can I do that ? I check running query in pg_stat_activity, but there is no query on that table.
Best regards,
Baptiste.
---
Baptiste LHOSTE
blhoste@alaloop.com
ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart
Téléphone : +33 (0) 5 59 41 51 10
www.alaloop.com
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: [Autovacuum] Issue to understand some logs
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:10 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:18 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:35 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
@ 2012-12-17 16:40 ` Baptiste LHOSTE <blhoste@alaloop.com>
1 sibling, 0 replies; 9+ messages in thread
From: Baptiste LHOSTE @ 2012-12-17 16:40 UTC (permalink / raw)
To: Guillaume Lelarge <guillaume@lelarge.info>; +Cc: pgsql-admin
I run a select on the pg_stat_all_tables and it returns that there is 0 n_dead_tup.
I am really confused.
Best regards,
Baptiste.
---
Baptiste LHOSTE
blhoste@alaloop.com
ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart
Téléphone : +33 (0) 5 59 41 51 10
www.alaloop.com
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: [Autovacuum] Issue to understand some logs
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:10 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:18 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:35 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
@ 2012-12-17 17:01 ` Tom Lane <tgl@sss.pgh.pa.us>
2012-12-17 17:26 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
1 sibling, 1 reply; 9+ messages in thread
From: Tom Lane @ 2012-12-17 17:01 UTC (permalink / raw)
To: Baptiste LHOSTE <blhoste@alaloop.com>; +Cc: Guillaume Lelarge <guillaume@lelarge.info>; pgsql-admin
Baptiste LHOSTE <blhoste@alaloop.com> writes:
>> As I said, because they are still visible to other transactions. Try to
>> see if you have long-lasting transactions.
> How can I do that ? I check running query in pg_stat_activity, but there is no query on that table.
Does "select * from pg_prepared_xacts" find anything?
regards, tom lane
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: [Autovacuum] Issue to understand some logs
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:10 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:18 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:35 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 17:01 ` Re: [Autovacuum] Issue to understand some logs Tom Lane <tgl@sss.pgh.pa.us>
@ 2012-12-17 17:26 ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-19 08:34 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
0 siblings, 1 reply; 9+ messages in thread
From: Baptiste LHOSTE @ 2012-12-17 17:26 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Guillaume Lelarge <guillaume@lelarge.info>; pgsql-admin
> Does "select * from pg_prepared_xacts" find anything?
Yes indeed, so I rollback our old prepared transactions.
I will check tomorrow, and I will let you know.
Best regards,
Baptiste.
---
Baptiste LHOSTE
blhoste@alaloop.com
ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart
Téléphone : +33 (0) 5 59 41 51 10
www.alaloop.com
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: [Autovacuum] Issue to understand some logs
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:10 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:18 ` Re: [Autovacuum] Issue to understand some logs Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:35 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 17:01 ` Re: [Autovacuum] Issue to understand some logs Tom Lane <tgl@sss.pgh.pa.us>
2012-12-17 17:26 ` Re: [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
@ 2012-12-19 08:34 ` Baptiste LHOSTE <blhoste@alaloop.com>
0 siblings, 0 replies; 9+ messages in thread
From: Baptiste LHOSTE @ 2012-12-19 08:34 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Guillaume Lelarge <guillaume@lelarge.info>; pgsql-admin
Thanks both of you for your help.
The autovacuum process did the work yesterday.
Best regards,
Baptiste
---
Baptiste LHOSTE
blhoste@alaloop.com
ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart
Téléphone : +33 (0) 5 59 41 51 10
www.alaloop.com
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
^ permalink raw reply [nested|flat] 9+ messages in thread
end of thread, other threads:[~2012-12-19 08:34 UTC | newest]
Thread overview: 9+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2012-12-17 15:57 [Autovacuum] Issue to understand some logs Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:02 ` Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:10 ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:18 ` Guillaume Lelarge <guillaume@lelarge.info>
2012-12-17 16:35 ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 16:40 ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-17 17:01 ` Tom Lane <tgl@sss.pgh.pa.us>
2012-12-17 17:26 ` Baptiste LHOSTE <blhoste@alaloop.com>
2012-12-19 08:34 ` Baptiste LHOSTE <blhoste@alaloop.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox