pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedClarification required: autovacuum and VACUUM command mode
12+ messages / 5 participants
[nested] [flat]
* Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 12:52 Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
0 siblings, 1 reply; 12+ messages in thread
From: Narasimha Murthy-VRFX87 @ 2010-05-14 12:52 UTC (permalink / raw)
To: pgsql-admin
Hello,
I need a clarification on auto-vacuum. Appreciate any
clarification/help.
As explained in page 1093 of postgresql-8.2-US.pdf, VACUUM command works
either in plain mode (if we do not specify FULL) or in FULL mode. When
autovacuum is enabled, what mode does it run the VACUUM command (in
plain mode or in FULL mode)?
postgresql-8.2-US.pdf manual is available at
http://www.postgresql.org/files/documentation/pdf/8.2/postgresql-8.2-US.
pdf
<http://www.postgresql.org/files/documentation/pdf/8.2/postgresql-8.2-US
.pdf>
Regards, Narasimha Murthy
Cell +91 95814 98895, +91-94940 62794 | 040-2347 2025 (O) | x2025 (O)
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 13:03 Guillaume Lelarge <guillaume@lelarge.info>
parent: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
0 siblings, 1 reply; 12+ messages in thread
From: Guillaume Lelarge @ 2010-05-14 13:03 UTC (permalink / raw)
To: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>; +Cc: pgsql-admin
Hi,
Le 14/05/2010 14:52, Narasimha Murthy-VRFX87 a écrit :
> [...]
> I need a clarification on auto-vacuum. Appreciate any
> clarification/help.
>
> As explained in page 1093 of postgresql-8.2-US.pdf, VACUUM command works
> either in plain mode (if we do not specify FULL) or in FULL mode. When
> autovacuum is enabled, what mode does it run the VACUUM command (in
> plain mode or in FULL mode)?
In plain mode.
--
Guillaume.
http://www.postgresqlfr.org
http://dalibo.com
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 13:12 Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
parent: Guillaume Lelarge <guillaume@lelarge.info>
0 siblings, 1 reply; 12+ messages in thread
From: Narasimha Murthy-VRFX87 @ 2010-05-14 13:12 UTC (permalink / raw)
To: Guillaume Lelarge <guillaume@lelarge.info>; +Cc: pgsql-admin
Hi Guillaume,
Thanks for a quick response.
How do I check this? Please clarify.
Regards, Narasimha Murthy
Cell +91 95814 98895, +91-94940 62794 | 040-2347 2025 (O) | x2025 (O)
-----Original Message-----
From: Guillaume Lelarge [mailto:guillaume@lelarge.info]
Sent: Friday, May 14, 2010 6:34 PM
To: Narasimha Murthy-VRFX87
Cc: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] Clarification required: autovacuum and VACUUM command mode
Hi,
Le 14/05/2010 14:52, Narasimha Murthy-VRFX87 a écrit :
> [...]
> I need a clarification on auto-vacuum. Appreciate any
> clarification/help.
>
> As explained in page 1093 of postgresql-8.2-US.pdf, VACUUM command
> works either in plain mode (if we do not specify FULL) or in FULL
> mode. When autovacuum is enabled, what mode does it run the VACUUM
> command (in plain mode or in FULL mode)?
In plain mode.
--
Guillaume.
http://www.postgresqlfr.org
http://dalibo.com
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 13:40 Kevin Grittner <Kevin.Grittner@wicourts.gov>
parent: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
0 siblings, 1 reply; 12+ messages in thread
From: Kevin Grittner @ 2010-05-14 13:40 UTC (permalink / raw)
To: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>; +Cc: pgsql-admin
"Narasimha Murthy-VRFX87" <VRFX87@motorola.com> wrote:
> Guillaume Lelarge <guillaume@lelarge.info> wrote:
>> Le 14/05/2010 14:52, Narasimha Murthy-VRFX87 a écrit :
>>> VACUUM command works either in plain mode (if we do not specify
>>> FULL) or in FULL mode. When autovacuum is enabled, what mode
>>> does it run the VACUUM command (in plain mode or in FULL mode)?
>>
>> In plain mode.
> How do I check this? Please clarify.
http://www.postgresql.org/docs/8.2/interactive/routine-vacuuming.html#VACUUM-FOR-SPACE-RECOVERY
Since VACUUM FULL is not recommended for routine use, it would
hardly make sense to use it for autovacuum. If you want to confirm,
try selecting from a table while autovacuum is vacuuming it -- since
VACUUM FULL locks the table against all other uses, the ability to
select proves it's not VACUUM FULL.
By the way, I hope you're not considering scheduling regular VACUUM
FULL runs against your database. You would wind up regretting that.
If you don't believe that, I recommend that you reread the
above-cited section until you're convinced.
-Kevin
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 14:20 Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
parent: Kevin Grittner <Kevin.Grittner@wicourts.gov>
0 siblings, 2 replies; 12+ messages in thread
From: Narasimha Murthy-VRFX87 @ 2010-05-14 14:20 UTC (permalink / raw)
To: Kevin Grittner <Kevin.Grittner@wicourts.gov>; +Cc: pgsql-admin
Hi Kevin,
Thanks for the clarification.
I have planned to schedule Lazy Vacuum (, not FULL Vacuum) using auto-vacuum daemon.
Another query: I do not want to run Analyze. However, auto-vacuum runs both both VACUUM and ANALYZE. I do not see any option to disable running ANALYZE during auto-vacuum. Is there any way to achive this?
Pl clarify.
Regards, Narasimha Murthy
Cell +91 95814 98895, +91-94940 62794 | 040-2347 2025 (O) | x2025 (O)
-----Original Message-----
From: Kevin Grittner [mailto:Kevin.Grittner@wicourts.gov]
Sent: Friday, May 14, 2010 7:10 PM
To: Narasimha Murthy-VRFX87
Cc: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] Clarification required: autovacuum and VACUUM command mode
"Narasimha Murthy-VRFX87" <VRFX87@motorola.com> wrote:
> Guillaume Lelarge <guillaume@lelarge.info> wrote:
>> Le 14/05/2010 14:52, Narasimha Murthy-VRFX87 a écrit :
>>> VACUUM command works either in plain mode (if we do not specify
>>> FULL) or in FULL mode. When autovacuum is enabled, what mode does it
>>> run the VACUUM command (in plain mode or in FULL mode)?
>>
>> In plain mode.
> How do I check this? Please clarify.
http://www.postgresql.org/docs/8.2/interactive/routine-vacuuming.html#VACUUM-FOR-SPACE-RECOVERY
Since VACUUM FULL is not recommended for routine use, it would hardly make sense to use it for autovacuum. If you want to confirm, try selecting from a table while autovacuum is vacuuming it -- since VACUUM FULL locks the table against all other uses, the ability to select proves it's not VACUUM FULL.
By the way, I hope you're not considering scheduling regular VACUUM FULL runs against your database. You would wind up regretting that.
If you don't believe that, I recommend that you reread the above-cited section until you're convinced.
-Kevin
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 14:44 Scott Marlowe <scott.marlowe@gmail.com>
parent: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
1 sibling, 0 replies; 12+ messages in thread
From: Scott Marlowe @ 2010-05-14 14:44 UTC (permalink / raw)
To: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>; +Cc: Kevin Grittner <Kevin.Grittner@wicourts.gov>; pgsql-admin
On Fri, May 14, 2010 at 8:20 AM, Narasimha Murthy-VRFX87
<VRFX87@motorola.com> wrote:
> Hi Kevin,
>
> Thanks for the clarification.
>
> I have planned to schedule Lazy Vacuum (, not FULL Vacuum) using auto-vacuum daemon.
>
> Another query: I do not want to run Analyze. However, auto-vacuum runs both both VACUUM and ANALYZE. I do not see any option to disable running ANALYZE during auto-vacuum. Is there any way to achive this?
Why would you NOT want to analyze? Are you considering doing your own
analyzes at the end of a series of updates?
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 14:47 Kevin Grittner <Kevin.Grittner@wicourts.gov>
parent: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
1 sibling, 1 reply; 12+ messages in thread
From: Kevin Grittner @ 2010-05-14 14:47 UTC (permalink / raw)
To: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>; +Cc: pgsql-admin
"Narasimha Murthy-VRFX87" <VRFX87@motorola.com> wrote:
> Another query: I do not want to run Analyze. However, auto-vacuum
> runs both both VACUUM and ANALYZE. I do not see any option to
> disable running ANALYZE during auto-vacuum. Is there any way to
> achive this?
Usually it's best to run ANALYZE more often than VACUUM, since the
statistics generated by ANALYZE are used to choose the most
efficient plan, and ANALYZE runs faster because it just takes a
random sample of rows. Out-of-date statistics are one of the most
common causes of slow queries. That's not to say there couldn't be
some very unusual circumstances under which it might make sense to
disable ANALYZE, but I'm highly skeptical.
Anyway, if you *really* want to shoot that fly off the end of your
toe (to stretch a metaphor), you could adjust the autovacuum
settings related to analyze to really high values.
-Kevin
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 15:01 Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
parent: Kevin Grittner <Kevin.Grittner@wicourts.gov>
0 siblings, 2 replies; 12+ messages in thread
From: Narasimha Murthy-VRFX87 @ 2010-05-14 15:01 UTC (permalink / raw)
To: Kevin Grittner <Kevin.Grittner@wicourts.gov>; +Cc: pgsql-admin
Hi Kevin,
Thanks again for a quick response.
I am using a 3rd party application, which in turn using PostgreSQL DB. I
can not change/tune the SQL queries, performed by the 3rd party
application. Hence, the statistics generated by ANALYZE, is of no use to
me. That is the reason, I have planned not to run ANALYZE.
Regards, Narasimha Murthy
Cell +91 95814 98895, +91-94940 62794 | 040-2347 2025 (O) | x2025 (O)
-----Original Message-----
From: Kevin Grittner [mailto:Kevin.Grittner@wicourts.gov]
Sent: Friday, May 14, 2010 8:18 PM
To: Narasimha Murthy-VRFX87
Cc: pgsql-admin@postgresql.org
Subject: RE: [ADMIN] Clarification required: autovacuum and VACUUM
command mode
"Narasimha Murthy-VRFX87" <VRFX87@motorola.com> wrote:
> Another query: I do not want to run Analyze. However, auto-vacuum runs
> both both VACUUM and ANALYZE. I do not see any option to disable
> running ANALYZE during auto-vacuum. Is there any way to achive this?
Usually it's best to run ANALYZE more often than VACUUM, since the
statistics generated by ANALYZE are used to choose the most efficient
plan, and ANALYZE runs faster because it just takes a random sample of
rows. Out-of-date statistics are one of the most common causes of slow
queries. That's not to say there couldn't be some very unusual
circumstances under which it might make sense to disable ANALYZE, but
I'm highly skeptical.
Anyway, if you *really* want to shoot that fly off the end of your toe
(to stretch a metaphor), you could adjust the autovacuum settings
related to analyze to really high values.
-Kevin
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 15:04 Lewis Kapell <lkapell@setonhome.org>
parent: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
1 sibling, 1 reply; 12+ messages in thread
From: Lewis Kapell @ 2010-05-14 15:04 UTC (permalink / raw)
To: pgsql-admin
You misunderstand the purpose of ANALYZE. Postgres needs the results in
order to perform queries efficiently. Whether you have the ability to
change or tune the queries is beside the point.
- Lewis
On 5/14/2010 11:01 AM, Narasimha Murthy-VRFX87 wrote:
> Hi Kevin,
>
> Thanks again for a quick response.
>
> I am using a 3rd party application, which in turn using PostgreSQL DB. I
> can not change/tune the SQL queries, performed by the 3rd party
> application. Hence, the statistics generated by ANALYZE, is of no use to
> me. That is the reason, I have planned not to run ANALYZE.
>
> Regards, Narasimha Murthy
> Cell +91 95814 98895, +91-94940 62794 | 040-2347 2025 (O) | x2025 (O)
>
> -----Original Message-----
> From: Kevin Grittner [mailto:Kevin.Grittner@wicourts.gov]
> Sent: Friday, May 14, 2010 8:18 PM
> To: Narasimha Murthy-VRFX87
> Cc: pgsql-admin@postgresql.org
> Subject: RE: [ADMIN] Clarification required: autovacuum and VACUUM
> command mode
>
> "Narasimha Murthy-VRFX87"<VRFX87@motorola.com> wrote:
>
>> Another query: I do not want to run Analyze. However, auto-vacuum runs
>
>> both both VACUUM and ANALYZE. I do not see any option to disable
>> running ANALYZE during auto-vacuum. Is there any way to achive this?
>
> Usually it's best to run ANALYZE more often than VACUUM, since the
> statistics generated by ANALYZE are used to choose the most efficient
> plan, and ANALYZE runs faster because it just takes a random sample of
> rows. Out-of-date statistics are one of the most common causes of slow
> queries. That's not to say there couldn't be some very unusual
> circumstances under which it might make sense to disable ANALYZE, but
> I'm highly skeptical.
>
> Anyway, if you *really* want to shoot that fly off the end of your toe
> (to stretch a metaphor), you could adjust the autovacuum settings
> related to analyze to really high values.
>
> -Kevin
>
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 15:17 Kevin Grittner <Kevin.Grittner@wicourts.gov>
parent: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
1 sibling, 0 replies; 12+ messages in thread
From: Kevin Grittner @ 2010-05-14 15:17 UTC (permalink / raw)
To: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>; +Cc: pgsql-admin
"Narasimha Murthy-VRFX87" <VRFX87@motorola.com> wrote:
> I am using a 3rd party application, which in turn using PostgreSQL
> DB. I can not change/tune the SQL queries, performed by the 3rd
> party application. Hence, the statistics generated by ANALYZE, is of
no
> use to me. That is the reason, I have planned not to run ANALYZE.
I think perhaps you're misunderstanding what ANALYZE does. Did that
vendor specifically tell you to disable ANALYZE? Unless they're
doing some analysis of the distribution of data and creating their
own statistics (remotely possible but highly unusual), the
statistics generated by ANALYZE will be required to allow the
queries they've written to execute efficiently.
-Kevin
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 15:17 Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
parent: Lewis Kapell <lkapell@setonhome.org>
0 siblings, 1 reply; 12+ messages in thread
From: Narasimha Murthy-VRFX87 @ 2010-05-14 15:17 UTC (permalink / raw)
To: Lewis Kapell <lkapell@setonhome.org>; +Cc: pgsql-admin
Hi Lewis,
Thanks for the clarification.
Referring to the statement in postgresql-8.2-US.pdf document "ANALYZE
collects statistics about the contents of tables in the database ...
query planner uses these statistics to help determine the most efficient
execution plans for queries."
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: Clarification required: autovacuum and VACUUM command mode
@ 2010-05-14 15:24 Lewis Kapell <lkapell@setonhome.org>
parent: Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
0 siblings, 0 replies; 12+ messages in thread
From: Lewis Kapell @ 2010-05-14 15:24 UTC (permalink / raw)
To: pgsql-admin
Yes, the query planner is part of Postgres itself. Here are some pages
of the manual that talk about the planner and how it works:
http://www.postgresql.org/docs/8.3/static/using-explain.html
http://www.postgresql.org/docs/8.3/static/planner-stats.html
And this talks about configuration options to control (or at least
influence) what the planner does:
http://www.postgresql.org/docs/8.3/static/runtime-config-query.html
- Lewis
On 5/14/2010 11:17 AM, Narasimha Murthy-VRFX87 wrote:
> Hi Lewis,
>
> Thanks for the clarification.
>
> Referring to the statement in postgresql-8.2-US.pdf document "ANALYZE
> collects statistics about the contents of tables in the database ...
> query planner uses these statistics to help determine the most efficient
> execution plans for queries."
>
> From your response, I now understood that "Query planner" is part of
> PostgreSQL DB.
>
> Regards, Narasimha Murthy
> Cell +91 95814 98895, +91-94940 62794 | 040-2347 2025 (O) | x2025 (O)
>
> -----Original Message-----
> From: pgsql-admin-owner@postgresql.org
> [mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Lewis Kapell
> Sent: Friday, May 14, 2010 8:34 PM
> To: pgsql-admin@postgresql.org
> Subject: Re: [ADMIN] Clarification required: autovacuum and VACUUM
> command mode
>
> You misunderstand the purpose of ANALYZE. Postgres needs the results in
> order to perform queries efficiently. Whether you have the ability to
> change or tune the queries is beside the point.
>
> - Lewis
>
>
> On 5/14/2010 11:01 AM, Narasimha Murthy-VRFX87 wrote:
>> Hi Kevin,
>>
>> Thanks again for a quick response.
>>
>> I am using a 3rd party application, which in turn using PostgreSQL DB.
>
>> I can not change/tune the SQL queries, performed by the 3rd party
>> application. Hence, the statistics generated by ANALYZE, is of no use
>> to me. That is the reason, I have planned not to run ANALYZE.
>>
>> Regards, Narasimha Murthy
>> Cell +91 95814 98895, +91-94940 62794 | 040-2347 2025 (O) | x2025 (O)
>>
>> -----Original Message-----
>> From: Kevin Grittner [mailto:Kevin.Grittner@wicourts.gov]
>> Sent: Friday, May 14, 2010 8:18 PM
>> To: Narasimha Murthy-VRFX87
>> Cc: pgsql-admin@postgresql.org
>> Subject: RE: [ADMIN] Clarification required: autovacuum and VACUUM
>> command mode
>>
>> "Narasimha Murthy-VRFX87"<VRFX87@motorola.com> wrote:
>>
>>> Another query: I do not want to run Analyze. However, auto-vacuum
>>> runs
>>
>>> both both VACUUM and ANALYZE. I do not see any option to disable
>>> running ANALYZE during auto-vacuum. Is there any way to achive this?
>>
>> Usually it's best to run ANALYZE more often than VACUUM, since the
>> statistics generated by ANALYZE are used to choose the most efficient
>> plan, and ANALYZE runs faster because it just takes a random sample of
>
>> rows. Out-of-date statistics are one of the most common causes of
>> slow queries. That's not to say there couldn't be some very unusual
>> circumstances under which it might make sense to disable ANALYZE, but
>> I'm highly skeptical.
>>
>> Anyway, if you *really* want to shoot that fly off the end of your toe
>
>> (to stretch a metaphor), you could adjust the autovacuum settings
>> related to analyze to really high values.
>>
>> -Kevin
>>
>
>
> --
> Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make
> changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-admin
>
^ permalink raw reply [nested|flat] 12+ messages in thread
end of thread, other threads:[~2010-05-14 15:24 UTC | newest]
Thread overview: 12+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2010-05-14 12:52 Clarification required: autovacuum and VACUUM command mode Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
2010-05-14 13:03 ` Guillaume Lelarge <guillaume@lelarge.info>
2010-05-14 13:12 ` Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
2010-05-14 13:40 ` Kevin Grittner <Kevin.Grittner@wicourts.gov>
2010-05-14 14:20 ` Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
2010-05-14 14:44 ` Scott Marlowe <scott.marlowe@gmail.com>
2010-05-14 14:47 ` Kevin Grittner <Kevin.Grittner@wicourts.gov>
2010-05-14 15:01 ` Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
2010-05-14 15:04 ` Lewis Kapell <lkapell@setonhome.org>
2010-05-14 15:17 ` Narasimha Murthy-VRFX87 <VRFX87@motorola.com>
2010-05-14 15:24 ` Lewis Kapell <lkapell@setonhome.org>
2010-05-14 15:17 ` Kevin Grittner <Kevin.Grittner@wicourts.gov>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox