Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dEdtl-0005ab-H2 for pgsql-performance@arkaria.postgresql.org; Sat, 27 May 2017 15:45:01 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1dEdtk-0007ix-N9 for pgsql-performance@arkaria.postgresql.org; Sat, 27 May 2017 15:45:00 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1dEdru-0001aO-NK; Sat, 27 May 2017 15:43:06 +0000 Received: from smtp5-g21.free.fr ([212.27.42.5]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1dEdrl-0005Xz-FU; Sat, 27 May 2017 15:43:05 +0000 Received: from [192.168.1.13] (unknown [82.233.212.24]) by smtp5-g21.free.fr (Postfix) with ESMTP id 1605A5FFA1; Sat, 27 May 2017 17:42:54 +0200 (CEST) Subject: Re: Monitoring tool for Postgres Database References: Cc: "pgsql-admin@postgresql.org" , "pgsql-performance@postgresql.org" To: Ravi Tammineni From: phb07 Message-ID: <03d1fc8f-563f-b77a-c56c-251492d48d30@apra.asso.fr> Date: Sat, 27 May 2017 17:42:54 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/alternative; boundary="------------B31B0A5A3007CD10F3C3DA1F" X-Pg-Spam-Score: -5.4 (-----) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org This is a multi-part message in MIME format. --------------B31B0A5A3007CD10F3C3DA1F Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Hi Ravi, We, at Dalibo, are contributing to the postgres community mostly through open source administration tools development. Among them : - pgBadger, from Gilles Darold, extracts a lot of data from the postgres logs and restitutes them via a web interface (https://github.com/dalibo/pgbadger and http://dalibo.github.io/pgbadger/), - OPM - Open PostgreSQL Monitoring - monitors the activity of instances and sends alerts if needed (http://opm.io/, https://github.com/OPMDG and http://opm.readthedocs.io/index.html). It uses the check_pgactivity agent, - PoWA - PostgreSQL Workload Analyzer - captures and stores the SQL activity of instances (using the pg_stat_statements extension) and reports it through a web interface. (http://powa.readthedocs.io/en/latest/ and https://github.com/dalibo/powa). Several plugins help the DBA in understanding and improving SQL statements performance: - pg_qualstats evaluates the selectivity of predicates or where clause encountered in SQL statements, - pg_stat_kcache captures additional statistics from the OS, like CPU and physical I/Os, - HypoPG allows to create hypothetical indexes and shows the access plan that the postgres optimizer would choose if these indexes would exist. - PgCluu, from Gilles Darold, performs a full audit of a PostgreSQL Cluster performances. A collector grabs statistics on the PostgreSQL cluster using psql and sar, a grapher generates all HTML and charts output. (http://pgcluu.darold.net/ and https://github.com/darold/pgcluu) FYI, we are also working on a new project named TemBoard (http://temboard.io/ and https://github.com/dalibo/temboard). It is not yet production ready. But it has been presented at the latest postgres conference in Russia (https://pgconf.ru/en/2017/93881). Philippe Beaudoin. Le 27/05/2017 à 06:58, Dave Stibrany a écrit : > We've found pghero to be a good first line of defence. It doesn't have > alerting yet, but it's great for a quick high level healthcheck. > > Also +1 for Datadog. Extremely flexible and elegant UI + powerful > alerting capabilities. > > On Fri, May 26, 2017 at 10:32 AM, Sunkara, Amrutha > > wrote: > > We have been using Nagios to monitor the system level stats. The > database level stats that we gather are custom scripts that we > have nagios poll to get the database health. You could use pg > badger to generate reports against your database logs as well. > Pg_badger reports are your bffs for performance related specs.. > very close to AWR reports that oracle provides. > > Sotrage/Disk latencies -- we have oracle's os watcher we running > regularly on these hosts to generate iostats as well. > > Thanks. > -Amrutha. > > On Thu, May 25, 2017 at 3:48 PM, Ravi Tammineni > > wrote: > > Hi, > > What is the best monitoring tool for Postgres database? > Something like Oracle Enterprise Manager. > > Specifically I am interested in tools to help: > > Alert DBAs to problems with both configuration and performance > issues > > Deadlocks, Long running queries etc., > > Monitoring of overall system performance > > General performance tuning > > Storage/Disk latencies > > Thanks > > ravi > > > --------------B31B0A5A3007CD10F3C3DA1F Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit

Hi Ravi,

We, at Dalibo, are contributing to the postgres community mostly through open source administration tools development.

Among them :
- pgBadger, from Gilles Darold, extracts a lot of data from the postgres logs and restitutes them via a web interface (https://github.com/dalibo/pgbadger and http://dalibo.github.io/pgbadger/),
- OPM - Open PostgreSQL Monitoring - monitors the activity of instances and sends alerts if needed (http://opm.io/, https://github.com/OPMDG and http://opm.readthedocs.io/index.html). It uses the check_pgactivity agent,
- PoWA - PostgreSQL Workload Analyzer - captures and stores the SQL activity of instances (using the pg_stat_statements extension) and reports it through a web interface. (http://powa.readthedocs.io/en/latest/ and https://github.com/dalibo/powa). Several plugins help the DBA in understanding and improving SQL statements performance:
   - pg_qualstats evaluates the selectivity of predicates or where clause encountered in SQL statements,
   - pg_stat_kcache captures additional statistics from the OS, like CPU and physical I/Os,
   - HypoPG allows to create hypothetical indexes and shows the access plan that the postgres optimizer would choose if these indexes would exist.
- PgCluu, from Gilles Darold, performs a full audit of a PostgreSQL Cluster performances. A collector grabs statistics on the PostgreSQL cluster using psql and sar, a grapher generates all HTML and charts output. (http://pgcluu.darold.net/ and https://github.com/darold/pgcluu)

FYI, we are also working on a new project named TemBoard (http://temboard.io/ and https://github.com/dalibo/temboard). It is not yet production ready. But it has been presented at the latest postgres conference in Russia (https://pgconf.ru/en/2017/93881).

Philippe Beaudoin.

Le 27/05/2017 à 06:58, Dave Stibrany a écrit :
We've found pghero to be a good first line of defence. It doesn't have alerting yet, but it's great for a quick high level healthcheck. 

Also +1 for Datadog. Extremely flexible and elegant UI + powerful alerting capabilities.

On Fri, May 26, 2017 at 10:32 AM, Sunkara, Amrutha <amrutha@nytimes.com> wrote:
We have been using Nagios to monitor the system level stats. The database level stats that we gather are custom scripts that we have nagios poll to get the database health. You could use pg badger to generate reports against your database logs as well. Pg_badger reports are your bffs for performance related specs.. very close to AWR reports that oracle provides.

Sotrage/Disk latencies -- we have oracle's os watcher we running regularly on these hosts to generate iostats as well. 

Thanks.
-Amrutha.

On Thu, May 25, 2017 at 3:48 PM, Ravi Tammineni <rtammineni@partner.aligntech.com> wrote:

Hi,

 

What is the best monitoring tool for Postgres database? Something like Oracle Enterprise Manager.

 

Specifically I am interested in tools to help:

 

Alert DBAs to problems with both configuration and performance issues

Deadlocks, Long running queries etc.,

Monitoring of overall system performance

General performance tuning

Storage/Disk latencies

 

 

Thanks

ravi




--------------B31B0A5A3007CD10F3C3DA1F--