pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
monitoring TPS and IOPS
7+ messages / 4 participants
[nested] [flat]

* monitoring TPS and IOPS
@ 2015-05-27 08:21 Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:30 ` monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  0 siblings, 1 reply; 7+ messages in thread

From: Pascal Laporte (plaporte) @ 2015-05-27 08:21 UTC (permalink / raw)
  To: pgsql-admin

Hello,
Which ways are available to pull information about transactions and I/O per second ?
For load testing we like to pull this information.
In Oracle we retrieve it from the AWR reports.
Are PG admins also looking at this data, and how is that collected/presented?
Cheers!



^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* monitoring TPS and IOPS
  2015-05-27 08:21 monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
@ 2015-05-27 08:30 ` Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:43   ` Re: monitoring TPS and IOPS Albe Laurenz <laurenz.albe@wien.gv.at>
  0 siblings, 1 reply; 7+ messages in thread

From: Pascal Laporte (plaporte) @ 2015-05-27 08:30 UTC (permalink / raw)
  To: pgsql-admin

Hello,
In what ways are we able to pull information about transactions and I/O per second ?
For things like load testing we need this type of information.
In Oracle we retrieve it from the AWR reports.
Are PG admins also looking at this data, and how is that collected/presented?
Cheers!



^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: monitoring TPS and IOPS
  2015-05-27 08:21 monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:30 ` monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
@ 2015-05-27 08:43   ` Albe Laurenz <laurenz.albe@wien.gv.at>
  2015-05-27 09:01     ` Re: monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  0 siblings, 1 reply; 7+ messages in thread

From: Albe Laurenz @ 2015-05-27 08:43 UTC (permalink / raw)
  To: 'Pascal Laporte (plaporte) *EXTERN*' <plaporte@cisco.com>; pgsql-admin

Pascal Laporte wrote:
> In what ways are we able to pull information about transactions and I/O per second ?
> For things like load testing we need this type of information.
> In Oracle we retrieve it from the AWR reports.
> Are PG admins also looking at this data, and how is that collected/presented?

For operating system parameters like I/O and CPU load you have to use operating
system tools, like "sar" on UNIX.

For measuring things like TPS during a test run, I'd recommend pgBadger
(http://dalibo.github.io/pgbadger/).

Yours,
Laurenz Albe

-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin


^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: monitoring TPS and IOPS
  2015-05-27 08:21 monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:30 ` monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:43   ` Re: monitoring TPS and IOPS Albe Laurenz <laurenz.albe@wien.gv.at>
@ 2015-05-27 09:01     ` Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 09:06       ` Re: monitoring TPS and IOPS Guillaume Lelarge <guillaume@lelarge.info>
  2015-05-27 09:07       ` Re: monitoring TPS and IOPS Kieren Scott <kierenscott@hotmail.com>
  2015-05-27 09:15       ` Re: monitoring TPS and IOPS Albe Laurenz <laurenz.albe@wien.gv.at>
  0 siblings, 3 replies; 7+ messages in thread

From: Pascal Laporte (plaporte) @ 2015-05-27 09:01 UTC (permalink / raw)
  To: Albe Laurenz <laurenz.albe@wien.gv.at>; pgsql-admin

Laurenz. Thank you.
For IOPS when doing load testing we would like to tell if the IO requests made by the DB can be handled by the server.
In oracle this information is stored in tables and so wondering if similar data can be found in PG as well.
I’m not sure how feasible it will be using OS tools.
For TPS we will explore pgBadger.
Regards,
__
Pascal




On 27/05/15 10:43, "Albe Laurenz" <laurenz.albe@wien.gv.at> wrote:

>Pascal Laporte wrote:
>> In what ways are we able to pull information about transactions and I/O per second ?
>> For things like load testing we need this type of information.
>> In Oracle we retrieve it from the AWR reports.
>> Are PG admins also looking at this data, and how is that collected/presented?
>
>For operating system parameters like I/O and CPU load you have to use operating
>system tools, like "sar" on UNIX.
>
>For measuring things like TPS during a test run, I'd recommend pgBadger
>(http://dalibo.github.io/pgbadger/).
>
>Yours,
>Laurenz Albe

-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin


^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: monitoring TPS and IOPS
  2015-05-27 08:21 monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:30 ` monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:43   ` Re: monitoring TPS and IOPS Albe Laurenz <laurenz.albe@wien.gv.at>
  2015-05-27 09:01     ` Re: monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
@ 2015-05-27 09:06       ` Guillaume Lelarge <guillaume@lelarge.info>
  2 siblings, 0 replies; 7+ messages in thread

From: Guillaume Lelarge @ 2015-05-27 09:06 UTC (permalink / raw)
  To: Pascal Laporte (plaporte) <plaporte@cisco.com>; +Cc: Albe Laurenz <laurenz.albe@wien.gv.at>; pgsql-admin

2015-05-27 11:01 GMT+02:00 Pascal Laporte (plaporte) <plaporte@cisco.com>:

> Laurenz. Thank you.
> For IOPS when doing load testing we would like to tell if the IO requests
> made by the DB can be handled by the server.
> In oracle this information is stored in tables and so wondering if similar
> data can be found in PG as well.
> I’m not sure how feasible it will be using OS tools.
>

Make sure the database files are on a specific partition and it will
definitely be possible with tools like iostat or sysstat/sar.

For TPS we will explore pgBadger.
>

You can also take a look at pg_stat_database (xact_commit and xact_rollback
columns). pgCluu might help you there.


> Regards,
> __
> Pascal
>
>
>
>
> On 27/05/15 10:43, "Albe Laurenz" <laurenz.albe@wien.gv.at> wrote:
>
> >Pascal Laporte wrote:
> >> In what ways are we able to pull information about transactions and I/O
> per second ?
> >> For things like load testing we need this type of information.
> >> In Oracle we retrieve it from the AWR reports.
> >> Are PG admins also looking at this data, and how is that
> collected/presented?
> >
> >For operating system parameters like I/O and CPU load you have to use
> operating
> >system tools, like "sar" on UNIX.
> >
> >For measuring things like TPS during a test run, I'd recommend pgBadger
> >(http://dalibo.github.io/pgbadger/).
> >
> >Yours,
> >Laurenz Albe
>
> --
> Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-admin
>



-- 
Guillaume.
  http://blog.guillaume.lelarge.info
  http://www.dalibo.com

^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: monitoring TPS and IOPS
  2015-05-27 08:21 monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:30 ` monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:43   ` Re: monitoring TPS and IOPS Albe Laurenz <laurenz.albe@wien.gv.at>
  2015-05-27 09:01     ` Re: monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
@ 2015-05-27 09:07       ` Kieren Scott <kierenscott@hotmail.com>
  2 siblings, 0 replies; 7+ messages in thread

From: Kieren Scott @ 2015-05-27 09:07 UTC (permalink / raw)
  To: pgsql-admin

For benchmarking TPS, have a look at pgbench if you haven't already done so.
http://www.postgresql.org/docs/devel/static/pgbench.html
Kieren

> From: plaporte@cisco.com
> To: laurenz.albe@wien.gv.at; 
> Subject: Re: [ADMIN] monitoring TPS and IOPS
> Date: Wed, 27 May 2015 09:01:33 +0000
> 
> Laurenz. Thank you.
> For IOPS when doing load testing we would like to tell if the IO requests made by the DB can be handled by the server.
> In oracle this information is stored in tables and so wondering if similar data can be found in PG as well.
> I’m not sure how feasible it will be using OS tools.
> For TPS we will explore pgBadger.
> Regards,
> __
> Pascal
> 
> 
> 
> 
> On 27/05/15 10:43, "Albe Laurenz" <laurenz.albe@wien.gv.at> wrote:
> 
> >Pascal Laporte wrote:
> >> In what ways are we able to pull information about transactions and I/O per second ?
> >> For things like load testing we need this type of information.
> >> In Oracle we retrieve it from the AWR reports.
> >> Are PG admins also looking at this data, and how is that collected/presented?
> >
> >For operating system parameters like I/O and CPU load you have to use operating
> >system tools, like "sar" on UNIX.
> >
> >For measuring things like TPS during a test run, I'd recommend pgBadger
> >(http://dalibo.github.io/pgbadger/).
> >
> >Yours,
> >Laurenz Albe
> 
> -- 
> Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-admin
 		 	   		  =

^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: monitoring TPS and IOPS
  2015-05-27 08:21 monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:30 ` monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
  2015-05-27 08:43   ` Re: monitoring TPS and IOPS Albe Laurenz <laurenz.albe@wien.gv.at>
  2015-05-27 09:01     ` Re: monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
@ 2015-05-27 09:15       ` Albe Laurenz <laurenz.albe@wien.gv.at>
  2 siblings, 0 replies; 7+ messages in thread

From: Albe Laurenz @ 2015-05-27 09:15 UTC (permalink / raw)
  To: 'Pascal Laporte (plaporte) *EXTERN*' <plaporte@cisco.com>; pgsql-admin

Pascal Laporte wrote:
> For IOPS when doing load testing we would like to tell if the IO requests made by the DB can be
> handled by the server.
> In oracle this information is stored in tables and so wondering if similar data can be found in PG as
> well.
> I’m not sure how feasible it will be using OS tools.

That works fine in my experience (which is on Linux).

I watch out for the I/O queue size, the service time and the I/O utilization.
When the queue size increases, it is an inication that the system cannot keep
up with the load.

Yours,
Laurenz Albe

-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin


^ permalink  raw  reply  [nested|flat] 7+ messages in thread


end of thread, other threads:[~2015-05-27 09:15 UTC | newest]

Thread overview: 7+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2015-05-27 08:21 monitoring TPS and IOPS Pascal Laporte (plaporte) <plaporte@cisco.com>
2015-05-27 08:30 ` Pascal Laporte (plaporte) <plaporte@cisco.com>
2015-05-27 08:43   ` Albe Laurenz <laurenz.albe@wien.gv.at>
2015-05-27 09:01     ` Pascal Laporte (plaporte) <plaporte@cisco.com>
2015-05-27 09:06       ` Guillaume Lelarge <guillaume@lelarge.info>
2015-05-27 09:07       ` Kieren Scott <kierenscott@hotmail.com>
2015-05-27 09:15       ` Albe Laurenz <laurenz.albe@wien.gv.at>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox