pg.ddx.io pgsql-performance@postgresql.org mailing list archive help / color / mirror / Atom feed From: Nagaraj Raj <nagaraj.sf@yahoo.com>
To: Pgsql Performance <pgsql-performance@lists.postgresql.org>
Subject: Query performance
Date: Thu, 22 Oct 2020 00:32:29 +0000 (UTC)
Message-ID: <2026306342.2139401.1603326749019@mail.yahoo.com> (raw )
References: <2026306342.2139401.1603326749019.ref@mail.yahoo.com >
Hi, I have long running query which running for long time and its planner always performing sequnce scan the table2.My gole is to reduce Read IO on the disk cause, this query runns more oftenly ( using this in funtion for ETL).
table1: transfer_order_header(records 2782678)table2: transfer_order_item ( records: 15995697)here is the query:
set work_mem = '688552kB';explain (analyze,buffers)select COALESCE(itm.serialnumber,'') AS SERIAL_NO, COALESCE(itm.ITEM_SKU,'') AS SKU, COALESCE(itm.receivingplant,'') AS RECEIVINGPLANT, COALESCE(itm.STO_ID,'') AS STO, supplyingplant, COALESCE(itm.deliveryitem,'') AS DELIVERYITEM, min(eventtime) as eventtime FROM sor_t.transfer_order_header hed,sor_t.transfer_order_item itm where hed.eventid=itm.eventid group by 1,2,3,4,5,6
Query Planner[2]:
"Finalize GroupAggregate (cost=1930380.06..4063262.11 rows=16004137 width=172) (actual time=56050.500..83268.566 rows=15891873 loops=1)"" Group Key: (COALESCE(itm.serialnumber, ''::character varying)), (COALESCE(itm.item_sku, ''::character varying)), (COALESCE(itm.receivingplant, ''::character varying)), (COALESCE(itm.sto_id, ''::character varying)), hed.supplyingplant, (COALESCE(itm.deliveryitem, ''::character varying))"" Buffers: shared hit=712191 read=3, temp read=38232 written=38233"" -> Gather Merge (cost=1930380.06..3669827.09 rows=13336780 width=172) (actual time=56050.488..77106.993 rows=15948520 loops=1)"" Workers Planned: 2"" Workers Launched: 2"" Buffers: shared hit=2213081 read=12, temp read=142840 written=142843"" -> Partial GroupAggregate (cost=1929380.04..2129431.74 rows=6668390 width=172) (actual time=50031.458..54888.828 rows=5316173 loops=3)"" Group Key: (COALESCE(itm.serialnumber, ''::character varying)), (COALESCE(itm.item_sku, ''::character varying)), (COALESCE(itm.receivingplant, ''::character varying)), (COALESCE(itm.sto_id, ''::character varying)), hed.supplyingplant, (COALESCE(itm.deliveryitem, ''::character varying))"" Buffers: shared hit=2213081 read=12, temp read=142840 written=142843"" -> Sort (cost=1929380.04..1946051.01 rows=6668390 width=172) (actual time=50031.446..52823.352 rows=5332010 loops=3)"" Sort Key: (COALESCE(itm.serialnumber, ''::character varying)), (COALESCE(itm.item_sku, ''::character varying)), (COALESCE(itm.receivingplant, ''::character varying)), (COALESCE(itm.sto_id, ''::character varying)), hed.supplyingplant, (COALESCE(itm.deliveryitem, ''::character varying))"" Sort Method: external merge Disk: 305856kB"" Worker 0: Sort Method: external merge Disk: 436816kB"" Worker 1: Sort Method: external merge Disk: 400048kB"" Buffers: shared hit=2213081 read=12, temp read=142840 written=142843"" -> Parallel Hash Join (cost=133229.66..603743.97 rows=6668390 width=172) (actual time=762.925..3901.133 rows=5332010 loops=3)"" Hash Cond: ((itm.eventid)::text = (hed.eventid)::text)"" Buffers: shared hit=2213027 read=12"" -> Parallel Seq Scan on transfer_order_item itm (cost=0.00..417722.90 rows=6668390 width=68) (actual time=0.005..524.359 rows=5332010 loops=3)"" Buffers: shared hit=351039"" -> Parallel Hash (cost=118545.68..118545.68 rows=1174718 width=35) (actual time=755.590..755.590 rows=926782 loops=3)"" Buckets: 4194304 Batches: 1 Memory Usage: 243808kB"" Buffers: shared hit=1861964 read=12"" -> Parallel Index Only Scan using transfer_order_header_eventid_supplyingplant_eventtime_idx1 on transfer_order_header hed (cost=0.56..118545.68 rows=1174718 width=35) (actual time=0.128..388.436 rows=926782 loops=3)"" Heap Fetches: 18322"" Buffers: shared hit=1861964 read=12""Planning Time: 1.068 ms""Execution Time: 84274.004 ms"
Tables[1] created ddls in dbfiddle.
PG Server: PostgreSQL 11.7 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 4.9.3, 64-bit.RAM: 456Mem Settings: "maintenance_work_mem" "8563712" "kB"
"work_mem" "688552" "kB"
"wal_buffers" "2048" "8kB"
"shared_buffers" "44388442" "8kB"
Any suggestions would greatly appretiated.
Thanks,Rj
view thread (48+ messages) latest in thread
Message-ID: <2026306342.2139401.1603326749019@mail.yahoo.com>
Permalink: ../2026306342.2139401.1603326749019@mail.yahoo.com/
Also on: postgresql.org/message-id/2026306342.2139401.1603326749019@mail.yahoo.com
copy link · copy postgr.es
reply Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: nagaraj.sf@yahoo.com, pgsql-performance@lists.postgresql.org
Subject: Re: Query performance
In-Reply-To: <2026306342.2139401.1603326749019@mail.yahoo.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox