pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedtemp_file_limit?
25+ messages / 5 participants
[nested] [flat]
* temp_file_limit?
@ 2022-12-18 11:48 Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
0 siblings, 1 reply; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-18 11:48 UTC (permalink / raw)
To: pgsql-performance@lists.postgresql.org
Hi list,
I have a misbehaving query which uses all available disk space and then
terminates with a "cannot write block" error. To prevent other processes
from running into trouble I've set the following:
temp_file_limit = 100GB
The query does parallelize and uses one parallel worker while executing,
but it does not abort when the temp file limit is reached:
345G pgsql_tmp
It does abort way later, after using around 300+ GB:
[53400] ERROR: temporary file size exceeds temp_file_limit (104857600kB)
Where: parallel worker
The comment in the file states that this is a per-session parameter, so
what is going wrong here?
I am using Postgres 14 on Ubuntu.
Regards,
Frits
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-18 15:57 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
0 siblings, 1 reply; 25+ messages in thread
From: Justin Pryzby @ 2022-12-18 15:57 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: pgsql-performance@lists.postgresql.org
On Sun, Dec 18, 2022 at 12:48:03PM +0100, Frits Jalvingh wrote:
> Hi list,
>
> I have a misbehaving query which uses all available disk space and then
> terminates with a "cannot write block" error. To prevent other processes
> from running into trouble I've set the following:
>
> temp_file_limit = 100GB
> The comment in the file states that this is a per-session parameter, so
> what is going wrong here?
Do you mean the comment in postgresql.conf ?
commit d1f822e58 changed to say that temp_file_limit is actually
per-process and not per-session.
Could you send the query plan, preferably "explain analyze" (if the
query finishes sometimes) ?
log_temp_files may be helpful here.
> The query does parallelize and uses one parallel worker while executing,
> but it does not abort when the temp file limit is reached:
>
> 345G pgsql_tmp
>
> It does abort way later, after using around 300+ GB:
> [53400] ERROR: temporary file size exceeds temp_file_limit (104857600kB)
> Where: parallel worker
Are you sure the 345G are from only one instance of the query ?
Or is it running multiple times, or along with other queries writing
100GB of tempfiles.
It seems possible that it sometimes runs with more than one parallel
worker. Also, are there old/stray tempfiles there which need to be
cleaned up?
--
Justin
^ permalink raw reply [nested|flat] 25+ messages in thread
* Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
@ 2022-12-18 17:29 ` Frits Jalvingh <jal@etc.to>
2022-12-18 19:28 ` Re: Fwd: temp_file_limit? Tom Lane <tgl@sss.pgh.pa.us>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 19:50 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
0 siblings, 3 replies; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-18 17:29 UTC (permalink / raw)
To: pgsql-performance@lists.postgresql.org
Hi Justin, thanks for your help!
Simple things first:
- I am running a single query on a developer machine. Nothing else uses the
database at that point.
- The database runs on a disk that has 473GB in use and 1.3T still free. I
am watching the increase in size used (watch df -hl /d2).
- If I remove the temp_file_limit the query will run until it has used the
1.3TB that was free, then it dies.
- when it runs I see two PG processes active: a main and a worker process
for that main.
I hope this answers some of the questions: yes, the query is the one using
the tempspace; it is the only one running; it uses only one parallel worker.
Just to be clear: my real question is: why is temp_file_limit not working
at the specified size? Because this is my real problem: when a query is
dying like this it will also kill other queries because these are also
running out of space. Even when the limit is per-process it should not have
exceeded 200GB imo. BTW, if that limit is really per process instead of per
session/query then that is a Very Bad Thing(tm), because this makes the
limit effectively worthless - if a query can spawn 8 parallel processes
then you can suddenly, without any form of control, again fill up that disk.
I'm not really asking for a solution to the bad performance, but hints are
always welcome so I'll include the requested info below:
With the failing plan the query never finishes; it just uses 1.3TB of
space, then dies.
This also means I cannot explain analyze as this does not produce output
when the query dies. This is a pretty terrible bug in my eyes, because you
cannot get the info when it's most needed. If I ever have time left to work
on Postgres' code this will be the first thing to fix 8-/
Anyway. The plan that fails badly is this one:
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Unique (cost=37360.85..37360.86 rows=1 width=42)
-> Sort (cost=37360.85..37360.85 rows=1 width=42)
Sort Key: (COALESCE(tijd.tijdkey, 'Unknown'::character varying)),
s_h_eenheid_ssm.identificatie
-> Hash Join (cost=34899.49..37360.84 rows=1 width=42)
Hash Cond: ((ve03678.calender_id)::text =
(COALESCE(tijd.tijdkey, 'Unknown'::character varying))::text)
Join Filter: ((s_h_eenheid_ssm.dv_start_dts <=
tijd.einddatum) AND (s_h_eenheid_ssm.dv_end_dts > tijd.einddatum) AND
(l_eenheid_sturingslabel_ssm_pe.dv_start_dts <= tijd.einddatum) AND
(l_eenheid_sturingslabel_ssm_pe.dv_end_dts > tijd.einddatum) AND
(sturingslabel_pe.dv_start_dts <= tijd.einddatum) AND
(sturingslabel_pe.dv_end_dts > tijd.einddatum))
-> Gather (cost=34897.66..37358.98 rows=1 width=65)
Workers Planned: 1
-> Parallel Hash Join (cost=33897.66..36358.88
rows=1 width=65)
Hash Cond: ((s_h_eenheid_ssm.id_h_eenheid =
l_eenheid_sturingslabel_ssm_pe.id_h_eenheid) AND
(COALESCE(s_h_eenheid_ssm.id_s, '-1'::integer) = ve03678.eenheid_id))
-> Parallel Seq Scan on s_h_eenheid_ssm
(cost=0.00..2326.55 rows=17955 width=34)
-> Parallel Hash (cost=33896.02..33896.02
rows=109 width=47)
-> Parallel Hash Join
(cost=18850.80..33896.02 rows=109 width=47)
Hash Cond: (ve03678.ve03678 =
sturingslabel_pe.datum)
-> Parallel Seq Scan on ve0367801
ve03678 (cost=0.00..12584.92 rows=655792 width=15)
-> Parallel Hash
(cost=18850.78..18850.78 rows=1 width=40)
-> Parallel Hash Join
(cost=15458.27..18850.78 rows=1 width=40)
Hash Cond:
(l_eenheid_sturingslabel_ssm_pe.id_h_sturingslabel =
sturingslabel_pe.id_h_sturingslabel)
-> Parallel Seq Scan on
l_eenheid_sturingslabel_ssm l_eenheid_sturingslabel_ssm_pe
(cost=0.00..2963.36 rows=114436 width=24)
-> Parallel Hash
(cost=15458.26..15458.26 rows=1 width=24)
-> Parallel Seq
Scan on s_h_sturingslabel_ssm sturingslabel_pe (cost=0.00..15458.26 rows=1
width=24)
Filter:
((soort = 'MSL'::text) AND (code = 'DAE'::text))
-> Hash (cost=1.37..1.37 rows=37 width=11)
-> Seq Scan on tijd (cost=0.00..1.37 rows=37
width=11)
(24 rows)
https://explain.depesz.com/s/qwsh
By itself I'm used to bad query performance in Postgresql; our application
only does bulk queries and Postgres quite often makes terrible plans for
those, but with set enable_nestloop=false set always most of them at least
execute. The remaining failing queries are almost 100% caused by bad join
sequences; I plan to work around those by forcing the join order from our
application. For instance, the exact same query above can also generate the
following plan (this one was created by manually setting
join_collapse_limit = 1, but fast variants also occur quite often when
disabling parallelism):
Unique (cost=70070.71..70070.72 rows=1 width=42) (actual
time=4566.379..4766.112 rows=1058629 loops=1)
-> Sort (cost=70070.71..70070.71 rows=1 width=42) (actual
time=4566.377..4618.021 rows=1058629 loops=1)
Sort Key: (COALESCE(tijd.tijdkey, 'Unknown'::character varying)),
s_h_eenheid_ssm.identificatie
Sort Method: quicksort Memory: 115317kB
-> Gather (cost=50108.01..70070.70 rows=1 width=42) (actual
time=1297.620..1651.003 rows=1058629 loops=1)
Workers Planned: 1
Workers Launched: 1
-> Parallel Hash Join (cost=49108.01..69070.60 rows=1
width=42) (actual time=1294.655..1604.524 rows=529314 loops=2)
Hash Cond: (((ve03678.calender_id)::text =
(COALESCE(tijd.tijdkey, 'Unknown'::character varying))::text) AND
(ve03678.eenheid_id = COALESCE(s_h_eenheid_ssm.id_s, '-1'::integer)) AND
(ve03678.ve03678 = sturingslabel_pe.datum))
-> Parallel Seq Scan on ve0367801 ve03678
(cost=0.00..12584.92 rows=655792 width=15) (actual time=0.004..27.971
rows=557423 loops=2)
-> Parallel Hash (cost=49107.99..49107.99 rows=1
width=25) (actual time=1294.347..1294.352 rows=542512 loops=2)
Buckets: 2097152 (originally 1024) Batches: 1
(originally 1) Memory Usage: 100728kB
-> Parallel Hash Join (cost=39244.15..49107.99
rows=1 width=25) (actual time=390.276..1089.770 rows=542512 loops=2)
Hash Cond:
(l_eenheid_sturingslabel_ssm_pe.id_h_sturingslabel =
sturingslabel_pe.id_h_sturingslabel)
Join Filter:
((sturingslabel_pe.dv_start_dts <= tijd.einddatum) AND
(sturingslabel_pe.dv_end_dts > tijd.einddatum))
-> Hash Join (cost=23785.87..33486.40
rows=43548 width=29) (actual time=342.982..791.469 rows=3367092 loops=2)
Hash Cond:
(l_eenheid_sturingslabel_ssm_pe.id_h_eenheid = s_h_eenheid_ssm.id_h_eenheid)
Join Filter:
((l_eenheid_sturingslabel_ssm_pe.dv_start_dts <= tijd.einddatum) AND
(l_eenheid_sturingslabel_ssm_pe.dv_end_dts > tijd.einddatum))
-> Parallel Seq Scan on
l_eenheid_sturingslabel_ssm l_eenheid_sturingslabel_ssm_pe
(cost=0.00..2963.36 rows=114436 width=24) (actual time=0.002..5.818
rows=97271 loops=2)
-> Hash (cost=22217.33..22217.33
rows=125483 width=29) (actual time=342.703..342.705 rows=1129351 loops=2)
Buckets: 2097152 (originally
131072) Batches: 1 (originally 1) Memory Usage: 86969kB
-> Nested Loop
(cost=0.00..22217.33 rows=125483 width=29) (actual time=0.039..175.471
rows=1129351 loops=2)
Join Filter:
((s_h_eenheid_ssm.dv_start_dts <= tijd.einddatum) AND
(s_h_eenheid_ssm.dv_end_dts > tijd.einddatum))
-> Seq Scan on
s_h_eenheid_ssm (cost=0.00..2452.23 rows=30523 width=34) (actual
time=0.022..4.488 rows=30523 loops=2)
-> Materialize
(cost=0.00..1.56 rows=37 width=11) (actual time=0.000..0.001 rows=37
loops=61046)
-> Seq Scan on
tijd (cost=0.00..1.37 rows=37 width=11) (actual time=0.009..0.013 rows=37
loops=2)
-> Parallel Hash
(cost=15458.26..15458.26 rows=1 width=24) (actual time=47.265..47.265
rows=69 loops=2)
Buckets: 1024 Batches: 1 Memory
Usage: 72kB
-> Parallel Seq Scan on
s_h_sturingslabel_ssm sturingslabel_pe (cost=0.00..15458.26 rows=1
width=24) (actual time=4.478..47.241 rows=69 loops=2)
Filter: ((soort = 'MSL'::text)
AND (code = 'DAE'::text))
Rows Removed by Filter: 233072
Planning Time: 0.623 ms
Execution Time: 5144.937 ms
(33 rows)
https://explain.depesz.com/s/CKhC
Same query, now runs in 5 seconds.
This query is behaving quite special in one of our customers' databases; it
runs about 80% of the time in 8 to 16 seconds, about 15% of the time it
takes about 2 hours, and the remaining 5% it dies with a disk space issue...
Regards,
Frits
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-18 19:28 ` Tom Lane <tgl@sss.pgh.pa.us>
2 siblings, 0 replies; 25+ messages in thread
From: Tom Lane @ 2022-12-18 19:28 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: pgsql-performance@lists.postgresql.org
Frits Jalvingh <jal@etc.to> writes:
> Just to be clear: my real question is: why is temp_file_limit not working
> at the specified size?
I've not looked at that code lately, but I strongly suspect that
it's implemented in such a way that it's a per-process limit, not a
per-session limit. So each parallel worker could use up that much
space.
It's also possible that you've found an actual bug, but without
a reproducer case nobody's going to take that possibility too
seriously. We're unlikely to accept "the limit should work
across multiple processes" as a valid bug though. That would
require a vastly more complicated implementation.
regards, tom lane
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-18 20:10 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 16:57 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2 siblings, 2 replies; 25+ messages in thread
From: Justin Pryzby @ 2022-12-18 20:10 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: pgsql-performance@lists.postgresql.org
On Sun, Dec 18, 2022 at 06:29:41PM +0100, Frits Jalvingh wrote:
> Just to be clear: my real question is: why is temp_file_limit not
> working at the specified size? Because this is my real problem: when a
> query is dying like this it will also kill other queries because these
> are also running out of space. Even when the limit is per-process it
> should not have exceeded 200GB imo.
What OS and filesystem are in use ?
Could you list the tmpdir when it's getting huge? The filenames include
the PID, which would indicate if there's another procecss involved, or a
bug allowed it to get huge.
sudo du --max=2 -mx ./pgsql_tmp |sort -nr
BTW, pg_ls_tmpdir() hides directories, so you shouldn't rely on it for
listing temporary directories...
One possibility is that there are files in the tmpdir, which have been
unlinked, but are still opened, so their space hasn't been reclaimed.
You could check for that by running lsof -nn |grep pgsql_tmp Any deleted
files would say things like 'DEL|deleted|inode|no such'
> BTW, if that limit is really per process instead of per
> session/query then that is a Very Bad Thing(tm), because this makes the
> limit effectively worthless - if a query can spawn 8 parallel processes
> then you can suddenly, without any form of control, again fill up that disk.
8 is the default value of max_worker_processes and max_parallel_workers,
but 2 is the default value of max_parallel_workers_per_gather. You're
free the change the default value to balance it with the temp_file_limit
(as suggested by the earlier-mentioned commit).
--
Justin
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
@ 2022-12-19 00:51 ` Thomas Munro <thomas.munro@gmail.com>
2022-12-19 00:53 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 17:46 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
1 sibling, 2 replies; 25+ messages in thread
From: Thomas Munro @ 2022-12-19 00:51 UTC (permalink / raw)
To: Justin Pryzby <pryzby@telsasoft.com>; +Cc: Frits Jalvingh <jal@etc.to>; pgsql-performance@lists.postgresql.org
On Mon, Dec 19, 2022 at 9:11 AM Justin Pryzby <pryzby@telsasoft.com> wrote:
> On Sun, Dec 18, 2022 at 06:29:41PM +0100, Frits Jalvingh wrote:
> > Just to be clear: my real question is: why is temp_file_limit not
> > working at the specified size? Because this is my real problem: when a
> > query is dying like this it will also kill other queries because these
> > are also running out of space. Even when the limit is per-process it
> > should not have exceeded 200GB imo.
It's really the limit for a single file (or virtual file because we
split them on 1GB boundaries, probably well past time we stopped doing
that), but we create many temporary files for various reasons. One
possibility is that you've hit a case that needs several rounds of
repartitioning (because of a failure to estimate the number of tuples
well), but we can't see that because you didn't show EXPLAIN (ANALYZE)
output (understandably if it runs out of disk space before
completing...). The parallel hash code doesn't free up the previous
generations' temporary files; it really only needs two generations'
worth concurrently (the one it's reading from and the one it's writing
to). In rare cases where more generations are needed it could unlink
the older ones -- that hasn't been implemented yet. If you set
log_temp_files = 0 to log temporary file names, it should be clear if
it's going through multiple rounds of repartitioning, from the names
(...of32..., ...of64..., ...of128..., ...of256..., ...).
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
@ 2022-12-19 00:53 ` Thomas Munro <thomas.munro@gmail.com>
2022-12-19 09:47 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
1 sibling, 1 reply; 25+ messages in thread
From: Thomas Munro @ 2022-12-19 00:53 UTC (permalink / raw)
To: Justin Pryzby <pryzby@telsasoft.com>; +Cc: Frits Jalvingh <jal@etc.to>; pgsql-performance@lists.postgresql.org
On Mon, Dec 19, 2022 at 1:51 PM Thomas Munro <thomas.munro@gmail.com> wrote:
> It's really the limit for a single file
Oops, sorry I take that back. It should be per process.
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 00:53 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
@ 2022-12-19 09:47 ` Frits Jalvingh <jal@etc.to>
2022-12-19 12:15 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
0 siblings, 1 reply; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-19 09:47 UTC (permalink / raw)
To: pgsql-performance@lists.postgresql.org
Hi Tom and Thomas, thanks for your help.
@Tom:
If it really is per-process then I would have expected it to die after
200GB was used?
As far as "valid bug" is concerned: I had hoped this would be per session,
as this at least delivers a reasonable and usable limit; it is easy to
control the number of sessions/statements in execution.
If it really is per process then the limit is not really useful, just like
work_mem: the execution plan of a query determines the number of processes
(up to the max, at least that is way better than work_mem) and that can
change whenever Postgres feels a new plan is in order. I can understand
that solving this might be harder (although to me it looks like just a
little bit of shared memory per session to keep a number). To me it does
not sound like an invalid bug, just one you do not want to solve now ;) And
the real problem, for me, is actually that both work_mem and
temp_file_limit should be for the entire instance/cluster ;) I know that
that is even harder.
For us it means we really cannot use Postgres parallelism: it is infinitely
better to have a query that runs longer but which finishes than to have the
database die and recover randomly with OOM or with disk space filling up
killing random queries. Which is a bit of a pity, ofc.
@Justin
The test is running on Ubuntu 22.04.1, x86_64, the disk is an NVMe 2TB
WD850X with ext4 as a file system.
I will collect the other data around tmpfiles hopefully later today.
I have already set max_parallel_workers_per_gather to 1. I will probably
disable all parallelism for the next runs to see whether that makes the
size limit more workable..
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 00:53 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 09:47 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-19 12:15 ` Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 14:45 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
0 siblings, 1 reply; 25+ messages in thread
From: Ranier Vilela @ 2022-12-19 12:15 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: pgsql-performance@lists.postgresql.org
Em seg., 19 de dez. de 2022 às 06:47, Frits Jalvingh <jal@etc.to> escreveu:
>
> The test is running on Ubuntu 22.04.1, x86_64, the disk is an NVMe 2TB
> WD850X with ext4 as a file system.
>
It's probably not a production environment.
Any chance of adding another 2TB NVMe, just for the temp files?
To see if Postgres can finish the queries and provide more information?
What exactly is the version of Postgres (14.???) are you using it?
regards,
Ranier Vilela
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 00:53 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 09:47 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 12:15 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
@ 2022-12-19 14:45 ` Frits Jalvingh <jal@etc.to>
2022-12-19 14:52 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
0 siblings, 1 reply; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-19 14:45 UTC (permalink / raw)
To: ; +Cc: pgsql-performance@lists.postgresql.org
Hi Ranier, thanks for your help.
I do not have more disks lying around, and I fear that if it does not
complete with 1.3TB of disk space it might not be that likely that adding
750GB would work...
Postgres version: the original (prd) issue was on 10.x. I also tested it on
14.x with the same issue. I then upgraded my machine to 15.1 to make sure
to report on the latest version, and all information mentioned in this
thread is from that version.
btw, this query generates quite different plans when tweaking things like
nested_loop=false/true, and the "fast" plan requires nested_loops=true and
join_collapse_limit=1 (5 seconds response). An odd thing is that both plans
contain only one nested loop (a cross join, I think it cannot do that
without one) but the general plan changes a lot.. I am trying to get output
from that second plan because this one just loops using CPU, not disk...
Perhaps that one will finish with some statistics...
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 00:53 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 09:47 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 12:15 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 14:45 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-19 14:52 ` Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 15:01 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
0 siblings, 1 reply; 25+ messages in thread
From: Ranier Vilela @ 2022-12-19 14:52 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: pgsql-performance@lists.postgresql.org
Em seg., 19 de dez. de 2022 às 11:45, Frits Jalvingh <jal@etc.to> escreveu:
> Hi Ranier, thanks for your help.
>
> I do not have more disks lying around, and I fear that if it does not
> complete with 1.3TB of disk space it might not be that likely that adding
> 750GB would work...
> Postgres version: the original (prd) issue was on 10.x. I also tested it
> on 14.x with the same issue. I then upgraded my machine to 15.1 to make
> sure to report on the latest version, and all information mentioned in this
> thread is from that version.
>
You can run with a Postgres debug compiled version?
https://wiki.postgresql.org/wiki/Getting_a_stack_trace_of_a_running_PostgreSQL_backend_on_Linux/BSD
Maybe, some light appears.
regards,
Ranier Vilela
>
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 00:53 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 09:47 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 12:15 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 14:45 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 14:52 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
@ 2022-12-19 15:01 ` Frits Jalvingh <jal@etc.to>
0 siblings, 0 replies; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-19 15:01 UTC (permalink / raw)
To: ; +Cc: pgsql-performance@lists.postgresql.org
Hehehe, that is not the worst plan ;) I did that once to debug a deadlock
in the JDBC driver when talking with Postgres, but it's not an adventure
I'd like to repeat right now ;)
>
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
@ 2022-12-19 17:46 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 19:29 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
1 sibling, 1 reply; 25+ messages in thread
From: Justin Pryzby @ 2022-12-19 17:46 UTC (permalink / raw)
To: Thomas Munro <thomas.munro@gmail.com>; Frits Jalvingh <jal@etc.to>; +Cc: pgsql-performance@lists.postgresql.org
On Mon, Dec 19, 2022 at 06:27:57PM +0100, Frits Jalvingh wrote:
> I have listed the files during that run,
> 213M -rw------- 1 postgres postgres 213M dec 19 17:46 i100of128.p0.0
> 207M -rw------- 1 postgres postgres 207M dec 19 17:46 i100of128.p1.0
> 210M -rw------- 1 postgres postgres 210M dec 19 17:49 i100of256.p0.0
> 211M -rw------- 1 postgres postgres 211M dec 19 17:49 i100of256.p1.0
> 188M -rw------- 1 postgres postgres 188M dec 19 17:53 i100of512.p0.0
[...]
I think that proves Thomas' theory. I'm not sure how that helps you,
though...
On Mon, Dec 19, 2022 at 01:51:33PM +1300, Thomas Munro wrote:
> One possibility is that you've hit a case that needs several rounds of
> repartitioning (because of a failure to estimate the number of tuples
> well), but we can't see that because you didn't show EXPLAIN (ANALYZE)
> output (understandably if it runs out of disk space before
> completing...). The parallel hash code doesn't free up the previous
> generations' temporary files; it really only needs two generations'
> worth concurrently (the one it's reading from and the one it's writing
> to). In rare cases where more generations are needed it could unlink
> the older ones -- that hasn't been implemented yet. If you set
> log_temp_files = 0 to log temporary file names, it should be clear if
> it's going through multiple rounds of repartitioning, from the names
> (...of32..., ...of64..., ...of128..., ...of256..., ...).
--
Justin Pryzby
System Administrator
Telsasoft
+1-952-707-8581
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 17:46 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
@ 2022-12-19 19:29 ` Frits Jalvingh <jal@etc.to>
2022-12-19 19:42 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
0 siblings, 1 reply; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-19 19:29 UTC (permalink / raw)
To: Justin Pryzby <pryzby@telsasoft.com>; +Cc: Thomas Munro <thomas.munro@gmail.com>; pgsql-performance@lists.postgresql.org
Ok, just to make sure that I understand correctly:
The parallel hash implementation needs to resize its table because of a
mismatch in expected tuple count. I do expect this to be true: Postgres
often grossly underestimates the expected row counts in our queries.
This is not fully implemented yet: removing the "old "files is not yet
done, so every time the table resizes it creates a new set of files and the
old ones remain.
I assume that the "used file size" only includes the "current" set of
files, and that the old ones are not counted towards that amount? That
would explain why it overallocates, of course.
By itself I now know what to do: I just need to disable all parallelism (
•̀ᴗ•́ )و ̑̑
I usually do that anyway because it makes queries die randomly. This is
just another reason.
I restarted that query with max_parallel_workers_per_gather=0, and this
does not seem to use tempspace at all. It was not exactly fast, it took 82
minutes of a single process running at 100% cpu.
https://explain.depesz.com/s/HedE
Thanks a lot for your help Justin, and all others that chimed in too.
Next round is to try to get that query to run in the 5 seconds that we know
it can do, reliably.
On Mon, Dec 19, 2022 at 6:46 PM Justin Pryzby <pryzby@telsasoft.com> wrote:
> On Mon, Dec 19, 2022 at 06:27:57PM +0100, Frits Jalvingh wrote:
> > I have listed the files during that run,
>
> > 213M -rw------- 1 postgres postgres 213M dec 19 17:46 i100of128.p0.0
> > 207M -rw------- 1 postgres postgres 207M dec 19 17:46 i100of128.p1.0
> > 210M -rw------- 1 postgres postgres 210M dec 19 17:49 i100of256.p0.0
> > 211M -rw------- 1 postgres postgres 211M dec 19 17:49 i100of256.p1.0
> > 188M -rw------- 1 postgres postgres 188M dec 19 17:53 i100of512.p0.0
> [...]
>
> I think that proves Thomas' theory. I'm not sure how that helps you,
> though...
>
> On Mon, Dec 19, 2022 at 01:51:33PM +1300, Thomas Munro wrote:
> > One possibility is that you've hit a case that needs several rounds of
> > repartitioning (because of a failure to estimate the number of tuples
> > well), but we can't see that because you didn't show EXPLAIN (ANALYZE)
> > output (understandably if it runs out of disk space before
> > completing...). The parallel hash code doesn't free up the previous
> > generations' temporary files; it really only needs two generations'
> > worth concurrently (the one it's reading from and the one it's writing
> > to). In rare cases where more generations are needed it could unlink
> > the older ones -- that hasn't been implemented yet. If you set
> > log_temp_files = 0 to log temporary file names, it should be clear if
> > it's going through multiple rounds of repartitioning, from the names
> > (...of32..., ...of64..., ...of128..., ...of256..., ...).
>
> --
> Justin Pryzby
> System Administrator
> Telsasoft
> +1-952-707-8581
>
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 17:46 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 19:29 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-19 19:42 ` Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 19:59 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
0 siblings, 1 reply; 25+ messages in thread
From: Ranier Vilela @ 2022-12-19 19:42 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: Justin Pryzby <pryzby@telsasoft.com>; Thomas Munro <thomas.munro@gmail.com>; pgsql-performance@lists.postgresql.org
Em seg., 19 de dez. de 2022 às 16:29, Frits Jalvingh <jal@etc.to> escreveu:
> Ok, just to make sure that I understand correctly:
> The parallel hash implementation needs to resize its table because of a
> mismatch in expected tuple count. I do expect this to be true: Postgres
> often grossly underestimates the expected row counts in our queries.
> This is not fully implemented yet: removing the "old "files is not yet
> done, so every time the table resizes it creates a new set of files and the
> old ones remain.
> I assume that the "used file size" only includes the "current" set of
> files, and that the old ones are not counted towards that amount? That
> would explain why it overallocates, of course.
>
It is not necessary what is happening.
Could you try manually deleting (rm) these files, using the postgres user?
It's an ugly and dirty test, but it could indicate that files are really
being left behind, without being deleted by Postgres.
Alternatively, you could compile a version with
CHECK_WRITE_VS_EXTEND set, and try to fetch as much information from the
logs as possible,
as has been indicated by others here.
> By itself I now know what to do: I just need to disable all parallelism (
> •̀ᴗ•́ )و ̑̑
>
> I usually do that anyway because it makes queries die randomly. This is
> just another reason.
>
> I restarted that query with max_parallel_workers_per_gather=0, and this
> does not seem to use tempspace at all. It was not exactly fast, it took 82
> minutes of a single process running at 100% cpu.
> https://explain.depesz.com/s/HedE
>
Anyway, see the hint page (https://explain.depesz.com/s/HedE#hints),
maybe it will be useful.
regards,
Ranier Vilela
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 17:46 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 19:29 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 19:42 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
@ 2022-12-19 19:59 ` Frits Jalvingh <jal@etc.to>
2022-12-19 20:07 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
0 siblings, 1 reply; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-19 19:59 UTC (permalink / raw)
To: Ranier Vilela <ranier.vf@gmail.com>; +Cc: Justin Pryzby <pryzby@telsasoft.com>; Thomas Munro <thomas.munro@gmail.com>; pgsql-performance@lists.postgresql.org
@ranier
These files ONLY exist during the query. They get deleted as soon as the
query terminates, by Postgres itself. Once the query terminates pgsql_tmp
is completely empty. Considering what Thomas said (and the actual
occurrence of the files he mentioned) this does seem to be the more likely
cause to me.
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 17:46 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 19:29 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 19:42 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 19:59 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-19 20:07 ` Thomas Munro <thomas.munro@gmail.com>
2022-12-19 20:32 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
0 siblings, 1 reply; 25+ messages in thread
From: Thomas Munro @ 2022-12-19 20:07 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: Ranier Vilela <ranier.vf@gmail.com>; Justin Pryzby <pryzby@telsasoft.com>; pgsql-performance@lists.postgresql.org
On Tue, Dec 20, 2022 at 8:59 AM Frits Jalvingh <jal@etc.to> wrote:
> @ranier
> These files ONLY exist during the query. They get deleted as soon as the query terminates, by Postgres itself. Once the query terminates pgsql_tmp is completely empty. Considering what Thomas said (and the actual occurrence of the files he mentioned) this does seem to be the more likely cause to me.
I'm working on some bug fixes near this area at the moment, so I'll
also see if I can figure out how to implement the missing eager
cleanup of earlier generations. It's still a pretty bad scenario once
you reach it (repartitioning repeatedly, that is) and the solution to
that it probably much harder, but it's obviously not great to waste
temporary disk space like that. BTW you can disable just parallel
hash with enable_parallel_hash=false.
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
2022-12-19 17:46 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 19:29 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 19:42 ` Re: Fwd: temp_file_limit? Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 19:59 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 20:07 ` Re: Fwd: temp_file_limit? Thomas Munro <thomas.munro@gmail.com>
@ 2022-12-19 20:32 ` Frits Jalvingh <jal@etc.to>
0 siblings, 0 replies; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-19 20:32 UTC (permalink / raw)
To: Thomas Munro <thomas.munro@gmail.com>; +Cc: pgsql-performance@lists.postgresql.org
@Thomas
Thanks for helping identifying the issue. I think it would be nice to clean
up those obsoleted files during the run because running out of disk is
reality not a good thing to have ;) Of course the bad estimates leading to
the resize are the real issue but this at least makes it less bad.
Thanks for the tip about disabling parallel_hash but I also found it in the
source. As mentioned before I disable (on production systems) all
parallelism, not just for this issue but to prevent the OOM killer from
killing Postgres - which happens way more often with parallelism on...
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
@ 2022-12-19 16:57 ` Frits Jalvingh <jal@etc.to>
2022-12-19 17:15 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
1 sibling, 1 reply; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-19 16:57 UTC (permalink / raw)
To: ; +Cc: pgsql-performance@lists.postgresql.org
@justin:
Ran the query again. Top shows the following processes:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+
COMMAND
650830 postgres 20 0 7503,2m 2,6g 2,6g R 100,0 4,2 12:46.34
postgres: jal datavault_317_prd [local] EXPLAIN
666141 postgres 20 0 7486,3m 2,6g 2,6g R 100,0 4,1 2:10.24
postgres: parallel worker for PID 650830
Your commands shows, during execution:
root@chatelet:/d2/var/lib/postgresql/15/main/base# du --max=2 -mx
./pgsql_tmp |sort -nr
68629 ./pgsql_tmp/pgsql_tmp650830.3.fileset
68629 ./pgsql_tmp
root@chatelet:/d2/var/lib/postgresql/15/main/base# du --max=2 -mx
./pgsql_tmp |sort -nr
194494 ./pgsql_tmp
194493 ./pgsql_tmp/pgsql_tmp650830.3.fileset
root@chatelet:/d2/var/lib/postgresql/15/main/base# du --max=2 -mx
./pgsql_tmp |sort -nr
335289 ./pgsql_tmp/pgsql_tmp650830.3.fileset
335289 ./pgsql_tmp
root@chatelet:/d2/var/lib/postgresql/15/main/base# du --max=2 -mx
./pgsql_tmp |sort -nr
412021 ./pgsql_tmp/pgsql_tmp650830.3.fileset
412021 ./pgsql_tmp
^^^ a few seconds after this last try the query aborted:
ERROR: temporary file size exceeds temp_file_limit (104857600kB)
One possibility is that there are files in the tmpdir, which have been
> unlinked, but are still opened, so their space hasn't been reclaimed.
> You could check for that by running lsof -nn |grep pgsql_tmp Any deleted
> files would say things like 'DEL|deleted|inode|no such'
>
I do not really understand what you would like me to do, and when. The disk
space is growing, and it is actual files under pgsql_tmp?
Hope this tells you something, please let me know if you would like more
info, and again - thanks!
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 16:57 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-19 17:15 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 17:27 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
0 siblings, 1 reply; 25+ messages in thread
From: Justin Pryzby @ 2022-12-19 17:15 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: pgsql-performance@lists.postgresql.org
On Mon, Dec 19, 2022 at 05:57:42PM +0100, Frits Jalvingh wrote:
> @justin:
>
> Ran the query again. Top shows the following processes:
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+
Thanks
> root@chatelet:/d2/var/lib/postgresql/15/main/base# du --max=2 -mx
> ./pgsql_tmp |sort -nr
> 412021 ./pgsql_tmp/pgsql_tmp650830.3.fileset
> 412021 ./pgsql_tmp
> ^^^ a few seconds after this last try the query aborted:
> ERROR: temporary file size exceeds temp_file_limit (104857600kB)
>
> One possibility is that there are files in the tmpdir, which have been
> > unlinked, but are still opened, so their space hasn't been reclaimed.
> > You could check for that by running lsof -nn |grep pgsql_tmp Any deleted
> > files would say things like 'DEL|deleted|inode|no such'
>
> I do not really understand what you would like me to do, and when. The disk
> space is growing, and it is actual files under pgsql_tmp?
Run this during the query as either postgres or root:
| lsof -nn |grep pgsql_tmp |grep -E 'DEL|deleted|inode|no such'
Any files it lists would be interesting to know about.
> Hope this tells you something, please let me know if you would like more
> info, and again - thanks!
I think Thomas' idea is more likely. We'd want to know the names of
files being written, either as logged by log_temp_files or from
| find pgsql_tmp -ls
during the query.
--
Justin
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 20:10 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 16:57 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 17:15 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
@ 2022-12-19 17:27 ` Frits Jalvingh <jal@etc.to>
0 siblings, 0 replies; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-19 17:27 UTC (permalink / raw)
To: ; +Cc: pgsql-performance@lists.postgresql.org
I have listed the files during that run, I will try to add those as an
attachment to the mail, no idea if the list accepts that. There were 2024
files in that directory around the end...
Executing that lsof command only produces some warnings, no files:
root@chatelet:/d2/var/lib/postgresql/15/main/base# lsof -nn |grep pgsql_tmp
|grep -E 'DEL|deleted|inode|no such'
lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs
Output information may be incomplete.
lsof: WARNING: can't stat() fuse.jetbrains-toolbox file system
/tmp/.mount_jetbraOAyv5H
Output information may be incomplete.
lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc
Output information may be incomplete.
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i100of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i100of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i100of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i100of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i100of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i100of512.p1.0
217M -rw------- 1 postgres postgres 217M dec 19 17:46 i101of128.p0.0
203M -rw------- 1 postgres postgres 203M dec 19 17:46 i101of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i101of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i101of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i101of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i101of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i102of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i102of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i102of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i102of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i102of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i102of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i103of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i103of128.p1.0
210M -rw------- 1 postgres postgres 209M dec 19 17:49 i103of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i103of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i103of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i103of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i104of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i104of128.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i104of256.p0.0
209M -rw------- 1 postgres postgres 208M dec 19 17:49 i104of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i104of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i104of512.p1.0
215M -rw------- 1 postgres postgres 215M dec 19 17:46 i105of128.p0.0
205M -rw------- 1 postgres postgres 205M dec 19 17:46 i105of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i105of256.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i105of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i105of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i105of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i106of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i106of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i106of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i106of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i106of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i106of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i107of128.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i107of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i107of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i107of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i107of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i107of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i108of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i108of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i108of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i108of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i108of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i108of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i109of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i109of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i109of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i109of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i109of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i109of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i10of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i10of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i10of16.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i10of16.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i10of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i10of256.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i10of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i10of32.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i10of512.p0.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i10of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i10of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i10of64.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i110of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i110of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i110of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i110of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i110of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i110of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i111of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i111of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i111of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i111of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i111of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i111of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i112of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i112of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i112of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i112of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i112of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i112of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i113of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i113of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i113of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i113of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i113of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i113of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i114of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i114of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i114of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i114of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i114of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i114of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i115of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i115of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i115of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i115of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i115of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i115of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i116of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i116of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i116of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i116of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i116of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i116of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i117of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i117of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i117of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i117of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i117of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i117of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:46 i118of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i118of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i118of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i118of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i118of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i118of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i119of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i119of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i119of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i119of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i119of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i119of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i11of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i11of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i11of16.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i11of16.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i11of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i11of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i11of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i11of32.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i11of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i11of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i11of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i11of64.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i120of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i120of128.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i120of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i120of256.p1.0
190M -rw------- 1 postgres postgres 190M dec 19 17:53 i120of512.p0.0
182M -rw------- 1 postgres postgres 182M dec 19 17:53 i120of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i121of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i121of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i121of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i121of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i121of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i121of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i122of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i122of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i122of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i122of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i122of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i122of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i123of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i123of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i123of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i123of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i123of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i123of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i124of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i124of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i124of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i124of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i124of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i124of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:46 i125of128.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i125of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i125of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i125of256.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i125of512.p0.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i125of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i126of128.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i126of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i126of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i126of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i126of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i126of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:46 i127of128.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i127of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i127of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i127of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i127of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i127of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i128of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i128of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i128of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i128of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i129of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i129of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i129of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i129of512.p1.0
217M -rw------- 1 postgres postgres 217M dec 19 17:46 i12of128.p0.0
203M -rw------- 1 postgres postgres 203M dec 19 17:46 i12of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i12of16.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i12of16.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i12of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i12of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i12of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i12of32.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i12of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i12of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i12of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i12of64.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i130of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i130of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i130of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i130of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i131of256.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i131of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i131of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i131of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i132of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i132of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i132of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i132of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i133of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i133of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i133of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i133of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i134of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i134of256.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i134of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i134of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i135of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i135of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i135of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i135of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i136of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i136of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i136of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i136of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i137of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i137of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i137of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i137of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i138of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i138of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i138of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i138of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i139of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i139of256.p1.0
182M -rw------- 1 postgres postgres 182M dec 19 17:53 i139of512.p0.0
190M -rw------- 1 postgres postgres 190M dec 19 17:53 i139of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i13of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i13of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i13of16.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:44 i13of16.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:49 i13of256.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:49 i13of256.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i13of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i13of32.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i13of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i13of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i13of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i13of64.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i140of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i140of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i140of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i140of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:49 i141of256.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:49 i141of256.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i141of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i141of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i142of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i142of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i142of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i142of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i143of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i143of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i143of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i143of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i144of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i144of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i144of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i144of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i145of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i145of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i145of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i145of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i146of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i146of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i146of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i146of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i147of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i147of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i147of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i147of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i148of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i148of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i148of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i148of512.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i149of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i149of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i149of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i149of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i14of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i14of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i14of16.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i14of16.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i14of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i14of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i14of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i14of32.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i14of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i14of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i14of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i14of64.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i150of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i150of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i150of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i150of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i151of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i151of256.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i151of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i151of512.p1.0
207M -rw------- 1 postgres postgres 207M dec 19 17:49 i152of256.p0.0
213M -rw------- 1 postgres postgres 213M dec 19 17:49 i152of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i152of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i152of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i153of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i153of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i153of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i153of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i154of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i154of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i154of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i154of512.p1.0
205M -rw------- 1 postgres postgres 205M dec 19 17:49 i155of256.p0.0
215M -rw------- 1 postgres postgres 215M dec 19 17:49 i155of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i155of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i155of512.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i156of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i156of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i156of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i156of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i157of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i157of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i157of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i157of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i158of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i158of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i158of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i158of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i159of256.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i159of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i159of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i159of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i15of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i15of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i15of16.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i15of16.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i15of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i15of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i15of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i15of32.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i15of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i15of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i15of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i15of64.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i160of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i160of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i160of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i160of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i161of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i161of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i161of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i161of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i162of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i162of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i162of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i162of512.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i163of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i163of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i163of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i163of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i164of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i164of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i164of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i164of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i165of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i165of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i165of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i165of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i166of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i166of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i166of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i166of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i167of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i167of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i167of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i167of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i168of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i168of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i168of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i168of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i169of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i169of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i169of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i169of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i16of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i16of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i16of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i16of256.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i16of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i16of32.p1.0
190M -rw------- 1 postgres postgres 190M dec 19 17:53 i16of512.p0.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i16of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i16of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i16of64.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i170of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i170of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i170of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i170of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i171of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i171of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i171of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i171of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i172of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i172of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i172of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i172of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i173of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i173of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i173of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i173of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i174of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i174of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i174of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i174of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i175of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i175of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i175of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i175of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i176of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i176of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i176of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i176of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i177of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i177of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i177of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i177of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i178of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i178of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i178of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i178of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i179of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i179of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i179of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i179of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i17of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i17of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i17of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i17of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i17of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i17of32.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i17of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i17of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i17of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i17of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i180of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i180of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i180of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i180of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i181of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i181of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i181of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i181of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i182of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i182of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i182of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i182of512.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i183of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i183of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i183of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i183of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i184of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i184of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i184of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i184of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i185of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i185of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i185of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i185of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i186of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i186of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i186of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i186of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i187of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i187of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i187of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i187of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i188of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i188of256.p1.0
190M -rw------- 1 postgres postgres 190M dec 19 17:53 i188of512.p0.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i188of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i189of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i189of256.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i189of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i189of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i18of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i18of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i18of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i18of256.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i18of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i18of32.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i18of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i18of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i18of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i18of64.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i190of256.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i190of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i190of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i190of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i191of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i191of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i191of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i191of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i192of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i192of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i192of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i192of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i193of256.p0.0
210M -rw------- 1 postgres postgres 209M dec 19 17:49 i193of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i193of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i193of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i194of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i194of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i194of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i194of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i195of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i195of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i195of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i195of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i196of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i196of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i196of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i196of512.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i197of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i197of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i197of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i197of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i198of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i198of256.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i198of512.p0.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i198of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i199of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i199of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i199of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i199of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i19of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i19of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i19of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i19of256.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i19of32.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i19of32.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i19of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i19of512.p1.0
199M -rw------- 1 postgres postgres 199M dec 19 17:45 i19of64.p0.0
222M -rw------- 1 postgres postgres 222M dec 19 17:45 i19of64.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i1of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i1of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i1of16.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i1of16.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i1of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i1of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i1of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i1of32.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:43 i1of4.p0.0
213M -rw------- 1 postgres postgres 212M dec 19 17:43 i1of4.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i1of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i1of512.p1.0
211M -rw------- 1 postgres postgres 210M dec 19 17:45 i1of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i1of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i1of8.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i1of8.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i200of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i200of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i200of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i200of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i201of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i201of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i201of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i201of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i202of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i202of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i202of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i202of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i203of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i203of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i203of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i203of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i204of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i204of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i204of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i204of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i205of256.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i205of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i205of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i205of512.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i206of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i206of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i206of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i206of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i207of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i207of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i207of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i207of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i208of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i208of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i208of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i208of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i209of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i209of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i209of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i209of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i20of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i20of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i20of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i20of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i20of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i20of32.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i20of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i20of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i20of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i20of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i210of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i210of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i210of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i210of512.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i211of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i211of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i211of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i211of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i212of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i212of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i212of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i212of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i213of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i213of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i213of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i213of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i214of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i214of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i214of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i214of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i215of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i215of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i215of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i215of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i216of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i216of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i216of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i216of512.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i217of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i217of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i217of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i217of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i218of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i218of256.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i218of512.p0.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i218of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i219of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i219of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i219of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i219of512.p1.0
215M -rw------- 1 postgres postgres 215M dec 19 17:46 i21of128.p0.0
205M -rw------- 1 postgres postgres 205M dec 19 17:46 i21of128.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i21of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i21of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i21of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i21of32.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i21of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i21of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i21of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i21of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i220of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i220of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i220of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i220of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i221of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i221of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i221of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i221of512.p1.0
207M -rw------- 1 postgres postgres 207M dec 19 17:49 i222of256.p0.0
213M -rw------- 1 postgres postgres 213M dec 19 17:49 i222of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i222of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i222of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i223of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i223of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i223of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i223of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i224of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i224of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i224of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i224of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i225of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i225of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i225of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i225of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i226of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i226of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i226of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i226of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i227of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i227of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i227of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i227of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i228of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i228of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i228of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i228of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i229of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i229of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i229of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i229of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i22of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i22of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i22of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i22of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i22of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i22of32.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i22of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i22of512.p1.0
207M -rw------- 1 postgres postgres 207M dec 19 17:45 i22of64.p0.0
213M -rw------- 1 postgres postgres 213M dec 19 17:45 i22of64.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i230of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i230of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i230of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i230of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i231of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i231of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i231of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i231of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i232of256.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i232of256.p1.0
174M -rw------- 1 postgres postgres 174M dec 19 17:53 i232of512.p0.0
198M -rw------- 1 postgres postgres 198M dec 19 17:53 i232of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i233of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i233of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i233of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i233of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i234of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i234of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i234of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i234of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i235of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i235of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i235of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i235of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i236of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i236of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i236of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i236of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i237of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i237of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i237of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i237of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i238of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i238of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i238of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i238of512.p1.0
210M -rw------- 1 postgres postgres 209M dec 19 17:49 i239of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i239of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i239of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i239of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i23of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i23of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i23of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i23of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i23of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i23of32.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i23of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i23of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i23of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i23of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i240of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i240of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i240of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i240of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i241of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i241of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i241of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i241of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i242of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i242of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i242of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i242of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i243of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i243of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i243of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i243of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i244of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i244of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i244of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i244of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i245of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i245of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i245of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i245of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i246of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i246of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i246of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i246of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i247of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i247of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i247of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i247of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i248of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i248of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i248of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i248of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i249of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i249of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i249of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i249of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i24of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i24of128.p1.0
207M -rw------- 1 postgres postgres 207M dec 19 17:49 i24of256.p0.0
213M -rw------- 1 postgres postgres 213M dec 19 17:49 i24of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i24of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i24of32.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i24of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i24of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i24of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i24of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i250of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i250of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i250of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i250of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i251of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i251of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i251of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i251of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i252of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i252of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i252of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i252of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i253of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i253of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i253of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i253of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i254of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i254of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i254of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i254of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i255of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i255of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i255of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i255of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i256of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i256of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i257of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i257of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i258of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i258of512.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i259of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i259of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i25of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i25of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i25of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i25of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i25of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i25of32.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i25of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i25of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i25of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i25of64.p1.0
191M -rw------- 1 postgres postgres 191M dec 19 17:53 i260of512.p0.0
181M -rw------- 1 postgres postgres 181M dec 19 17:53 i260of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i261of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i261of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i262of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i262of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i263of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i263of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i264of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i264of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i265of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i265of512.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i266of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i266of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i267of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i267of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i268of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i268of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i269of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i269of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i26of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i26of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i26of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i26of256.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i26of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i26of32.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i26of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i26of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i26of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i26of64.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i270of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i270of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i271of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i271of512.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i272of512.p0.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i272of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i273of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i273of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i274of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i274of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i275of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i275of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i276of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i276of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i277of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i277of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i278of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i278of512.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i279of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i279of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i27of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i27of128.p1.0
205M -rw------- 1 postgres postgres 205M dec 19 17:49 i27of256.p0.0
215M -rw------- 1 postgres postgres 215M dec 19 17:49 i27of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i27of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i27of32.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i27of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i27of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i27of64.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i27of64.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i280of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i280of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i281of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i281of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i282of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i282of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i283of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i283of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i284of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i284of512.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i285of512.p0.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i285of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i286of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i286of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i287of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i287of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i288of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i288of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i289of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i289of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i28of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i28of128.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i28of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i28of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i28of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i28of32.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i28of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i28of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i28of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i28of64.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i290of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i290of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i291of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i291of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i292of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i292of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i293of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i293of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i294of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i294of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i295of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i295of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i296of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i296of512.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i297of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i297of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i298of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i298of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i299of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i299of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i29of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i29of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i29of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i29of256.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i29of32.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:44 i29of32.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i29of512.p0.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i29of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:45 i29of64.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:45 i29of64.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i2of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i2of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i2of16.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i2of16.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i2of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i2of256.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i2of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i2of32.p1.0
207M -rw------- 1 postgres postgres 207M dec 19 17:43 i2of4.p0.0
213M -rw------- 1 postgres postgres 212M dec 19 17:43 i2of4.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i2of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i2of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i2of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i2of64.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i2of8.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i2of8.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i300of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i300of512.p1.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i301of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i301of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i302of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i302of512.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i303of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i303of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i304of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i304of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i305of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i305of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i306of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i306of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i307of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i307of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i308of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i308of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i309of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i309of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i30of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i30of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i30of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i30of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i30of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i30of32.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i30of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i30of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:45 i30of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i30of64.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i310of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i310of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i311of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i311of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i312of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i312of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i313of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i313of512.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i314of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i314of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i315of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i315of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i316of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i316of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i317of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i317of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i318of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i318of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i319of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i319of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i31of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i31of128.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i31of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i31of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i31of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i31of32.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i31of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i31of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:45 i31of64.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:45 i31of64.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i320of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i320of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i321of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i321of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i322of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i322of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i323of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i323of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i324of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i324of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i325of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i325of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i326of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i326of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i327of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i327of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i328of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i328of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i329of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i329of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i32of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i32of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i32of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i32of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i32of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i32of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i32of64.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i32of64.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i330of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i330of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i331of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i331of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i332of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i332of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i333of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i333of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i334of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i334of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i335of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i335of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i336of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i336of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i337of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i337of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i338of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i338of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i339of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i339of512.p1.0
216M -rw------- 1 postgres postgres 216M dec 19 17:46 i33of128.p0.0
204M -rw------- 1 postgres postgres 204M dec 19 17:46 i33of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i33of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i33of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i33of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i33of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i33of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i33of64.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i340of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i340of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i341of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i341of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i342of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i342of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i343of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i343of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i344of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i344of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i345of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i345of512.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i346of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i346of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i347of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i347of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i348of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i348of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i349of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i349of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i34of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i34of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i34of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i34of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i34of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i34of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i34of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i34of64.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i350of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i350of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i351of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i351of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i352of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i352of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i353of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i353of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i354of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i354of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i355of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i355of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i356of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i356of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i357of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i357of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i358of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i358of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i359of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i359of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:46 i35of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i35of128.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i35of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i35of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i35of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i35of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i35of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i35of64.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i360of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i360of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i361of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i361of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i362of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i362of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i363of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i363of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i364of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i364of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i365of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i365of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i366of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i366of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i367of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i367of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i368of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i368of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i369of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i369of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i36of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i36of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i36of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i36of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i36of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i36of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i36of64.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i36of64.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i370of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i370of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i371of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i371of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i372of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i372of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i373of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i373of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i374of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i374of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i375of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i375of512.p1.0
190M -rw------- 1 postgres postgres 190M dec 19 17:53 i376of512.p0.0
182M -rw------- 1 postgres postgres 182M dec 19 17:53 i376of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i377of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i377of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i378of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i378of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i379of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i379of512.p1.0
217M -rw------- 1 postgres postgres 217M dec 19 17:46 i37of128.p0.0
203M -rw------- 1 postgres postgres 203M dec 19 17:46 i37of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i37of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i37of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i37of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i37of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i37of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i37of64.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i380of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i380of512.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i381of512.p0.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i381of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i382of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i382of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i383of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i383of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i384of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i384of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i385of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i385of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i386of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i386of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i387of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i387of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i388of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i388of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i389of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i389of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i38of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i38of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i38of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i38of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i38of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i38of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i38of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i38of64.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i390of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i390of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i391of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i391of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i392of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i392of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i393of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i393of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i394of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i394of512.p1.0
182M -rw------- 1 postgres postgres 182M dec 19 17:53 i395of512.p0.0
190M -rw------- 1 postgres postgres 190M dec 19 17:53 i395of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i396of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i396of512.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i397of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i397of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i398of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i398of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i399of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i399of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i39of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i39of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i39of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i39of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i39of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i39of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i39of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i39of64.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i3of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i3of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i3of16.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i3of16.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i3of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i3of256.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i3of32.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i3of32.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:43 i3of4.p0.0
213M -rw------- 1 postgres postgres 213M dec 19 17:43 i3of4.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i3of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i3of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i3of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i3of64.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i3of8.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i3of8.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i400of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i400of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i401of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i401of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i402of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i402of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i403of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i403of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i404of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i404of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i405of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i405of512.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i406of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i406of512.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i407of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i407of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i408of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i408of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i409of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i409of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i40of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i40of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i40of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i40of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i40of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i40of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:45 i40of64.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:45 i40of64.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i410of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i410of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i411of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i411of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i412of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i412of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i413of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i413of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i414of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i414of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i415of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i415of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i416of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i416of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i417of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i417of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i418of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i418of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i419of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i419of512.p1.0
215M -rw------- 1 postgres postgres 215M dec 19 17:46 i41of128.p0.0
205M -rw------- 1 postgres postgres 205M dec 19 17:46 i41of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i41of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i41of256.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i41of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i41of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i41of64.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i41of64.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i420of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i420of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i421of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i421of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i422of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i422of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i423of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i423of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i424of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i424of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i425of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i425of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i426of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i426of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i427of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i427of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i428of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i428of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i429of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i429of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i42of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i42of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i42of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i42of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i42of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i42of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i42of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i42of64.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i430of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i430of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i431of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i431of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i432of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i432of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i433of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i433of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i434of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i434of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i435of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i435of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i436of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i436of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i437of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i437of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i438of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i438of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i439of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i439of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i43of128.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i43of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i43of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i43of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i43of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i43of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i43of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i43of64.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i440of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i440of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i441of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i441of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i442of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i442of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i443of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i443of512.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i444of512.p0.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i444of512.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i445of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i445of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i446of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i446of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i447of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i447of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i448of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i448of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i449of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i449of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i44of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i44of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i44of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i44of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i44of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i44of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i44of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i44of64.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i450of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i450of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i451of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i451of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i452of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i452of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i453of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i453of512.p1.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i454of512.p0.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i454of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i455of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i455of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i456of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i456of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i457of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i457of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i458of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i458of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i459of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i459of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i45of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i45of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i45of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i45of256.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i45of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i45of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i45of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i45of64.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i460of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i460of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i461of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i461of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i462of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i462of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i463of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i463of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i464of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i464of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i465of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i465of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i466of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i466of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i467of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i467of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i468of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i468of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i469of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i469of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i46of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i46of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i46of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i46of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i46of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i46of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i46of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i46of64.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i470of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i470of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i471of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i471of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i472of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i472of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i473of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i473of512.p1.0
183M -rw------- 1 postgres postgres 183M dec 19 17:53 i474of512.p0.0
189M -rw------- 1 postgres postgres 189M dec 19 17:53 i474of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i475of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i475of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i476of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i476of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i477of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i477of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i478of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i478of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i479of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i479of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i47of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i47of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i47of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i47of256.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i47of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i47of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i47of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i47of64.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i480of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i480of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i481of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i481of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i482of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i482of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i483of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i483of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i484of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i484of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i485of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i485of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i486of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i486of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i487of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i487of512.p1.0
174M -rw------- 1 postgres postgres 174M dec 19 17:53 i488of512.p0.0
198M -rw------- 1 postgres postgres 198M dec 19 17:53 i488of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i489of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i489of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i48of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i48of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i48of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i48of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i48of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i48of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i48of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i48of64.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i490of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i490of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i491of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i491of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i492of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i492of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i493of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i493of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i494of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i494of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i495of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i495of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i496of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i496of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i497of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i497of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i498of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i498of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i499of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i499of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i49of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i49of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i49of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i49of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i49of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i49of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i49of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i49of64.p1.0
216M -rw------- 1 postgres postgres 216M dec 19 17:46 i4of128.p0.0
204M -rw------- 1 postgres postgres 204M dec 19 17:46 i4of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i4of16.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i4of16.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i4of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i4of256.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i4of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i4of32.p1.0
191M -rw------- 1 postgres postgres 191M dec 19 17:53 i4of512.p0.0
181M -rw------- 1 postgres postgres 181M dec 19 17:53 i4of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i4of64.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i4of64.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i4of8.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i4of8.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i500of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i500of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i501of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i501of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i502of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i502of512.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i503of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i503of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i504of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i504of512.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i505of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i505of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i506of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i506of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i507of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i507of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i508of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i508of512.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i509of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i509of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i50of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i50of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i50of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i50of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i50of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i50of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i50of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i50of64.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i510of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i510of512.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i511of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i511of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i51of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i51of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i51of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i51of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i51of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i51of512.p1.0
199M -rw------- 1 postgres postgres 199M dec 19 17:45 i51of64.p0.0
221M -rw------- 1 postgres postgres 221M dec 19 17:45 i51of64.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i52of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i52of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i52of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i52of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i52of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i52of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i52of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i52of64.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i53of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i53of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i53of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i53of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i53of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i53of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i53of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i53of64.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:46 i54of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i54of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i54of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i54of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i54of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i54of512.p1.0
207M -rw------- 1 postgres postgres 207M dec 19 17:45 i54of64.p0.0
213M -rw------- 1 postgres postgres 213M dec 19 17:45 i54of64.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i55of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i55of128.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i55of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i55of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i55of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i55of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i55of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i55of64.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i56of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i56of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i56of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i56of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i56of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i56of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i56of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i56of64.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i57of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i57of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i57of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i57of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i57of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i57of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i57of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i57of64.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i58of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i58of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i58of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i58of256.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i58of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i58of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i58of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i58of64.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i59of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i59of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i59of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i59of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i59of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i59of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i59of64.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i59of64.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i5of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i5of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i5of16.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:44 i5of16.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i5of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i5of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i5of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i5of32.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i5of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i5of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i5of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i5of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i5of8.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i5of8.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i60of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i60of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i60of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i60of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i60of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i60of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i60of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i60of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i61of128.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i61of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i61of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i61of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i61of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i61of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:45 i61of64.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:45 i61of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i62of128.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:46 i62of128.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i62of256.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i62of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i62of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i62of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:45 i62of64.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:45 i62of64.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:46 i63of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i63of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i63of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i63of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i63of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i63of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:45 i63of64.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:45 i63of64.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:46 i64of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i64of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i64of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i64of256.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i64of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i64of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i65of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i65of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i65of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i65of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i65of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i65of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i66of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i66of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i66of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i66of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i66of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i66of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i67of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i67of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i67of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i67of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i67of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i67of512.p1.0
216M -rw------- 1 postgres postgres 216M dec 19 17:46 i68of128.p0.0
204M -rw------- 1 postgres postgres 204M dec 19 17:46 i68of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i68of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i68of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i68of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i68of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i69of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i69of128.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i69of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i69of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i69of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i69of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i6of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i6of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i6of16.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i6of16.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i6of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i6of256.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i6of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i6of32.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i6of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i6of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i6of64.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i6of64.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i6of8.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i6of8.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i70of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i70of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i70of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i70of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i70of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i70of512.p1.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i71of128.p0.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i71of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i71of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i71of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i71of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i71of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i72of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i72of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i72of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i72of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i72of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i72of512.p1.0
215M -rw------- 1 postgres postgres 215M dec 19 17:46 i73of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i73of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i73of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i73of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i73of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i73of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i74of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i74of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i74of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i74of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i74of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i74of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i75of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i75of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i75of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i75of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i75of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i75of512.p1.0
217M -rw------- 1 postgres postgres 217M dec 19 17:46 i76of128.p0.0
204M -rw------- 1 postgres postgres 204M dec 19 17:46 i76of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i76of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i76of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i76of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i76of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i77of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i77of128.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i77of256.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i77of256.p1.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i77of512.p0.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i77of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i78of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i78of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i78of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i78of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i78of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i78of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i79of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i79of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i79of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i79of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i79of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i79of512.p1.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i7of128.p0.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i7of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i7of16.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i7of16.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i7of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i7of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i7of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i7of32.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i7of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i7of512.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i7of64.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:45 i7of64.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i7of8.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i7of8.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i80of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i80of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i80of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i80of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i80of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i80of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i81of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i81of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i81of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i81of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i81of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i81of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i82of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i82of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i82of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i82of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i82of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i82of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i83of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i83of128.p1.0
208M -rw------- 1 postgres postgres 208M dec 19 17:49 i83of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i83of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i83of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i83of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i84of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i84of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i84of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i84of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i84of512.p0.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i84of512.p1.0
215M -rw------- 1 postgres postgres 215M dec 19 17:46 i85of128.p0.0
206M -rw------- 1 postgres postgres 205M dec 19 17:46 i85of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i85of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i85of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i85of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i85of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i86of128.p0.0
208M -rw------- 1 postgres postgres 207M dec 19 17:46 i86of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i86of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i86of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i86of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i86of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i87of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i87of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i87of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i87of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i87of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i87of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i88of128.p0.0
208M -rw------- 1 postgres postgres 207M dec 19 17:46 i88of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i88of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i88of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i88of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i88of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i89of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i89of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i89of256.p0.0
212M -rw------- 1 postgres postgres 212M dec 19 17:49 i89of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i89of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i89of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i8of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i8of128.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i8of16.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:44 i8of16.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i8of256.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i8of256.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i8of32.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i8of32.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i8of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i8of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:45 i8of64.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:45 i8of64.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i90of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i90of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i90of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i90of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i90of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i90of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i91of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i91of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i91of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i91of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i91of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i91of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i92of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i92of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i92of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i92of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i92of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i92of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i93of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i93of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i93of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i93of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i93of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i93of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i94of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i94of128.p1.0
207M -rw------- 1 postgres postgres 207M dec 19 17:49 i94of256.p0.0
213M -rw------- 1 postgres postgres 213M dec 19 17:49 i94of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i94of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i94of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i95of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i95of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i95of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i95of256.p1.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i95of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i95of512.p1.0
213M -rw------- 1 postgres postgres 213M dec 19 17:46 i96of128.p0.0
207M -rw------- 1 postgres postgres 207M dec 19 17:46 i96of128.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:49 i96of256.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:49 i96of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i96of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i96of512.p1.0
216M -rw------- 1 postgres postgres 216M dec 19 17:46 i97of128.p0.0
204M -rw------- 1 postgres postgres 204M dec 19 17:46 i97of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i97of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i97of256.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i97of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i97of512.p1.0
212M -rw------- 1 postgres postgres 212M dec 19 17:46 i98of128.p0.0
208M -rw------- 1 postgres postgres 208M dec 19 17:46 i98of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i98of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i98of256.p1.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i98of512.p0.0
186M -rw------- 1 postgres postgres 186M dec 19 17:53 i98of512.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:46 i99of128.p0.0
209M -rw------- 1 postgres postgres 209M dec 19 17:46 i99of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i99of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i99of256.p1.0
188M -rw------- 1 postgres postgres 188M dec 19 17:53 i99of512.p0.0
184M -rw------- 1 postgres postgres 184M dec 19 17:53 i99of512.p1.0
214M -rw------- 1 postgres postgres 214M dec 19 17:46 i9of128.p0.0
206M -rw------- 1 postgres postgres 206M dec 19 17:46 i9of128.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i9of16.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i9of16.p1.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i9of256.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:49 i9of256.p1.0
211M -rw------- 1 postgres postgres 211M dec 19 17:44 i9of32.p0.0
210M -rw------- 1 postgres postgres 210M dec 19 17:44 i9of32.p1.0
185M -rw------- 1 postgres postgres 185M dec 19 17:53 i9of512.p0.0
187M -rw------- 1 postgres postgres 187M dec 19 17:53 i9of512.p1.0
209M -rw------- 1 postgres postgres 209M dec 19 17:45 i9of64.p0.0
211M -rw------- 1 postgres postgres 211M dec 19 17:45 i9of64.p1.0
Attachments:
[text/plain] pgtmpfiles.txt (135.2K, ../../CAKhTGFWSzMgqBijTmNhFXeSzFBg387r=cK0EoD-=CBrbksZb4A@mail.gmail.com/3-pgtmpfiles.txt)
download
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-19 19:50 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 20:10 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2 siblings, 1 reply; 25+ messages in thread
From: Justin Pryzby @ 2022-12-19 19:50 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: pgsql-performance@lists.postgresql.org
On Sun, Dec 18, 2022 at 06:29:41PM +0100, Frits Jalvingh wrote:
> By itself I'm used to bad query performance in Postgresql; our application
> only does bulk queries and Postgres quite often makes terrible plans for
> those, but with set enable_nestloop=false set always most of them at least
> execute. The remaining failing queries are almost 100% caused by bad join
> sequences; I plan to work around those by forcing the join order from our
> application. For instance, the exact same query above can also generate the
> following plan (this one was created by manually setting
> join_collapse_limit = 1, but fast variants also occur quite often when
> disabling parallelism):
I, too, ended up setting enable_nestloop=false for our report queries,
to avoid the worst-case plans.
But you should also try to address the rowcount misestimates. This
underestimates the rowcount by a factor of 69 (or 138 in the plan you
sent today):
| (soort = 'MSL'::text) AND (code = 'DAE'::text)
If those conditions are correlated, you can improve the estimate by
adding extended stats object.
| CREATE STATISTICS s_h_sturingslabel_ssm_stats soort,code FROM s_h_sturingslabel_ssm; ANALYZE s_h_sturingslabel_ssm;
Unfortunately, stats objects currently only improve scans, and not
joins, so that might *improve* some queries, but it won't resolve the
worst problems:
| Hash Join (cost=22,832.23..44,190.21 rows=185 width=47) (actual time=159.725..2,645,634.918 rows=28,086,472,886 loops=1)
Maybe you can improve that by adjusting the stats target or ndistinct...
--
Justin
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 19:50 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
@ 2022-12-19 20:10 ` Frits Jalvingh <jal@etc.to>
2022-12-20 21:11 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
0 siblings, 1 reply; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-19 20:10 UTC (permalink / raw)
To: Justin Pryzby <pryzby@telsasoft.com>; +Cc: pgsql-performance@lists.postgresql.org
@justin
I tried the create statistics variant and that definitely improves the
estimate, and with that one of the "bad" cases (the one with the 82 minute
plan) now creates a good plan using only a few seconds.
That is a worthwhile path to follow. A bit hard to do, because those
conditions can be anything, but I can probably calculate the ones used per
customer and create those correlation statistics from that... It is
definitely better than tweaking the "poor man's query hints" enable_xxxx
8-/ which is really not helping with plan stability either.
That will be a lot of work, but I'll let you know the results ;)
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 19:50 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 20:10 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
@ 2022-12-20 21:11 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-23 08:12 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
0 siblings, 1 reply; 25+ messages in thread
From: Justin Pryzby @ 2022-12-20 21:11 UTC (permalink / raw)
To: Frits Jalvingh <jal@etc.to>; +Cc: pgsql-performance@lists.postgresql.org
On Mon, Dec 19, 2022 at 09:10:27PM +0100, Frits Jalvingh wrote:
> @justin
>
> I tried the create statistics variant and that definitely improves the
> estimate, and with that one of the "bad" cases (the one with the 82 minute
> plan) now creates a good plan using only a few seconds.
> That is a worthwhile path to follow. A bit hard to do, because those
> conditions can be anything, but I can probably calculate the ones used per
> customer and create those correlation statistics from that... It is
> definitely better than tweaking the "poor man's query hints" enable_xxxx
> 8-/ which is really not helping with plan stability either.
>
> That will be a lot of work, but I'll let you know the results ;)
Yeah, if the conditions are arbitrary, then it's going to be more
difficult. Hopefully you don't have too many columns. :)
I suggest enabling autoexplain and monitoring for queries which were
slow, and retroactively adding statistics to those columns which are
most-commonly queried, and which have correlations (which the planner
doesn't otherwise know about).
You won't want to have more than a handful of columns in a stats object
(since it requires factorial(N) complexity), but you can have multiple
stats objects with different combinations of columns (and, in v14,
expressions). You can also set a lower stats target to make the cost a
bit lower.
You could try to check which columns are correlated, either by running:
| SELECT COUNT(1),col1,col2 FROM tbl GROUP BY 2,3 ORDER BY 1;
for different combinations of columns.
Or by creating a tentative/experimental stats object on a handful of
columns at a time for which you have an intuition about their
correlation, and then checking the calculated dependencies FROM
pg_stats_ext. You may need to to something clever to use that for
arbitrarily columns. Maybe this is a start.
| SELECT dep.value::float, tablename, attnames, dep.key, exprs FROM (SELECT (json_each_text(dependencies::text::json)).* AS dep, * FROM pg_stats_ext)dep WHERE dependencies IS NOT NULL ORDER BY 1 DESC ; -- AND regexp_count(key, ',') < 2
--
Justin
^ permalink raw reply [nested|flat] 25+ messages in thread
* Re: Fwd: temp_file_limit?
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Re: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-19 19:50 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 20:10 ` Re: Fwd: temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-20 21:11 ` Re: Fwd: temp_file_limit? Justin Pryzby <pryzby@telsasoft.com>
@ 2022-12-23 08:12 ` Frits Jalvingh <jal@etc.to>
0 siblings, 0 replies; 25+ messages in thread
From: Frits Jalvingh @ 2022-12-23 08:12 UTC (permalink / raw)
To: Justin Pryzby <pryzby@telsasoft.com>; +Cc: pgsql-performance@lists.postgresql.org
Hi Justin,
As our queries are generated I decided to create a peephole optimizer kind
of thing to scan the generated SQL AST to find multiple conditions on the
same table reference. I can then use our metadata to see if these
references are expected to be correlated. This creates about 20 statistics
sets, including the one you have indicated. This at least makes the
problematic query have a stable and very fast plan (so far). I had hoped
for some more improvement with other queries but that has not yet been
evident ;)
Thanks a lot for the tips and your help!
Cordially,
Frits
On Tue, Dec 20, 2022 at 10:11 PM Justin Pryzby <pryzby@telsasoft.com> wrote:
> On Mon, Dec 19, 2022 at 09:10:27PM +0100, Frits Jalvingh wrote:
> > @justin
> >
> > I tried the create statistics variant and that definitely improves the
> > estimate, and with that one of the "bad" cases (the one with the 82
> minute
> > plan) now creates a good plan using only a few seconds.
> > That is a worthwhile path to follow. A bit hard to do, because those
> > conditions can be anything, but I can probably calculate the ones used
> per
> > customer and create those correlation statistics from that... It is
> > definitely better than tweaking the "poor man's query hints" enable_xxxx
> > 8-/ which is really not helping with plan stability either.
> >
> > That will be a lot of work, but I'll let you know the results ;)
>
> Yeah, if the conditions are arbitrary, then it's going to be more
> difficult. Hopefully you don't have too many columns. :)
>
> I suggest enabling autoexplain and monitoring for queries which were
> slow, and retroactively adding statistics to those columns which are
> most-commonly queried, and which have correlations (which the planner
> doesn't otherwise know about).
>
> You won't want to have more than a handful of columns in a stats object
> (since it requires factorial(N) complexity), but you can have multiple
> stats objects with different combinations of columns (and, in v14,
> expressions). You can also set a lower stats target to make the cost a
> bit lower.
>
> You could try to check which columns are correlated, either by running:
> | SELECT COUNT(1),col1,col2 FROM tbl GROUP BY 2,3 ORDER BY 1;
> for different combinations of columns.
>
> Or by creating a tentative/experimental stats object on a handful of
> columns at a time for which you have an intuition about their
> correlation, and then checking the calculated dependencies FROM
> pg_stats_ext. You may need to to something clever to use that for
> arbitrarily columns. Maybe this is a start.
> | SELECT dep.value::float, tablename, attnames, dep.key, exprs FROM
> (SELECT (json_each_text(dependencies::text::json)).* AS dep, * FROM
> pg_stats_ext)dep WHERE dependencies IS NOT NULL ORDER BY 1 DESC ; -- AND
> regexp_count(key, ',') < 2
>
> --
> Justin
>
^ permalink raw reply [nested|flat] 25+ messages in thread
end of thread, other threads:[~2022-12-23 08:12 UTC | newest]
Thread overview: 25+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2022-12-18 11:48 temp_file_limit? Frits Jalvingh <jal@etc.to>
2022-12-18 15:57 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-18 17:29 ` Frits Jalvingh <jal@etc.to>
2022-12-18 19:28 ` Tom Lane <tgl@sss.pgh.pa.us>
2022-12-18 20:10 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 00:51 ` Thomas Munro <thomas.munro@gmail.com>
2022-12-19 00:53 ` Thomas Munro <thomas.munro@gmail.com>
2022-12-19 09:47 ` Frits Jalvingh <jal@etc.to>
2022-12-19 12:15 ` Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 14:45 ` Frits Jalvingh <jal@etc.to>
2022-12-19 14:52 ` Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 15:01 ` Frits Jalvingh <jal@etc.to>
2022-12-19 17:46 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 19:29 ` Frits Jalvingh <jal@etc.to>
2022-12-19 19:42 ` Ranier Vilela <ranier.vf@gmail.com>
2022-12-19 19:59 ` Frits Jalvingh <jal@etc.to>
2022-12-19 20:07 ` Thomas Munro <thomas.munro@gmail.com>
2022-12-19 20:32 ` Frits Jalvingh <jal@etc.to>
2022-12-19 16:57 ` Frits Jalvingh <jal@etc.to>
2022-12-19 17:15 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 17:27 ` Frits Jalvingh <jal@etc.to>
2022-12-19 19:50 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-19 20:10 ` Frits Jalvingh <jal@etc.to>
2022-12-20 21:11 ` Justin Pryzby <pryzby@telsasoft.com>
2022-12-23 08:12 ` Frits Jalvingh <jal@etc.to>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox