Received: from malur.postgresql.org ([2a02:16a8:dc51::56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1fkFbX-0003II-GS for pgsql-hackers@arkaria.postgresql.org; Mon, 30 Jul 2018 21:21:23 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1fkFbV-0006fh-Vn for pgsql-hackers@arkaria.postgresql.org; Mon, 30 Jul 2018 21:21:21 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1fkFbU-0006Xf-La for pgsql-hackers@lists.postgresql.org; Mon, 30 Jul 2018 21:21:20 +0000 Received: from mail-pl0-x242.google.com ([2607:f8b0:400e:c01::242]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1fkFbQ-0000vG-9N for pgsql-hackers@lists.postgresql.org; Mon, 30 Jul 2018 21:21:19 +0000 Received: by mail-pl0-x242.google.com with SMTP id d5-v6so575402pll.4 for ; Mon, 30 Jul 2018 14:21:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=message-id:mime-version:to:cc:from:subject:date:importance :in-reply-to:references; bh=d+wZQbLBC0KVFNnUW5g3kfsJa+cHMQ8WpEDcsDbzAaY=; b=SXLxGVzpBRPFrhF0G56EmcqzBrtNnNa/CMJBkhpwOpz8dEXzVywlxUgQDVoGN7MNts PSiSHNpMj66EdVsn/MDE2cithcPkMJQVACEWUYKdZnsZ2F8G0rxzT959UWLWd5B8yiLl FdIeSQYB6U21SZ5wyYN6JRdwN5SdMyFQI9rUKJvtcsF06ZbA5vrljd2mfxp7CK1ZdE2P L2NKsMdIA/3mnPifMLSyN67FdEcBV0V0pnB36w/cTBYG+BFUGyAM8B1aAmSuJLKTv3lr zH0+9Ct1I+c+ychmZrZYZwr0ynQwm78N1AOT+kJO3f/fByAK6axUbeuTBzNM4+I3LWMM AhWA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:mime-version:to:cc:from:subject:date :importance:in-reply-to:references; bh=d+wZQbLBC0KVFNnUW5g3kfsJa+cHMQ8WpEDcsDbzAaY=; b=IzuKDtyQwMYnhxJa/3E5BEyXlEg0LccJ+N7aByuGaKhOXPNj8/WMTmFO/KgLVKRzEm kRdwCqxpmFjjWnwlrKfwDGAYdJUXT2d/JBUuYMvEodRW0/HRp2URJdrD6EymVH/vUdRA GGX6WMdW8xp+oba5wa4JwzT1x6DFCwArXs0//T351eFYSm3JGi757My5WluF3s7NQWMw WJW2WVmLALYwCyV+jZJaqAXLzzjfSMWyhzssNzXTzXWe96K27h91gpmlvuIpG7E/7avH ksJs2/yk375WxsVVMRrkq7jD+ymCjL1TFTEP2GS+rb0LOz0TeCF7gQ5xy3bvY+0onWSw x/8Q== X-Gm-Message-State: AOUpUlHROlfuBBbXE6jia/x/Qm+8qu2J3ES5BN1RcXYQbrvC7wTAWmKN NJP3QUYMdgFZb+vK4vwp6P4= X-Google-Smtp-Source: AAOMgpfdcnYYCCWjmt+Mc0aWx4ssEKSjD/7LfOWA5zb1/9Iy3INr1+YlvEWwYwhoRBlvSx+ZSsn+jA== X-Received: by 2002:a17:902:3041:: with SMTP id u59-v6mr4815109plb.99.1532985673922; Mon, 30 Jul 2018 14:21:13 -0700 (PDT) Received: from ?IPv6:::ffff:207.23.178.42? (d207-023-178-042.wireless.sfu.ca. [207.23.178.42]) by smtp.gmail.com with ESMTPSA id d191-v6sm11382917pfg.172.2018.07.30.14.21.12 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 30 Jul 2018 14:21:13 -0700 (PDT) Message-ID: <5b5f8149.1c69fb81.e06c6.d054@mx.google.com> MIME-Version: 1.0 To: Tomas Vondra Cc: Andrey Borodin , Peter Geoghegan , "alvherre@2ndquadrant.com" , PostgreSQL Hackers From: Kefan Yang Subject: RE: GSOC 2018 Project - A New Sorting Routine Date: Mon, 30 Jul 2018 14:21:15 -0700 Importance: normal X-Priority: 3 In-Reply-To: References: <57ae7691-6dc8-d6d0-361a-a7269e656273@2ndquadrant.com> <00147235-69d3-d4f0-36c1-198d630af7ad@2ndquadrant.com> <1C5B17F1-D37F-4730-A2E4-EB7288C6DC09@yandex-team.ru> <78b9c822-e127-5250-a01c-4c51a50c82bd@2ndquadrant.com> <5b4fad82.1c69fb81.7a6f6.d32b@mx.google.com> <58417882-04e3-b23e-b53e-7d0720558335@2ndquadrant.com> <5b5654cc.1c69fb81.5ea44.d698@mx.google.com> Content-Type: multipart/alternative; boundary="_EBF4ECEB-4A7B-4CE7-B233-C3A9A6863ACC_" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk --_EBF4ECEB-4A7B-4CE7-B233-C3A9A6863ACC_ Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Hey Tomas!=20 Sorry to bother but it would be great if we can get the test results this w= eek. Regards, Kefan From: Tomas Vondra Sent: July 24, 2018 8:16 AM To: Kefan Yang Cc: Andrey Borodin; Peter Geoghegan; alvherre@2ndquadrant.com; PostgreSQL H= ackers Subject: Re: GSOC 2018 Project - A New Sorting Routine On 07/24/2018 12:21 AM, Kefan Yang wrote: > Hi Tomas! >=20 > I did a few tests on my own Linux machine, but the problem is that my=20 > resources on AWS(CPU, RAM and even Disk space) are very limited. I=20 > considered establishing virtual machine on my own PC but the performance= =20 > is even worse. >=20 > My original patch has two main optimizations: (1) switch to heap sort=20 > when depth limit exceeded (2) check whether the array is presorted only=20 > once at the beginning. Now I want to test these optimizations=20 > separately. On AWS EC2 instance, regressions on CREATE INDEX cases seems= =20 > to be less significant if we use (1) only, but I can only test up to=20 > 100000 records and 512MB memory using your scripts. >=20 > So would you mind re-running the tests using the two patches I provided=20 > in the attachment? That will be very helpful >=20 I can do that, but it'll have to wait a couple of days. I'm currently=20 using the boxes for some other tests. regards --=20 Tomas Vondra http://www.2ndQuadrant.com PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services --_EBF4ECEB-4A7B-4CE7-B233-C3A9A6863ACC_ Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset="utf-8"

Hey Tomas!

 

Sorry to bother but = it would be great if we can get the test results this week.

<= p class=3DMsoNormal> 

Regards,=

Kefan

 

From: Tomas Vondra
Sent: July 24, 2018 8:16 AM=
To: Kefan Yang
Cc: Andrey Borodin; Peter Geoghegan; alvherre@2ndquadrant.com; PostgreSQL Hackers
Subject: Re: GSOC 2= 018 Project - A New Sorting Routine

&nbs= p;

 

=  

On 07/24/2018 12:21 AM, Kefan Yan= g wrote:

> Hi Tomas!

>= ;

> I did a few tests on my own Linux machine, = but the problem is that my

> resources on AWS(C= PU, RAM and even Disk space) are very limited. I

&= gt; considered establishing virtual machine on my own PC but the performanc= e

> is even worse.

>=

> My original patch has two main optimizations= : (1) switch to heap sort

> when depth limit ex= ceeded (2) check whether the array is presorted only

> once at the beginning. Now I want to test these optimizations

<= p class=3DMsoNormal>> separately. On AWS EC2 instance, regressions on CR= EATE INDEX cases seems

> to be less significant= if we use (1) only, but I can only test up to

>= ; 100000 records and 512MB memory using your scripts.

>

> So would you mind re-running the test= s using the two patches I provided

> in the att= achment? That will be very helpful

>

 

I can do that, but = it'll have to wait a couple of days. I'm currently

using the boxes for some other tests.

 <= /o:p>

regards

 

--

Tomas Vondra=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 http://www.2ndQuadrant.com

Po= stgreSQL Development, 24x7 Support, Remote DBA, Training & Services

=

 

= --_EBF4ECEB-4A7B-4CE7-B233-C3A9A6863ACC_--