Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1UzmWz-0006nD-Ou for pgsql-hackers@arkaria.postgresql.org; Thu, 18 Jul 2013 11:37:57 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1UzmWy-0003t3-QX for pgsql-hackers@arkaria.postgresql.org; Thu, 18 Jul 2013 11:37:56 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1UzmWx-0003sx-Od for pgsql-hackers@postgresql.org; Thu, 18 Jul 2013 11:37:55 +0000 Received: from szxga01-in.huawei.com ([119.145.14.64]) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1UzmWs-0002w8-2H for pgsql-hackers@postgresql.org; Thu, 18 Jul 2013 11:37:55 +0000 Received: from 172.24.2.119 (EHLO szxeml210-edg.china.huawei.com) ([172.24.2.119]) by szxrg01-dlp.huawei.com (MOS 4.3.4-GA FastPath queued) with ESMTP id BFJ53115; Thu, 18 Jul 2013 19:22:14 +0800 (CST) Received: from SZXEML415-HUB.china.huawei.com (10.82.67.154) by szxeml210-edg.china.huawei.com (172.24.2.183) with Microsoft SMTP Server (TLS) id 14.1.323.7; Thu, 18 Jul 2013 19:20:43 +0800 Received: from blrprnc09ns (10.18.96.98) by szxeml415-hub.china.huawei.com (10.82.67.154) with Microsoft SMTP Server id 14.1.323.7; Thu, 18 Jul 2013 19:20:45 +0800 From: Amit Kapila To: "'Ants Aasma'" CC: "'Greg Smith'" , "'Heikki Linnakangas'" , "'PostgreSQL-development'" , "'KONDO Mitsumasa'" References: <51B5AFB1.5030404@lab.ntt.co.jp> <51BDCB6C.1090507@vmware.com> <51E2F1C4.6010503@2ndQuadrant.com> <51e687de.ea06980a.04fe.332eSMTPIN_ADDED_BROKEN@mx.google.com> In-Reply-To: Subject: Re: Improvement of checkpoint IO scheduler for stable transaction responses Date: Thu, 18 Jul 2013 16:50:43 +0530 Message-ID: <005d01ce83a8$d8a6fd90$89f4f8b0$@kapila@huawei.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: Ac6C6qc7ZIye5wsdTD2cYe989gafiAAu3/BA Content-Language: en-us X-Originating-IP: [10.18.96.98] X-CFilter-Loop: Reflected X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On Wednesday, July 17, 2013 6:08 PM Ants Aasma wrote: > On Wed, Jul 17, 2013 at 2:54 PM, Amit Kapila > wrote: > > I think Oracle also use similar concept for making writes efficient, > and > > they have patent also for this technology which you can find at below > link: > > > http://www.google.com/patents/US7194589?dq=645987&hl=en&sa=X&ei=kn7mUZ- > PIsWq > > rAe99oDgBw&sqi=2&pjf=1&ved=0CEcQ6AEwAw > > > > Although Oracle has different concept for performing checkpoint > writes, but > > I thought of sharing the above link with you, so that unknowingly we > should > > not go into wrong path. > > > > AFAIK instead of depending on OS buffers, they use direct I/O and > infact in > > the patent above they are using temporary buffer (Claim 3) to sort > the > > writes which is not the same idea as far as I can understand by > reading > > above thread. > > They are not even sorting anything, the patent is for > opportunistically looking for adjacent dirty blocks when writing out a > dirty buffer to disk. While a useful technique, this has nothing to do > with sorting checkpoints. It is not sorting, rather it finds consecutive blocks before writing to disk using hashing in buffer cache. I think the patch is different from it in multiple ways. I had read this patent some time back and thought that you are also trying to achieve something similar (Reduce random I/O), so shared with you. With Regards, Amit Kapila. -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers