To: "pgsql-performance@lists.postgresql.org"
 <pgsql-performance@lists.postgresql.org>
From: Gunther <raj@gusw.net>
Subject: FPGA optimization ...
Message-ID: <e41deea2-9594-36dc-be76-47c39368911e@gusw.net>
Date: Mon, 4 Nov 2019 18:33:15 -0500
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101
 Thunderbird/60.9.0
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="------------9C20CF9DAA7C4765F102DA11"
Content-Language: en-US
Precedence: bulk

This is a multi-part message in MIME format.
--------------9C20CF9DAA7C4765F102DA11
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit

The time has come.

FPGA optimization is in the palm of our hands (literally a 2 TB 40 GB/s 
IO PostgreSQL server fits into less than a shoe box), and on Amazon AWS 
F1 instances.

Some demos are beginning to exist: https://github.com/Xilinx/data-analytics.
<https://github.com/Xilinx/data-analytics>

But a lot more could be done. How about linear sort performance at O(N)? 
https://hackaday.com/2016/01/20/a-linear-time-sorting-algorithm-for-fpgas/. 
And how about ​https://people.csail.mit.edu/wjun/papers/fccm2017.pdf, 
the following four sorting accelerators are used:

  * Tuple Sorter : Sorts an N-tuple using a sorting network.
  * Page Sorter : Sorts an 8KB (a flash page) chunk of sorted N-tuples
    in on-chip memory.
  * Super-Page Sorter : Sorts 16 8K-32MB sorted chunks in DRAM.
  * Storage-to-Storage Sorter: Sorts 16 512MB or larger sorted chunks in
    flash.

Order of magnitude speed improvements? Better than Hadoop clusters on a 
single chip? 40 GB/s I/O throughput massive full table scan, blazing 
fast sort-merge joins? Here it is. Anybody working more on that? Should 
be an ideal project for a student or a group of students.

Is there a PostgreSQL foundation I could donate to, 501(c)(3) tax 
exempt? I can donate and possibly find some people at Purdue University 
who might take this on. Interest?

regards,
-Gunther


--------------9C20CF9DAA7C4765F102DA11
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit

<html>
  <head>

    <meta http-equiv="content-type" content="text/html; charset=UTF-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <p>The time has come. <br>
    </p>
    <p>FPGA optimization is in the palm of our hands (literally a 2 TB
      40 GB/s IO PostgreSQL server fits into less than a shoe box), and
      on Amazon AWS F1 instances.</p>
    <p>Some demos are beginning to exist: <a
        href="https://github.com/Xilinx/data-analytics">https://github.com/Xilinx/data-analytics.<br>
      </a></p>
    <p>But a lot more could be done. How about linear sort performance
      at O(N)? <a moz-do-not-send="true"
href="https://hackaday.com/2016/01/20/a-linear-time-sorting-algorithm-for-fpgas/">https://hackaday.com/2016/01/20/a-linear-time-sorting-algorithm-for-fpgas/</a>.
      And how about ​<a moz-do-not-send="true"
        href="https://people.csail.mit.edu/wjun/papers/fccm2017.pdf">https://people.csail.mit.edu/wjun/papers/fccm2017.pdf</a>,
      the following four sorting accelerators are used:<br>
    </p>
    <ul>
      <li>Tuple Sorter : Sorts an N-tuple using a sorting network.</li>
      <li>Page Sorter : Sorts an 8KB (a flash page) chunk of sorted
        N-tuples in on-chip memory.</li>
      <li>Super-Page Sorter : Sorts 16 8K-32MB sorted chunks in DRAM.</li>
      <li>Storage-to-Storage Sorter: Sorts 16 512MB or larger sorted
        chunks in flash.</li>
    </ul>
    <p>Order of magnitude speed improvements? Better than Hadoop
      clusters on a single chip? 40 GB/s I/O throughput massive full
      table scan, blazing fast sort-merge joins? Here it is. Anybody
      working more on that? Should be an ideal project for a student or
      a group of students.</p>
    <p>Is there a PostgreSQL foundation I could donate to, 501(c)(3) tax
      exempt? I can donate and possibly find some people at Purdue
      University who might take this on. Interest?<br>
    </p>
    <p>regards,<br>
      -Gunther<br>
    </p>
  </body>
</html>

--------------9C20CF9DAA7C4765F102DA11--