pg.ddx.io  pgsql-general@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Arulraj, Joy <arulraj@gatech.edu>
To: pgsql-general@lists.postgresql.org <pgsql-general@lists.postgresql.org>
Subject: Feedback on supporting AI queries in Postgres with EvaDB
Date: Thu, 7 Sep 2023 14:12:09 +0000
Message-ID: <etPan.64f9da39.3226fa16.827f@gatech.edu> (raw)

Greetings!


We are developing the EvaDB query engine [https://github.com/georgia-tech-db/evadb] for supporting AI queries in Postgres. Our goal is to assist software developers in building AI-powered apps with SQL. EvaDB allows querying data with AI models in this way:


— Convert the super bowl audio to text using a speech-to-text model

CREATE TABLE transcript AS

SELECT SpeechToText(audio) FROM super_bowl_video;


— Run a ChatGPT-based query on the derived text column

SELECT ChatGPT('When did touchdowns happen in this game", text)

FROM transcript;


Here is a more interesting query for analyzing sentiments expressed in food reviews and generating responses for addressing reviews with negative sentiment:


— Analyze sentiments in reviews and respond to “negative” reviews using ChatGPT

SELECT ChatGPT(

                     "Respond to the review with a solution to address the reviewer's concern",

                      review)

FROM postgres_data.review_table

WHERE ChatGPT(

                    "Is the review positive or negative? Only reply 'positive' or 'negative'.",

                    review) = "negative"

              AND location = “waffle house”;


To process this query, EvaDB’s optimizer pushes the scan operator at the bottom of the query plan down to Postgres (SELECT review FROM postgres_data.review_table;) and takes care of executing the other operators (function expression evaluation, filtering, etc.) [https://evadb.readthedocs.io/en/stable/source/usecases/sentiment-analysis.html]. The optimizer is focused on accelerating queries with AI functions written in Python. For example, it automatically reorders query predicates based on the cost of evaluating them. While processing the review analysis query, EvaDB first filters out tuples from restaurants other than “waffle house”, and then processes the remaining tuples with ChatGPT to speed up the query.


As such optimizations are done outside Postgres, I am referring to them as “external” query optimization. Besides predicate reordering, EvaDB supports parallel query execution, function caching, etc. for speeding up AI queries [https://github.com/georgia-tech-db/evadb/tree/staging/evadb/optimizer].


We would appreciate feedback on:

  1.  How can we better use Postgres to accelerate such AI queries? Is PL/Python relevant for this use-case?

  2.  What are some prior “external” query optimization systems tailored for Postgres that we can learn from?



Thanks for your time,

Joy

---------------------------------------------------------------
Joy Arulraj<https://faculty.cc.gatech.edu/~jarulraj/;
Assistant Professor, School of Computer Science
Georgia Tech


Message-ID: <etPan.64f9da39.3226fa16.827f@gatech.edu>
Permalink:  ../etPan.64f9da39.3226fa16.827f@gatech.edu/
Also on:    postgresql.org/message-id/etPan.64f9da39.3226fa16.827f@gatech.edu

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-general@postgresql.org
  Cc: arulraj@gatech.edu
  Subject: Re: Feedback on supporting AI queries in Postgres with EvaDB
  In-Reply-To: <etPan.64f9da39.3226fa16.827f@gatech.edu>
  References: <etPan.64f9da39.3226fa16.827f@gatech.edu>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox