MIME-Version: 1.0
From: Rita <rmorgan466@gmail.com>
Date: Wed, 22 May 2024 16:41:29 -0400
Message-ID: 
 <CAOF-KfioWjnYUXheWoZK_Zu+2YpK1weRWt--bc-w_ka8Tr8Bjw@mail.gmail.com>
Subject: selecting a materialized view function, plpgsql
To: pgsql-novice@postgresql.org
Content-Type: multipart/alternative; boundary="000000000000278b2e061910f6b5"
Archived-At: 
 <https://www.postgresql.org/message-id/CAOF-KfioWjnYUXheWoZK_Zu%2B2YpK1weRWt--bc-w_ka8Tr8Bjw%40mail.gmail.com>
Precedence: bulk

--000000000000278b2e061910f6b5
Content-Type: text/plain; charset="UTF-8"

Hello.

I am using timescaledb with grafana. I am at a point where my telemetry
data is very large. I collect a metric every 1 second so per 1 day I have
close to (3600*24), 86400 points. Graphing them on grafana has become a
challenge because postgresql can't keep up. Especially when I want to view
a 7 day or 30 day summary.

To fix this, I created materialized views and they seem to be working but
its quite error prone when I try to implement this in Grafana. So I decided
to take the plpgsql route.

I have a function which looks like this
create or replace function nview(from_millis BIGINT,to_millis BIGINT)
RETURNS SETOF record as $$
DECLARE
  day_diff INTEGER;
  query TEXT;
BEGIN
  day_diff := (to_millis - from_millis) / (1000*3600*24);
  IF day_diff >=10 THEN
     -- run query which has 1 day averages
  ELSIF day_diff BETWEEN 4 AND 10 THEN
    -- run query which has 6 hour summaries
  ELSE
    -- run whatever
  END IF;
RETURN QUERY EXECUTE query;
END;
$$ LANGUAGE plpgsql;

Was wondering is this a good approach? Have anyone else used Grafana with
Postgresql?


-- 
--- Get your facts first, then you can distort them as you please.--

--000000000000278b2e061910f6b5
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hello.=C2=A0</div><div><br></div><div>I am using time=
scaledb with grafana. I am at a point where my telemetry data is very large=
. I collect a metric every 1 second so per 1 day I have close to (3600*24),=
 86400 points. Graphing them on grafana has become a challenge because post=
gresql can&#39;t keep up. Especially=C2=A0when I want to view a 7 day or 30=
 day summary.=C2=A0</div><div><br></div><div>To fix this, I created materia=
lized=C2=A0views and they seem to be working but its quite error prone when=
 I try to implement this in Grafana. So I decided to take the plpgsql route=
.=C2=A0</div><div><br></div><div>I have a function which looks like this</d=
iv><div>create or replace function nview(from_millis BIGINT,to_millis BIGIN=
T)</div><div>RETURNS SETOF record as $$</div><div>DECLARE</div><div>=C2=A0 =
day_diff INTEGER;</div><div>=C2=A0 query TEXT;</div><div>BEGIN</div><div>=
=C2=A0 day_diff :=3D (to_millis - from_millis) / (1000*3600*24);</div><div>=
=C2=A0 IF day_diff &gt;=3D10 THEN</div><div>=C2=A0 =C2=A0 =C2=A0-- run quer=
y which has 1 day averages</div><div>=C2=A0 ELSIF day_diff BETWEEN 4 AND 10=
 THEN</div><div>=C2=A0 =C2=A0 -- run query which has 6 hour summaries</div>=
<div>=C2=A0 ELSE</div><div>=C2=A0 =C2=A0 -- run whatever</div><div>=C2=A0 E=
ND IF;</div><div>RETURN QUERY EXECUTE query;</div><div>END;</div><div>$$ LA=
NGUAGE plpgsql;</div><div><br></div><div>Was wondering is this a good appro=
ach? Have anyone else used Grafana with Postgresql?=C2=A0</div><div><br cle=
ar=3D"all"><div><br></div><span class=3D"gmail_signature_prefix">-- </span>=
<br><div dir=3D"ltr" class=3D"gmail_signature" data-smartmail=3D"gmail_sign=
ature">--- <span>Get your facts first, then you can distort them as you ple=
ase.</span>--</div></div></div>

--000000000000278b2e061910f6b5--