Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1u2BWz-00EL4F-E6 for pgsql-general@arkaria.postgresql.org; Tue, 08 Apr 2025 16:10:33 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1u2BWx-00AvQi-4J for pgsql-general@arkaria.postgresql.org; Tue, 08 Apr 2025 16:10:31 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1u2BWw-00AvQY-PW for pgsql-general@lists.postgresql.org; Tue, 08 Apr 2025 16:10:31 +0000 Received: from cloud.gatewaynet.com ([185.90.37.94]) by magus.postgresql.org with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1u2BWu-004A7l-1e for pgsql-general@lists.postgresql.org; Tue, 08 Apr 2025 16:10:30 +0000 Message-ID: Date: Tue, 8 Apr 2025 19:10:15 +0300 MIME-Version: 1.0 Content-Language: en-US To: "pgsql-general@lists.postgresql.org" From: Achilleas Mantzios - cloud Subject: timescaledb vs NULL vs pg_timeseries vs partman + pgcron + pg_ivm Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hi in continuation of "Ideas about presenting data coming from sensors" https://www.postgresql.org/message-id/flat/8d2dd92a-da16-435b-a38e-fe72191fc9d1%40cloud.gatewaynet.com we got the system working in single tables fashion (3 kinds of them), since no timeseries solution seemed to fit 100% all the requirements at the time, or simply because I didn't have the time to evaluate all the existing options. Fast forward today, in a few months we got almost 63M rows , but this will increase exponentially since new vessels will be configured to send their sensor's data. After an initial idea with timescaledb, I tried to install pg_timeseries today, and give it a try. pg_timeseries does not seem active and their "columnar" requirement seems to have stuck due to citus not having been updated to postgresql 17. Stopper. timescaledb seemed mature, but also exotic, allow me the term. No way to use native logical replication, shortage of options to run on premise or self hosted, which leaves us with those options : a) stick with timescaledb in their cloud offering and try to bridge the two systems (ours and the new timescaledb instance) b) convert to native partitioning and just try to manage via partman, forgetting for the moment incremental views and columnar store, or maybe try to introduce some functionality from pg_ivm + pgcron So the question : are those are our only options? google says so but is this really the case ? thank you.