Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tRDXP-0085Ay-NE for pgsql-announce@arkaria.postgresql.org; Fri, 27 Dec 2024 16:50:12 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tRDXO-00BX2O-V5 for pgsql-announce@arkaria.postgresql.org; Fri, 27 Dec 2024 16:50:10 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tRDXO-00BX22-0y for pgsql-announce@lists.postgresql.org; Fri, 27 Dec 2024 16:50:09 +0000 Received: from mahout.postgresql.org ([2001:4800:3e1:1::227]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tRDXJ-001u8a-UL for pgsql-announce@lists.postgresql.org; Fri, 27 Dec 2024 16:50:09 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=postgresql.org; s=20171124; h=Message-ID:Date:Reply-To:From:To:Subject: MIME-Version:Content-Type:Sender:Cc:Content-Transfer-Encoding:Content-ID: Content-Description:In-Reply-To:References; bh=bFFG42uLCRZJ2EyqjYh/9e2i0Pah7HtsvOn+vz/aQdM=; b=XnrAnUsM4I2GHXVKy2uFBNZc5D 294JYOEtwGenaVgsh4po+FN/+YhRFk3bgNtcHKJaQQ2LReiViPk/4T0JYhKaOOEACAClcN/+PXKQC qIy9+OCCnjqCCLfY+iIxcUnn4IKgWkwumSArin5wAasvYgcHzkbjim6MB+SB9RSQ2LVk4LHfv5+mn I3AUf4XAcMI1w6S3hMMFbCpSStE5hqmddoD1p7E4ffxMUdYQFjtcQPz3uebQYQQIsfE84FUNyuKbk WNRCqnKtnpHiTZ9d1n+GMzQbfG6b1U0loHCzfJMgCID64U9EG/JuMx6kBkgOtmJYs/mudvCp/SuZk rRdYzmSg==; Received: from wrigleys.postgresql.org ([2a02:16a8:dc51::60]) by mahout.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tRDXH-005Ow5-UE for pgsql-announce@lists.postgresql.org; Fri, 27 Dec 2024 16:50:04 +0000 Received: from localhost ([127.0.0.1] helo=wrigleys.postgresql.org) by wrigleys.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tRDXF-007q6l-Vw for pgsql-announce@lists.postgresql.org; Fri, 27 Dec 2024 16:50:02 +0000 Content-Type: multipart/mixed; boundary="===============3716136427656767762==" MIME-Version: 1.0 Subject: [ANNOUNCE] SynchDB 1.0 Released - PostgreSQL Extension for Real-Time Database Synchronization To: PostgreSQL Announce From: Hornetlabs Technology Inc via PostgreSQL Announce Reply-To: grantzhou@highgo.ca Date: Fri, 27 Dec 2024 16:49:16 +0000 Message-ID: <173531815620.678.17595712145362117993@wrigleys.postgresql.org> X-Auto-Response-Suppress: All Auto-Submitted: auto-generated X-pglister-tags: related X-pglister-tagsig: 64064cbaf38a2105a4d6b891c70b8c06bdedffda3291be2e07d45f2547ead34c List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --===============3716136427656767762== Content-Type: multipart/alternative; boundary="===============5198399806153745670==" MIME-Version: 1.0 --===============5198399806153745670== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable # SynchDB 1.0 Release Notes **Release Date: December 24, 2024** We're excited to announce the release of SynchDB 1.0! This PostgreSQL exten= sion enables seamless data synchronization from multiple heterogeneous data= bases (MySQL, MS SQL Server) directly to PostgreSQL. SynchDB handles all da= ta synchronization natively without middleware, providing an efficient solu= tion for real-time data replication and integration. This release addresses performance and resource issues identified in the 1.= 0 beta1 release and introduces several new utilities for fine-tuning SynchD= B's behavior and performance. ## New Features ### Performance Improvements - Implemented data caching in DML parsing stage to reduce PostgreSQL catalo= g access - Added throttle control in Debezium runner to prevent JVM memory buildup - Significantly increased processing speed by handling batches in single Po= stgreSQL transactions ### New Functions and Views - `synchdb_start_engine_bgw(name, mode)`: Added custom snapshot mode parame= ter - `synchdb_log_jvm_meminfo(name)`: Debug function for JVM heap memory usage= monitoring - `synchdb_stats_view`: New view for connector statistics - `synchdb_reset_stats(name)`: Function to clear connector statistics ### Configuration Enhancements - Added new GUCs for Debezium Runner performance tuning - Made JVM maximum heap memory allocation configurable - Enabled connector-specific SSL parameter configuration in rule files - Made maximum number of connector background workers configurable ## Changes - Enhanced `synchdb_state_view()`: - Added new 'stage' field showing connector status - Limited display to valid connectors only - Removed partial batch completion notifications - Updated SQLServer's default char type size mapping from 0 to -1 ## Bug Fixes - Resolved memory leaks in both SynchDB and Debezium runner components - Improved memory context handling in SynchDB - Corrected heap memory release during change event processing - Fixed SPI memory usage during DML processing ## Known Issues 1. Automatic connector launcher limitation: - Only launches connector workers created under the default postgres dat= abase - Issue tracking: github.com/Hornetlabs/synchdb/issues/71 2. ALTER TABLE ALTER COLUMN limitations: - Cannot handle complex data type changes (e.g., TEXT to INT) - Does not support column index changes - Cannot process renamed columns - Issue tracking: github.com/Hornetlabs/synchdb/issues/77 3. Connector state persistence: - Restarting a paused connector resumes operation instead of maintaining= paused state - Issue tracking: github.com/Hornetlabs/synchdb/issues/80 ## Resources - GitHub Repository: [SynchDB GitHub](https://github.com/Hornetlabs/synchdb) - Documentation: [SynchDB Docs](https://docs.synchdb.com/) - Downloads: [Release v1.0](https://github.com/Hornetlabs/synchdb/releases/= tag/v1.0) - Issue Reporting: [GitHub Issues](https://github.com/Hornetlabs/synchdb/is= sues) - Website: [Hornetlabs Technology](https://hornetlabs.ca/) ## About SynchDB SynchDB is an open-source PostgreSQL extension developed by Hornetlabs Tech= nology. It enables direct data replication from heterogeneous databases (My= SQL, MS SQLServer, Oracle, etc.) to PostgreSQL with high performance and re= liability. The extension handles all synchronization needs without requirin= g middleware or third-party software. --===============5198399806153745670== Content-Type: text/html; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable [ANNOUNCE] SynchDB 1.0 Released - PostgreSQL Extension for Real-= Time Database Synchronization
 

[ANNOUNCE] SynchDB 1.0 Released - PostgreSQL Extension for Real-Time = Database Synchronization

SynchDB 1.0 Release Notes

Release Date: December 24, 2024

We're excited to announce the release of Sy= nchDB 1.0! This PostgreSQL extension enables seamless data synchronization = from multiple heterogeneous databases (MySQL, MS SQL Server) directly to Po= stgreSQL. SynchDB handles all data synchronization natively without middlew= are, providing an efficient solution for real-time data replication and int= egration.

This release addresses performance and reso= urce issues identified in the 1.0 beta1 release and introduces several new = utilities for fine-tuning SynchDB's behavior and performance.

New Features

Performance Improvements

  • Implemented dat= a caching in DML parsing stage to reduce PostgreSQL catalog access
  • Added throttle = control in Debezium runner to prevent JVM memory buildup
  • Significantly i= ncreased processing speed by handling batches in single PostgreSQL transact= ions

New Functions and Views

  • synchdb_s= tart_engine_bgw(name, mode): Added custom snapshot mode parameter
  • synchdb_l= og_jvm_meminfo(name): Debug function for JVM heap memory usage monit= oring
  • synchdb_s= tats_view: New view for connector statistics
  • synchdb_r= eset_stats(name): Function to clear connector statistics

Configuration Enhancements

  • Added new GUCs = for Debezium Runner performance tuning
  • Made JVM maximu= m heap memory allocation configurable
  • Enabled connect= or-specific SSL parameter configuration in rule files
  • Made maximum nu= mber of connector background workers configurable

Changes

  • Enhanced = synchdb_state_view():
  • Added new 'stag= e' field showing connector status
  • Limited display= to valid connectors only
  • Removed partial= batch completion notifications
  • Updated SQLServ= er's default char type size mapping from 0 to -1

Bug Fixes

  • Resolved memory= leaks in both SynchDB and Debezium runner components
  • Improved memory= context handling in SynchDB
  • Corrected heap = memory release during change event processing
  • Fixed SPI memor= y usage during DML processing

Known Issues

  1. Automatic conne= ctor launcher limitation:
  2. Only launches c= onnector workers created under the default postgres database

  3. Issue tracking: github.com/Hornetlabs/synch= db/issues/71

  4. ALTER TABLE ALTER COLUMN limitations:

  5. Cannot handle c= omplex data type changes (e.g., TEXT to INT)
  6. Does not suppor= t column index changes
  7. Cannot process = renamed columns

  8. Issue tracking: github.com/Hornetlabs/synch= db/issues/77

  9. Connector state persistence:

  10. Restarting a pa= used connector resumes operation instead of maintaining paused state
  11. Issue tracking:= github.com/Hornetlabs/synchdb/issues/80

Resources

About SynchDB

SynchDB is an open-source PostgreSQL extens= ion developed by Hornetlabs Technology. It enables direct data replication = from heterogeneous databases (MySQL, MS SQLServer, Oracle, etc.) to Postgre= SQL with high performance and reliability. The extension handles all synchr= onization needs without requiring middleware or third-party software.
This email was sent to you from Hornetlabs Technology Inc. It was delivered= on their behalf by the PostgreSQL project. Any questions about the content of the message shou= ld be sent to Hornetlabs Technology Inc.

You were sent this email as a subscriber of the pgsql-announce mai= linglist, for the content tag Related Open Source. To unsubscribe from further emails, or change which emails you want to receive, please click th= e personal unsubscribe link that you can find in the headers of this email, or visit https://lists.postgresql.org/unsubscribe/.
 
--===============5198399806153745670==-- --===============3716136427656767762==--