public inbox for [email protected]  

help / color / mirror / Atom feed

From: Durgamahesh Manne <[email protected]>
To: [email protected]
To: [email protected]
To: Greg Sabino Mullane <[email protected]>
To: [email protected] <[email protected]>
Subject: Recommendations on Improving the debezium performance even on medium workload
Date: Fri, 13 Sep 2024 01:21:55 +0530
Message-ID: <CAJCZkoKbfzFSfTemPiZN-mBrgy7ob=9gFq-5BnNEbHsH3Fe-dA@mail.gmail.com> (raw)

Hi Team

How do we improve the debezium performance?
Recommendations at kafka configuration side
Agenda is to minimize the lag during moderate or high work load on db

default > poll.interval.ms = 500ms
Recommended value for balanced performance > 1000ms
Recommended value for high throughput > 1000ms to 5000ms





default > max.batch.size = 2048 allocated > 2560
Recommended value for balanced performance > 500 to 1000
Recommended value for high throughput > 2000 or 5000



default > max.queue.size = 8192 allocated > 10000
Recommended value for balanced performance > 7500 (1000 to 10000)
Recommended value for high throughput > 10000

based on kafka load we can optimize debezium connector performance



default > heartbeat.interval.ms = 0 allocated > 5000ms
Recommended value for this > 5000ms to 10000ms


Are these helpful  ?

Need auto connectivity even on connector(slot) failure

please let me know your recommendations please


Regards,

Durga Mahesh

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected], [email protected], [email protected]
  Subject: Re: Recommendations on Improving the debezium performance even on medium workload
  In-Reply-To: <CAJCZkoKbfzFSfTemPiZN-mBrgy7ob=9gFq-5BnNEbHsH3Fe-dA@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox