Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kafka changefeed don't work even cdc max-message-bytes less then broker topic's #3081

Closed
Tammyxia opened this issue Oct 19, 2021 · 0 comments · Fixed by #3080
Closed

kafka changefeed don't work even cdc max-message-bytes less then broker topic's #3081

Tammyxia opened this issue Oct 19, 2021 · 0 comments · Fixed by #3080
Labels
area/ticdc Issues or PRs related to TiCDC. severity/critical type/bug The issue is confirmed as a bug.

Comments

@Tammyxia
Copy link

What did you do?

  • tidb cluster + capture each has one node which all deployed in a physical server.
  • Deploy a broker, then create a topic: bin/kafka-topics.sh --create --topic cdc-events --bootstrap-server 172.16.6.24:9092 --replication-factor 1 --partitions 6
  • Check this topic parameters: message.max.bytes = 1000012, max.message.bytes -> 1000012, replica.fetch.max.bytes = 1048576, replica.fetch.max.bytes = 1048576, socket.request.max.bytes = 104857600
  • Create a changefeed: tiup ctl:v5.2.1 cdc changefeed create --pd=http://172.16.4.158:2379 --sink-uri='kafka://172.16.6.24:9092/cdc-events?partition-num=6&max-message-bytes=900000' --changefeed-id="kafka-task-1"
  • Create one more changefeed: tiup ctl:v5.2.1 cdc changefeed create --pd=http://172.16.4.158:2379 --sink-uri='kafka://172.16.6.24:9092/cdc-events?partition-num=6&max-message-bytes=10000' --changefeed-id="kafka-task-2"
  • Run sysbench workload: sysbench oltp_insert run --db-driver=mysql --mysql-host=172.16.4.158 --mysql-port=4000 --mysql-user=root --mysql-password= --mysql-db=test --threads=20 --tables=10 --time=360000 --report-interval=10

What did you expect to see?

The two changefeeds work normally.

What did you see instead?

  • Both changefeeds failed to sync any data.

image

  • Using cdc to create a kafka topic test-events, also has error "Message too large": tiup ctl:v5.2.1 cdc changefeed create --pd=http://172.16.4.158:2379 --sink-uri='kafka://172.16.6.24:9092/test-events?' --changefeed-id="kafka-task-3"

Versions of the cluster

Upstream TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):

v5.2.1

TiCDC version (execute cdc version):

Release Version: v5.2.1-20211014
Git Commit Hash: f1dd56ab5861fc52ab30d8af7a44037ba58277eb
Git Branch: heads/refs/tags/v5.2.1-20211014
UTC Build Time: 2021-10-14 13:51:49
Go Version: go version go1.16.4 linux/amd64
Failpoint Build: false```
@Tammyxia Tammyxia added the type/bug The issue is confirmed as a bug. label Oct 19, 2021
@Tammyxia Tammyxia changed the title kafka changefeed don't work even kafka changefeed don't work even cdc max-message-bytes less then broker topic's Oct 19, 2021
@AkiraXie AkiraXie added the area/ticdc Issues or PRs related to TiCDC. label Mar 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ticdc Issues or PRs related to TiCDC. severity/critical type/bug The issue is confirmed as a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants