Stack Overflow
Stack Overflow

Questions tagged [debezium-server]

20 questions
2
votes
1 answer

Debezium server docker cannot access AWS credentials

My goal is to use Debezium for real-time CDC from MongoDB to AWS Kinesis. I am using the official Debezium server 1.8 docker image. I'm able to run the image locally and I've configured the settings via environment variables that I am passing into…
Jonathan Porter
  • 1,365
  • 7
  • 34
  • 62
1
vote
0 answers

Debezium Server MongoDB connector Enabling the Signalling doesn't work

I run the Debezium Server with source MongoDB and sink Kinesis on k8s. After enabling the signalling by setting DEBEZIUM_SOURCE_SIGNAL_DATA_COLLECTION="test.debezium_signaling" DEBEZIUM_SOURCE_COLLECTION_INCLUDE_LIST: "
taraf
  • 777
  • 2
  • 10
  • 28
0
votes
1 answer

java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: java.nio.file.NoSuchFileException: \tmp\connect.offsets

I am running kafka and debezium PostgreSQL connector locally on Windows. everything else is good, topics are also stored. just getting this error: java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException:…
Sidhant Suvagiya
  • 35
  • 7
0
votes
0 answers

Debezium Server only logging schema changes and not logging data changes

I am currently trying to standup debezium server to track data changes in a MySQL database. I have successfully set up the debezium-server project in Ubuntu and successfully connected it to my database. It is able to notice the when I make changes…
Kaleb7168
  • 1
0
votes
0 answers

The config property debezium.sink.type is required but it could not be found in any config source

I am trying to build this architecture where: (the source: AWS RDS Postgres) + (Debezium Server) + (Kinesis Firehose) my database is running and the kinesis firehose is also there and running and I have configured both of them. I have also put the…
matt 1990
  • 1
  • 1
0
votes
0 answers

debezium-ui cannot connect to the debezium-connect-cluster-connect-api service

Hello I recently deployed debezium-ui on Kubernetes cluster, but I can't access "debezium-connect-cluster-connect-api" service due to network policy. How can I modify or delete the network policy service in kafkaconnect? List of services: enter…
Iman Namjooyan
  • 1
  • 3
0
votes
0 answers

On Debezium startup, initial snapshot excludes existing triggers, functions and other object types

I created a database called dictionary as my master DB which has 2 tables(state and employees). In addition to the tables, I also added few functions, triggers, stored procedures, indexes. I am hoping to replicate everything to a slave. On debezium…
arsenics
  • 13
  • 1
  • 6
0
votes
1 answer

Track a particular table using Debezium

I am using Debezium embedded oracle connector for spring to track changes in my tables. Is there a property/way to track a particular table from a schema. My schema has a lot of tables and I do not want to track all of them for changes. I have added…
Pranav Gaba
  • 1
  • 1
0
votes
0 answers

debezium mysql 2.1.2 data latency is stable at 1 minute

When I use debezium mysql 2.1.2, by observing the message timestamp in kafka and comparing it with the writing time of the data in the database, I found that the change will be sent to kafka after 1 minute after the data in the database is written.…
pedoc
  • 1
  • 1
0
votes
0 answers

Pass headers in Debezium http sink

I am using http sink as in doc. I need to pass headers to http sink url, is there a way to do that? TIA
Yogen Rai
  • 2,961
  • 3
  • 25
  • 37
0
votes
0 answers

debezium 2.0 connector sqlserver issue in mBean, JmxAttributeGauge

In older versions of Debezium using SQL Server as an example, metrics were available using the following naming strategy: debezium.sql_server:type=connector-metrics,server=,context= In new release debezium 2.0, the…
Govind Yadav
  • 33
  • 4
0
votes
0 answers

Debezium server fffset file storage claim or cleanup

So, for non-kafka deployment, we specify offset storage file with debezium.source.offset.storage.file.filename as per documentation, how does the storage is reclaimed or cleanup happens? I am planning to have k8s deployment with mounted volume…
Yogen Rai
  • 2,961
  • 3
  • 25
  • 37
0
votes
1 answer

Debezium 2.0 confluent AvroConverter is not working

Since debezium 2.0 has decided to remove the io.confluent.connect.avro.AvroConverter I tried to inject it directly but it keep giving me following error: Here is my simplified deployment: apiVersion: apps/v1 kind: Deployment metadata: name:…
Jonathan Chevalier
  • 993
  • 1
  • 9
  • 18
0
votes
0 answers

Debezium Server source connector for GCP cloud SQL Server without Kafka

I am trying to use Debezium server (Standalone without Kafka) to load data (incremental) from GCP Cloud SQL Server to PubSub and then BigQuery. I am running a test on my laptop to see if that's doable. I set up debezium server on docker this is my…
Ariox66
  • 620
  • 2
  • 9
  • 29
0
votes
0 answers

Debezium sql connector status api is not showing exception

we are trying to upgrade debezium-connector-sqlserver-1.0.0. to debezium-connector-sqlserver-1.9.5..After upgrade ,the debezium connector status api always shows running status ,even if connector has exception.the server has adopt open jdk…
Shala
  • 31
  • 4
1
2