Stack Overflow
Stack Overflow

Questions tagged [change-data-capture]

Change data capture (CDC) encompasses database design patterns to keep track of changed data and perform actions with it.

In databases, change data capture (CDC) is a set of software design patterns used to determine (and track) the data that has changed so that action can be taken using the changed data. Also, Change data capture (CDC) is an approach to data integration that is based on the identification, capture and delivery of the changes made to enterprise data sources.

CDC solutions occur most often in data-warehouse environments since capturing and preserving the state of data across time is one of the core functions of a data warehouse, but CDC can be utilized in any database or data repository system.

271 questions
21
votes
2 answers

Could not update the metadata that indicates database X is enabled for Change Data Capture. The error returned was 15517

I use SQL Server 2008 and AdventureWorkDB. I want enable Change Data Capture in my database. I execute this command : USE [AdventureWorksDB]; GO EXEC sys.sp_cdc_enable_db ; But i get this error : Could not update the metadata that indicates…
Ardalan Shahgholi
  • 11,967
  • 21
  • 108
  • 144
18
votes
3 answers

How the cdc retention value can be changed for the cleanup job?

I'm implementing a logging feature on a asp.net mvc2 application, that uses SqlServer2008 as a database and Entity Framework as a data model. I enabled CDC feature of SqlServer and it's logging changes well, but I just noticed that some of the old…
Eedoh
  • 5,818
  • 9
  • 38
  • 62
13
votes
1 answer

Is Change Data Capture Performance Loss Restricted to CDC Enabled Tables?

I have read that enabling Change Data Capture obviously has an impact on database performance. Would this performance loss only effect the tables that have CDC enabled or would it effect all actions across the database In my situation I am using…
Mark
  • 1,509
  • 1
  • 15
  • 28
12
votes
2 answers

What is the difference between Oracle Streams and Change Data Capture?

There are several similar Oracle technologies - Oracle Streams, Oracle Change Data Capture and Database Change Notification. What are the differences between these? Are they related to Oracle Advanced Queueing?
Petr Sturc
11
votes
2 answers

Why we require temporal table in SQL Server 2016 as we have CDC or CT?

What advantages do Temporal Tables have over Change Data Capture or Change Tracking in SQL Server?
Kannan Kandasamy
  • 13,405
  • 3
  • 25
  • 38
11
votes
1 answer

Change Data Capture or Change Tracking - Same as Traditional Audit Trail Table?

Before I delve into the abyss of Microsoft documentation any deeper, I'd like to know if someone experienced with Change Data Capture and Change Tracking know if one or both of these can be used to replace the traditional ... "Audit trail table…
HardCode
  • 6,497
  • 4
  • 31
  • 54
10
votes
5 answers

How to create Triggers to add the change events into Audit Log tables

Suppose we have 50 tables in a database and we want to capture all the changes (Previous value and new value of columns) across the columns of each table. An audit table will be there, which will have below columns: ID, Server_Name, User_Name,…
user2160151
  • 103
  • 1
  • 1
  • 4
10
votes
3 answers

How do I reconstruct a historical view?

I am currently exploring Change Data Capture as an option to store temporal databases. It is great because it stores only the deltas and seems like it may solve my problem. When I enabled CDC, a bunch of tables appeared under System Tables. When…
Legend
  • 113,822
  • 119
  • 272
  • 400
9
votes
1 answer

CDC is enabled, but cdc.dbo_CT table is not being populated

I have enabled CDC using the following steps: exec sys.sp_cdc_enable_db; exec sys.sp_cdc_enable_table @source_schema = N'dbo', @source_name = N'table_name', @role_name = N'CDC_Access', @supports_net_changes = 1; I can see that a CT table has been…
FooBar
  • 384
  • 2
  • 4
  • 14
8
votes
1 answer

CDC table not working after adding new columns to the source table

Two new columns were added to our source table while CDC was still enabled on the table. I need the new columns to appear in the CDC table but do not know what procedure should be followed to do this? I have already disabled CDC on the table,…
knightscharge
  • 382
  • 2
  • 6
  • 14
7
votes
0 answers

Debezium postgres incremental snapshot performance issues

I am trying to use debezium incremental snapshots in the latest debezium (1.7) and postgres (V13). For testing, I populated a table with 1M rows, each row is 4KB with a UUID primary key and 20 varchar columns. Since I just wanted to measure snapshot…
sha
  • 614
  • 6
  • 16
7
votes
1 answer

Change-data-capture from Postgres SQL to kafka topics using standalone mode Kafka-connect

I have been trying to get data from postgres sql to kafka topics using the following command /bin connect-standalone.properties config/connect-standalone.properties postgres.sproperties, but am facing several issues with it here are the contents of…
Snehil Singh
  • 207
  • 3
  • 10
5
votes
1 answer

Oracle change-data-capture with Kafka best practices

I'm working on a project where we need to stream real-time updates from Oracle to a bunch of systems (Cassandra, Hadoop, real-time processing, etc). We are planing to use Golden Gate to capture the changes from Oracle, write them to Kafka, and then…
EugeneMi
  • 3,475
  • 3
  • 38
  • 57
5
votes
5 answers

SQL Server 2012 Change Data Capture Error 14234

I am having problems setting up change data capture on a SQL Server 2012 instance. Whenever I attempt to enable CDC on a table I get the following error: Msg 22832, Level 16, State 1, Procedure sp_cdc_enable_table_internal, Line 623 Could not…
Crove Shadowhirn
  • 61
  • 1
  • 4
5
votes
2 answers

Compare and Contrast Change Data Capture and Database Change Notification

Oracle has two seemingly competing technologies. CDC and DCN. What are the strengths of each? When would you use one and not the other?
Mark Brady
1
2 3
…
18 19