Skip to content
Open
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
87 changes: 46 additions & 41 deletions roadmap.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -24,51 +24,52 @@ As our engineering capacity is limited, we're focusing our efforts on a single r
i.e. patch releases for the current stable minor release (e.g. 1.2.1.Final) are done in case of critical bug fixes only.
====

== 3.1 - March 2025

* Oracle 12c support sunset (best-effort moving forward)
* Completed implementation and refactoring of MongoDB sink connector
* Message vectorization support (via SMT)
* Sink for InstructLab
* Sink for vector databases (TBD)
* Condition-based lifecycle control of Debezium Engine
* Revamped ExtractNewDocument state SMT to handle complex nested documents and arrays
* Support Transformations in Debezium Platform (UI)
* Support signaling in Debezium Platform (UI)
* Make storage configurable at deploy time in Debezium Platform (UI)
* Design Debezium component descriptors / registry

== 3.2 - June 2025

* OpenLineage integration
* Debezium Server support for Debezium sink (MongoDB and JDBC) connectors
* Debezium Engine Quarkus integration
* Read-only incremental snapshot for MongoDB
* WebAssembly support in scripting transformations
* Support for two stage processing architecture in Oracle connector
* Design/Implement user-friendly offset manipulation (i.e, start at a specific position in the transaction logs)
* Design/Implement Debezium component descriptors / registry

== 3.3 - September 2025

* Create PoC for implementing sagas (long-running business transactions spanning multiple (micro-)services) using CDC and the outbox pattern
* Explore and provide building blocks for implementing CQRS architectures based on change data streams
* Exactly-Once support for other connectors
* Additional monitoring - Quantimeter
* Make storage configurable at runtime in Debezium Platform (UI)

== 3.4 - December 2025

* Read-only incremental snapshot for SQL Server and Oracle
* Add schema history compaction tool
* Support vaults in Debezium Platform (UI)
* Design upgradability of already configured resources in Debezium Platform (UI)
== 3.5: January - March 2026

* [Core] Cross-connector SPI for message / transaction buffers
* [Core] Snapshotting single tables using multiple threads for higher throughput
* [Oracle] Move LogMiner reader to a dedicated thread apart from event processing loop thread
* [Debezium Server] Cloud storage sicks
* [Debezium Server] PoC to support clustering
* [Debezium Server] Source connector for Milvus
* [Debezium Server] Source connector for Qdrant
* [Quarkus Extension] Advanced filtering support
* [Quarkus Extension] Support for Oracle 19c+
* [Platform] Integrate documentation for better user experience

== 3.6: April - June 2026

* [Core] Micrometer monitoring using OpenTelemetry
* [Core] Remove dependency on Kafka Connect APIs
* [Debezium Server] CLI support
* [Quarkus Extension] CLI support
* [Platform] Component descriptors/registry
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will be mainly in Q1 and eventually will continue in half Q2

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll put it in Q1, and if it slips or there are portions left for Q2, we can bump the specifics in the roadmap just before Q2 to provide more context if needed. Does that work for you?

* [Platform] Offset management
* [Platform] Guided workflow for modify table include lists
* [Testing] Framework to fully test Platform (functional and visual components)

== 3.7: July - September 2026

* [Core] Alternative persistent stores for `ReselectPostProcessor`
* [Connectors] A new source connector for a graph database (TBD)
* [Connectors] Maven archetype for Debezium connector development
* [Oracle] Capture changes from multiple Pluggable Databases using a single deployment
* [Debezium Server] First-class support for Iceberg sink
* [Platform] Incremental snapshot progress notifications
* [Platform] Dispatch K8 events hen deployed using Kubernetes operator
* [AI] New PyDebeziumAI

== 3.8: October - December 2026

* [Connectors] New ElasticSearch sink (Kafka and Debezium Server)
* [Connectors] New SQLite source connector
* [Platform] Vault support to securely store credentials and other sensitive data

== Future Releases

* Source connector for InfluxDB time series database
* Introduce an SPI to reduce memory footprint for multi-tenant databases with identical schemas

* Design/Implement user-friendly offset manipulation (i.e, start at a specific position in the transaction logs)
* Provide a Debezium-specific SPI for describing change event schemas
* API/SPI allowing to implement custom connectors on the foundations of Debezium
* Exploration of creating aggregated events, based on the streams/data from multiple tables, so to enable use cases which need to incorporate data from multiple tables into a single output structure (e.g. an Elasticsearch document containing order and orderline info)
Expand All @@ -77,11 +78,15 @@ i.e. patch releases for the current stable minor release (e.g. 1.2.1.Final) are
* Provide more detailed monitoring information about Debezium's internal state and health via JMX (e.g. to spot loss of DB connection while the connector still is running)
* Explore publication of change events via reactive data streams (on top of embedded connector)
* New implementation of the Debezium embedded engine independent of Kafka Connect APIs
* Read-only incremental snapshot for SQL Server and Oracle
* Create PoC for implementing sagas (long-running business transactions spanning multiple (micro-)services) using CDC and the outbox pattern
* Explore and provide building blocks for implementing CQRS architectures based on change data streams
* Add schema history compaction tool
* Debezium UI (Legacy) - New CLI tooling
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Haven't we archived the repo? Those this still make sense?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ya I think that was just left over from what was there previously, great catch. I removed it.

** Incremental Snapshot interface
** Quick-start connector deployment
** Support varied Kafka Connect and Debezium versions
** Offset manipulation
** Make storage configurable at runtime
* Debezium Operator
** Improved Observability and Metrics
** R&D to consider multitasking support with Debezium Server
Expand Down