Debezium to stream data from Oracle to MariaDB Posted on February 20, 2026 , Modified on October 12, 2026 , by Yannick JaquierTable of contents Preamble Apache Kafka installation Apache Kafka Connect configuration Debezium Connector for Oracle configuration Debezium connector for JDBC configuration UI for Apache Kafka Issues encountered Failed to process record: Failed to resolve column type for schema: STRUCT io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery. References Read more Databricks, Linux, MariaDB, Oracle Kafka 1 comment
Spark Structured Streaming for incremental ingestion flows Posted on January 20, 2024 , Modified on January 19, 2024 , by Yannick JaquierTable of contents Preamble Spark Structured Streaming first test case Spark Structured Streaming second test case Spark Structured Streaming third test case to prepare further ingestion References Read more Databricks Development Leave a comment
Change Data Feed to track changes at row level Posted on December 20, 2023 , Modified on August 25, 2025 , by Yannick JaquierTable of contents Preamble Change Data Feed testing Change Data Feed testing with Spark Structured Streaming References Read more Databricks Development Leave a comment
Auto loader to process flow of raw files hands-on Posted on November 30, 2023 , Modified on January 19, 2024 , by Yannick JaquierTable of contents Preamble Auto Loader test case Auto Loader testing References Read more Databricks Development Leave a comment
dbx for local and rapid development lifecycle through Databricks Posted on July 10, 2023 , Modified on October 12, 2026 , by Yannick JaquierTable of contents Preamble Not able to access DBFS files under Databricks Connect Creation of the DBR 12.2 Conda environment DBX installation and configuration Databricks CLI installation Databricks CLI profile configuration DBX installation DBX configuration DBX execution Resolve unicode error and add icons to Git Bash DBX execution of a more complex example Synchronize your local code with Databricks References Read more Databricks Development Leave a comment
Data skipping and row group skipping in action with delta tables Posted on June 1, 2023 , Modified on June 5, 2026 , by Yannick JaquierTable of contents Preamble Data skipping test case Data skipping and row chunk skipping testing References Read more Databricks Tuning Leave a comment