Flink CDC for database replication to big data Posted on September 30, 2026 , Modified on October 23, 2026 , by Yannick JaquierTable of contents Preamble Iceberg installation in Spark Flink installation Flink CDC installation PostgreSQL source database configuration Iceberg sink configuration MariaDB source database configuration Oracle source database configuration Issues encountered Connection refused /tmp in noexec REST/Web UI upload handler still in /tmp References Read more Hadoop, MariaDB, MySQL, Oracle, PostgreSQL Development Leave a comment
Automate your cluster with Ambari API and Ambari Metrics System Posted on March 26, 2021 , Modified on March 26, 2021 , by Yannick JaquierTable of contents Preamble Ambari Metrics System (AMS) Ambari API List services and components Status of services and components Stop services and components Start services and components Conclusion References Read more Hadoop Ambari 2 comments
Hiveserver2 monitoring with Jconsole and Grafana in HDP 3.x Posted on November 22, 2020 , Modified on November 16, 2020 , by Yannick JaquierTable of contents Preamble Hiveserver2 monitoring with Jconsole Hiveserver2 monitoring with Grafana References Read more Hadoop Tuning Leave a comment
Spark dynamic allocation how to configure and use it Posted on October 22, 2020 , Modified on June 5, 2026 , by Yannick JaquierTable of contents Preamble Spark dynamic allocation setup Spark dynamic allocation testing References Read more Hadoop Tuning Leave a comment
INSERT OVERWRITE does not delete old directories Posted on September 22, 2020 , Modified on July 1, 2025 , by Yannick JaquierTable of contents Preamble INSERT OVERWRITE test case INSERT OVERWRITE does not delete old directories References Read more Hadoop Bug Leave a comment
Spark lineage issue and how to handle it with Hive Warehouse Connector Posted on August 23, 2020 , Modified on July 7, 2026 , by Yannick JaquierTable of contents Preamble Test case and problem Spark lineage solution Spark lineage second problem and partial solution References Read more Hadoop Spark Leave a comment