Hive fetch task really improving response time by bypassing MapReduce ? Posted on November 24, 2019, updated on February 28, 2020 by Yannick Jaquier Table of contents Preamble Identical queries not same response time Partitions statistics and concatenation Fetch task performing worst than MapReduce ? To go further References Continue reading
Fetch Zookeeper information from Python with Kazoo to connect Hive Posted on October 25, 2019, updated on October 22, 2019 by Yannick Jaquier Table of contents Preamble Kazoo development environment installation Python source code Kazoo testing References Continue reading
Hadoop backup: what parts to backup and how to do it ? Posted on September 27, 2019, updated on October 28, 2019 by Yannick Jaquier Table of contents Preamble Mandatory parts to backup Configuration files Ambari server meta info NameNode metadata Ambari repository database Backup with Point In Time Recovery (PITR) capability Backup with no PITR capability Hive repository database Backup with Point In Time Recovery (PITR) capability Backup with no PITR capability Not mandatory parts to backup JournalNodes Parts nice to backup HDFS References Continue reading
HDFS capacity planning computation and analysis Posted on August 30, 2019, updated on August 27, 2019 by Yannick Jaquier Table of contents Preamble HDFS capacity planning first estimation HDFS snapshot situation After delete of HDFS snapshot References Continue reading
ORC versus Parquet compression and response time Posted on August 2, 2019, updated on February 20, 2020 by Yannick Jaquier Table of contents Preamble ORC versus Parquet compression ORC versus Parquet response time References Continue reading
HDFS balancer options to speed up balance operations Posted on July 5, 2019, updated on November 27, 2019 by Yannick Jaquier Table of contents Preamble HDFS Balancer References Continue reading