How to install and configure a standalone TEZ UI with HDP 3.x Posted on July 22, 2020, updated on September 15, 2020 by Yannick Jaquier Table of contents Preamble TEZ UI installation TEZ UI configuration TEZ UI bug correction trick References Continue reading
PySpark and Spark Scala Jupyter kernels cluster integration Posted on June 21, 2020, updated on June 9, 2020 by Yannick Jaquier Table of contents Preamble JupyterHub installation Jupyter kernels manual configuration Sparkmagic Jupyter kernels configuration References Continue reading
Hive Warehouse Connector integration in Zeppelin Notebook Posted on May 21, 2020, updated on May 18, 2020 by Yannick Jaquier Table of contents Preamble HWC on the command line Zeppelin Spark2 interpreter configuration Zeppelin Livy2 interpreter configuration References Continue reading
How to use Livy server to submit Spark job through a REST interface Posted on February 24, 2020, updated on February 19, 2020 by Yannick Jaquier Table of contents Preamble Configuration Curl testing HTTP ERROR: 400 Python testing References Continue reading
Hive concatenate command issues and workaround Posted on January 24, 2020, updated on January 20, 2020 by Yannick Jaquier Table of contents Preamble Concatenate command failing for access right HDFS default access right with Hive and Spark To go further Worked well till... References Continue reading
How to handle HDFS blocks with corrupted replicas or under replicated Posted on December 25, 2019, updated on December 20, 2019 by Yannick Jaquier Table of contents Preamble Managing under replicated blocks Managing blocks with corrupted replicas References Continue reading