How WebHCat Works and How to Debug (Part 2)

Link to Part 1 2. How to debug WebHCat 2.1. BadGateway (HTTP status code 502) This is a very generic message from Gateway nodes. We will cover some common cases and possible mitigations. This is the most common Templeton problems customer are seeing right now. 2.1.1. WebHcat service down This happens in-case WebHCat server on…

2

How WebHCat Works and How to Debug (Part 1)

1. Overview and Goals One of the common scenarios our customers facing are: why my Hive, Pig, or Scoop job submissions are failing? Most likely something is wrong with your WebHCat service. In this article, we will try to answer some of the common questions like: What is WebHCat or sometimes referred to also as…

0

Spark Debugging on HDInsight 101

Apache Spark is an open source processing framework that runs large-scale data analytics applications. Built on an in-memory compute engine, Spark enables high performance querying on big data. It leverages a parallel data processing framework that persists data in-memory and disk if needed.  This article details common ways of submitting spark applications on our HDInsight…


Troubleshooting YARN/MR issues on HDInsight clusters

HDInsight Hadoop clusters beginning with version 3.x are shipped with YARN , the next version of Hadoop MapReduce framework. YARN is a generic resource arbitration framework that acts as the computational layer for your distributed applications. To read more about YARN, please refer to Hadoop Apache documentation Customers sometimes face issues while running either plain…