[Solved-1 Solution] Where to see the mapreduce code generated from hadoop pig statements ?



What is mapreduce ?

  • MapReduce is a core component of the Apache Hadoop software framework.
  • MapReduce serves two essential functions: It parcels out work to various nodes within the cluster or map, and it organizes and reduces the results from each node into a unified answer to a query.

Problem :

We all know that the Hadoop pig statements are converted into java mapreduce code. Is there is any way to see the mapreduce code generated from pig statements ?

Solution 1:

We all know that hadoop pig statements are converted into java mapreduce code

  • This is not the case. Hadoop Pig statements are not translated into Java MapReduce code.
  • A better way of thinking about it is Pig code is "interpreted" in an Pig interpreter that runs in Java MapReduce.

We can also plan for this way:

  • Python and Perl do not "generate" C code, they run through a C program (interpreter) that executes the instructions. Basically, Pig provides a framework for a query plan to be executed.
  • The Pig code gets interpreted and a prebuilt interpreter MapReduce job executes it. For this reason, this is impossible to do.

Related Searches to Where to see the mapreduce code generated from hadoop pig statements