what is pig in hadoop - Wikitechy https://www.wikitechy.com/interview-questions/tag/what-is-pig-in-hadoop/ Interview Questions Tue, 14 Sep 2021 11:23:16 +0000 en-US hourly 1 https://wordpress.org/?v=6.9.4 https://www.wikitechy.com/interview-questions/wp-content/uploads/2025/10/cropped-wikitechy-icon-32x32.png what is pig in hadoop - Wikitechy https://www.wikitechy.com/interview-questions/tag/what-is-pig-in-hadoop/ 32 32 What is hive ? https://www.wikitechy.com/interview-questions/hive/what-is-hive/ https://www.wikitechy.com/interview-questions/hive/what-is-hive/#respond Tue, 13 Jul 2021 21:09:15 +0000 https://www.wikitechy.com/interview-questions/?p=548

Hive

  • Hive is a component of Hortonworks Data Platform(HDP).
  • Hive provides a SQL interface to data stored in HDP.
  • Hive has 3 main functions:
    • Data Summarization
    • Query
    • Analysis.
  • It supports queries expressed language called HiveQL, which automatically translates SQL like queries into MapReduce jobs executed on Hadoop.
  • It also enables data serialization and increases flexibility in schema architecture including a system catalog called Hive Metastore.

Architecture of hive :

what is hive

Features of hive:

  • Different storage such as plain text, RCFile, ORC, HBase, and others.
  • Pre-defined functions (UDFs) to manipulate dates, strings, and other data-mining tools.
  • Hive supports extending the UDF set to handle use-cases not supported by built-in functions.

Limitations of Hive:

  • Hive supports overwriting or hold data, but not updates and deletes.
  • In Hive, sub queries are not supported
]]> https://www.wikitechy.com/interview-questions/hive/what-is-hive/feed/ 0 What is the difference between Pig and Hive ? https://www.wikitechy.com/interview-questions/apache-pig/what-is-the-difference-between-pig-and-hive/ https://www.wikitechy.com/interview-questions/apache-pig/what-is-the-difference-between-pig-and-hive/#respond Mon, 12 Jul 2021 08:22:29 +0000 https://www.wikitechy.com/interview-questions/?p=205

Difference between pig and Hive

Pig Hive
Pig Hadoop Component is generally
used by Researchers and Programmers.		 Hive Hadoop Component is mainly used by data analysts.
Pig Hadoop Component is used
for semi structured data.		 Hive Hadoop Component is used for completely structured Data.
Pig Hadoop Component has a procedural data
flow language (Pig Latin).		 Hive Hadoop Component has a declarative Structured Query Language (HiveQL).
Pig can’t start reliance based server. Hive can start reliance based server,send queries from any nook and corner directly to the Hive
server which will execute them.
Pig is also SQL like but it varies from great extent
and it will take some time efforts to master Pig.		 Hive directly borrowed SQL expertise it learnt easily.
Avro supported for Pig. Avro does not support for Hive.
Pig Hadoop Component operates on
the client side of any group.		 Hive Hadoop Component operates on the server side of any group.
Pig Hadoop Component is highly
used for programming.		 Hive Hadoop Component is mainly used for generating reports.
Pig Hadoop is a great ETL tool for
big data because of its powerful
transformation and processing capabilities.		 Hive Hadoop Component is helpful for ETL(Extract, Transform and Load).
In Pig there is no dedicated metadata database
and the schemas or data types will
be defined in the script itself.		 Hive makes use of exact variation of the SQL DLL language by defining the tables beforehand and
storing the schema details in any local database.
Pig Hadoop component does not have
any notion for partitions though might
be one can achieve this through filters.		 The Hive Hadoop component has a provision for
partitions so that you can process the subset
of data by date or in an alphabetical order.
Pig Hadoop Component renders users with sample
data for each scenario and each step through
its “Illustrate” function.		 This feature is not incorporated with the
Hive Hadoop Component.
]]> https://www.wikitechy.com/interview-questions/apache-pig/what-is-the-difference-between-pig-and-hive/feed/ 0