<br />
<b>Warning</b>:  Undefined array key "global_protection_id" in <b>/home/wikitechy/public_html/interview-questions/wp-content/plugins/content-protector/inc/class-ps-rest-handler.php</b> on line <b>51</b><br />
{"id":281,"date":"2021-07-12T18:01:53","date_gmt":"2021-07-12T18:01:53","guid":{"rendered":"https:\/\/www.wikitechy.com\/interview-questions\/?p=281"},"modified":"2021-09-14T07:13:13","modified_gmt":"2021-09-14T07:13:13","slug":"what-are-the-core-components-of-hadoop","status":"publish","type":"post","link":"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/","title":{"rendered":"What are the core components of Hadoop ?"},"content":{"rendered":"<div class=\"TextHeading\">\n<div class=\"hddn\">\n<h2 id=\"what-are-the-core-components-of-hadoop\" class=\"color-pink\" style=\"text-align: justify;\">What are the core components of Hadoop ?<\/h2>\n<\/div>\n<\/div>\n<div class=\"Content\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<ul>\n<li>Hadoop is an open source framework that is meant for storage and processing of big data in a distributed manner.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"ImageContent\" style=\"text-align: justify;\">\n<div class=\"hddn\"><img decoding=\"async\" class=\"img-responsive center-block aligncenter\" src=\"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/what-are-the-core-components-of-hadoop.png\" alt=\"What are the core components of Hadoop\" \/><\/div>\n<\/div>\n<div class=\"TextHeading\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<h2 id=\"hdfs-hadoop-distributed-file-system\" class=\"color-purple\">HDFS (Hadoop Distributed File System)<\/h2>\n<\/div>\n<\/div>\n<div class=\"Content\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<ul>\n<li><a href=\"https:\/\/www.wikitechy.com\/interview-questions\/hadoop\/what-are-the-components-of-hdfs-and-yarn\" target=\"_blank\" rel=\"noopener\">HDFS<\/a>\u00a0is the basic storage system of Hadoop.<\/li>\n<li>The large data files running on a cluster of commodity hardware are stored in HDFS.<\/li>\n<li>It can store data in a reliable manner even when hardware fails.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"ImageContent\" style=\"text-align: justify;\">\n<div class=\"hddn\"><img decoding=\"async\" class=\"img-responsive center-block aligncenter\" src=\"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/hdfs.png\" alt=\"HDFS (Hadoop Distributed File System)\" \/><\/div>\n<\/div>\n<div class=\"TextHeading\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<h2 id=\"core-components-of-hadoop\" class=\"color-orange\">Core Components of Hadoop<\/h2>\n<\/div>\n<\/div>\n<div class=\"Content\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<ul>\n<li>Hadoop MapReduce<\/li>\n<li>YARN<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"TextHeading\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<h2 id=\"hadoop-mapreduce\" class=\"color-green\">Hadoop MapReduce<\/h2>\n<\/div>\n<\/div>\n<div class=\"Content\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<ul>\n<li><a href=\"https:\/\/www.wikitechy.com\/tutorials\/hive\/hive-mapreduce-hadoop-mapreduce\" target=\"_blank\" rel=\"noopener\">MapReduce<\/a>\u00a0is the Hadoop layer that is responsible for data processing. It writes an application to process unstructured and structured data stored in HDFS.<\/li>\n<li>It is responsible for the parallel processing of high volume of data by dividing data into independent tasks.<\/li>\n<li>The processing is done in two phases Map and Reduce.<\/li>\n<li>The Map is the first phase of processing that specifies complex logic code and the Reduce is the second phase of processing that specifies light-weight operations.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"ImageContent\" style=\"text-align: justify;\">\n<div class=\"hddn\"><img decoding=\"async\" class=\"img-responsive center-block aligncenter\" src=\"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/hadoop-mapreduce.gif\" alt=\" Hadoop MapReduce\" \/><\/div>\n<\/div>\n<div class=\"TextHeading\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<h2 id=\"yarn\" class=\"color-green\">YARN<\/h2>\n<\/div>\n<\/div>\n<div class=\"Content\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<ul>\n<li>The processing framework in Hadoop is\u00a0<a href=\"https:\/\/forums.wikitechy.com\/question\/how-to-prevent-spark-executors-from-getting-lost-when-using-yarn-client-mode\/\" target=\"_blank\" rel=\"noopener\">YARN<\/a>.<\/li>\n<li>It is used for resource management and provides multiple data processing engines i.e. data science, real-time streaming, and batch processing.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"ImageContent\">\n<div class=\"hddn\"><img decoding=\"async\" class=\"img-responsive center-block aligncenter\" src=\"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/yarn.jpg\" alt=\" YARN\" \/><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Answer : Hadoop is an open source framework that is meant&#8230;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"passster_activate_protection":false,"passster_protect_child_pages":"","passster_protection_type":"password","passster_password":"","passster_activate_overwrite_defaults":"","passster_headline":"","passster_instruction":"","passster_placeholder":"","passster_button":"","passster_id":"","passster_activate_misc_settings":"","passster_redirect_url":"","passster_hide":"no","passster_area_shortcode":"","gtb_hide_title":false,"gtb_wrap_title":false,"gtb_class_title":"","gtb_remove_headerfooter":false,"footnotes":""},"categories":[1065],"tags":[195,1150,1363,1373,1119,360,1362,1100,1141,1145,203,199,214,1120,1366,1380,1370,1372,1371,1124,1156,1142,1358,1153,205,485,1357,222,484,1151,1148,1123,1364,1146,1125,1375,1147,1381,1376,1377,1378,1178,1143,1368,196,212,286,1122,1367,1361,970,366,1360,288,367,206,975,200,974,1374,197,280,364,1369,1379,1313,1365,968,216,285,1121],"class_list":["post-281","post","type-post","status-publish","format-standard","hentry","category-big-data","tag-accenture-interview-questions-and-answers","tag-apache-hadoop-components","tag-apache-hadoop-core-components-were-inspired-bycomponents-of-hadoop-ecosystemapache-hadoops-core-components-inspired-by","tag-apart-from-its-basic-components-apache-hadoop-also-provides","tag-att-interview-questions-and-answers","tag-atos-interview-questions-and-answers","tag-basic-components-of-big-data","tag-big-data-architecture-components","tag-big-data-components","tag-big-data-ecosystem-components","tag-capgemini-interview-questions-and-answers","tag-casting-networks-india-pvt-limited-interview-questions-and-answers","tag-cgi-group-inc-interview-questions-and-answers","tag-collabera-technologiesinterview-questions-and-answers","tag-components-of-apache-hadoop","tag-components-of-big-data-analytics","tag-components-of-hadoop-architecture","tag-components-of-hadoop-cluster-based-on-hdfs","tag-components-of-hadoop-framework","tag-components-of-hadoop-in-big-data","tag-core-apache-components-in-hadoop","tag-core-components-of-hadoop","tag-core-components-of-hadoop-ques","tag-core-hadoop-components","tag-dell-international-services-india-pvt-ltd-interview-questions-and-answers","tag-ernst-young-interview-questions-and-answers","tag-explain-hadoop-architecture-and-its-components-with-proper-diagram","tag-flipkart-interview-questions-and-answers","tag-genpact-interview-questions-and-answers","tag-hadoop-and-its-components","tag-hadoop-architecture-components","tag-hadoop-components","tag-hadoop-components-diagram","tag-hadoop-components-explained","tag-hadoop-ecosystem-components","tag-hadoop-framework","tag-hadoop-framework-components","tag-hadoop-includes-open-source-components-and-closed-source-ones","tag-hadoop-layers","tag-hadoop-lower-levels","tag-hadoop-offers-built-in-redundancy-feature-for-both-hdfs-and-mapreduce","tag-hadoop-storage","tag-hdfs-components","tag-hortonworks-hadoop-components","tag-ibm-interview-questions-and-answers","tag-indecomm-global-services-interview-questions-and-answers","tag-lt-infotech-interview-questions-and-answers","tag-list-of-hadoop-components","tag-main-components-of-hadoop","tag-mapreduce-components","tag-mindtree-interview-questions-and-answers","tag-netapp-interview-questions-and-answers","tag-not-a-big-data-component","tag-r-systems-interview-questions-and-answers","tag-rbs-india-development-centre-pvt-ltd-interview-questions-and-answers","tag-sap-labs-india-pvt-ltd-interview-questions-and-answers","tag-tata-consultancy-service-interview-questions-and-answers","tag-tech-mahindra-interview-questions-and-answers","tag-trigent-software-interview-questions-and-answers","tag-two-major-components-of-the-mapreduce-layer","tag-unitedhealth-group-interview-questions-and-answers","tag-virtusa-consulting-services-pvt-ltd-interview-questions-and-answers","tag-wells-fargo-interview-questions-and-answers","tag-what-are-the-components-of-hadoop","tag-what-are-the-core-components-of-hadoop","tag-what-is-hadoop","tag-which-component-of-hadoop-ecosystem-supports-updation","tag-wipro-infotech-interview-questions-and-answers","tag-wipro-interview-questions-and-answers","tag-xoriant-solutions-pvt-ltd-interview-questions-and-answers","tag-zs-associates-interview-questions-and-answers"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>What are the core components of Hadoop ? - Big Data<\/title>\n<meta name=\"description\" content=\"What are the core components of Hadoop ? - Hadoop is an open source framework that is meant for storage and processing of big data in a distributed manner\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What are the core components of Hadoop ? - Big Data\" \/>\n<meta property=\"og:description\" content=\"What are the core components of Hadoop ? - Hadoop is an open source framework that is meant for storage and processing of big data in a distributed manner\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/\" \/>\n<meta property=\"og:site_name\" content=\"Wikitechy\" \/>\n<meta property=\"article:published_time\" content=\"2021-07-12T18:01:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-09-14T07:13:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/what-are-the-core-components-of-hadoop.png\" \/>\n<meta name=\"author\" content=\"Editor\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editor\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/\",\"url\":\"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/\",\"name\":\"What are the core components of Hadoop ? - Big Data\",\"isPartOf\":{\"@id\":\"https:\/\/www.wikitechy.com\/interview-questions\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/what-are-the-core-components-of-hadoop.png\",\"datePublished\":\"2021-07-12T18:01:53+00:00\",\"dateModified\":\"2021-09-14T07:13:13+00:00\",\"author\":{\"@id\":\"https:\/\/www.wikitechy.com\/interview-questions\/#\/schema\/person\/4d5a581fb5470d1560324bddc5e8b757\"},\"description\":\"What are the core components of Hadoop ? - Hadoop is an open source framework that is meant for storage and processing of big data in a distributed manner\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/#primaryimage\",\"url\":\"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/what-are-the-core-components-of-hadoop.png\",\"contentUrl\":\"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/what-are-the-core-components-of-hadoop.png\"},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.wikitechy.com\/interview-questions\/#website\",\"url\":\"https:\/\/www.wikitechy.com\/interview-questions\/\",\"name\":\"Wikitechy\",\"description\":\"Interview Questions\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.wikitechy.com\/interview-questions\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.wikitechy.com\/interview-questions\/#\/schema\/person\/4d5a581fb5470d1560324bddc5e8b757\",\"name\":\"Editor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.wikitechy.com\/interview-questions\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g\",\"caption\":\"Editor\"},\"url\":\"https:\/\/www.wikitechy.com\/interview-questions\/author\/editor\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What are the core components of Hadoop ? - Big Data","description":"What are the core components of Hadoop ? - Hadoop is an open source framework that is meant for storage and processing of big data in a distributed manner","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/","og_locale":"en_US","og_type":"article","og_title":"What are the core components of Hadoop ? - Big Data","og_description":"What are the core components of Hadoop ? - Hadoop is an open source framework that is meant for storage and processing of big data in a distributed manner","og_url":"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/","og_site_name":"Wikitechy","article_published_time":"2021-07-12T18:01:53+00:00","article_modified_time":"2021-09-14T07:13:13+00:00","og_image":[{"url":"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/what-are-the-core-components-of-hadoop.png"}],"author":"Editor","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Editor","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/","url":"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/","name":"What are the core components of Hadoop ? - Big Data","isPartOf":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/#primaryimage"},"image":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/#primaryimage"},"thumbnailUrl":"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/what-are-the-core-components-of-hadoop.png","datePublished":"2021-07-12T18:01:53+00:00","dateModified":"2021-09-14T07:13:13+00:00","author":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/#\/schema\/person\/4d5a581fb5470d1560324bddc5e8b757"},"description":"What are the core components of Hadoop ? - Hadoop is an open source framework that is meant for storage and processing of big data in a distributed manner","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.wikitechy.com\/interview-questions\/big-data\/what-are-the-core-components-of-hadoop\/#primaryimage","url":"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/what-are-the-core-components-of-hadoop.png","contentUrl":"https:\/\/cdn.wikitechy.com\/interview-questions\/hadoop\/what-are-the-core-components-of-hadoop.png"},{"@type":"WebSite","@id":"https:\/\/www.wikitechy.com\/interview-questions\/#website","url":"https:\/\/www.wikitechy.com\/interview-questions\/","name":"Wikitechy","description":"Interview Questions","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.wikitechy.com\/interview-questions\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.wikitechy.com\/interview-questions\/#\/schema\/person\/4d5a581fb5470d1560324bddc5e8b757","name":"Editor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.wikitechy.com\/interview-questions\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g","caption":"Editor"},"url":"https:\/\/www.wikitechy.com\/interview-questions\/author\/editor\/"}]}},"_links":{"self":[{"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/posts\/281","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/comments?post=281"}],"version-history":[{"count":3,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/posts\/281\/revisions"}],"predecessor-version":[{"id":3684,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/posts\/281\/revisions\/3684"}],"wp:attachment":[{"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/media?parent=281"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/categories?post=281"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/tags?post=281"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}