{"id":123,"date":"2021-07-11T15:17:38","date_gmt":"2021-07-11T15:17:38","guid":{"rendered":"https:\/\/www.wikitechy.com\/interview-questions\/?p=123"},"modified":"2021-09-15T05:48:54","modified_gmt":"2021-09-15T05:48:54","slug":"what-is-apache-flume","status":"publish","type":"post","link":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/","title":{"rendered":"What is Apache flume ?"},"content":{"rendered":"<div class=\"TextHeading\">\n<div class=\"hddn\">\n<h2 id=\"apache-flume\" class=\"color-green\" style=\"text-align: justify;\">Apache flume<\/h2>\n<\/div>\n<\/div>\n<div class=\"Content\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<ul>\n<li>Apache Flume is a reliable, distributed and accessible service for efficiently aggregating, collecting, and moving\u00a0<b>huge amounts of log data<\/b>.<\/li>\n<li>It has an easy and flexible design based on\u00a0<b>streaming data flows<\/b>. It\u2019s robust and fault tolerant with tunable reliability mechanisms and recovery mechanisms.<\/li>\n<li>It uses an easy extensible data model that enables for\u00a0<b>on-line analytic application<\/b>.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"text-center row\" style=\"text-align: justify;\">\n<div class=\"col-sm-12\">\n<div id=\"bsa-zone_1590522538159-8_123456\"><\/div>\n<\/div>\n<\/div>\n<div class=\"ImageContent\" style=\"text-align: justify;\">\n<div class=\"hddn\"><img fetchpriority=\"high\" decoding=\"async\" class=\"aligncenter size-medium\" src=\"https:\/\/cdn.wikitechy.com\/interview-questions\/apache-flume\/apache-flume.png\" alt=\"Apache Flume\" width=\"600\" height=\"226\" \/><\/div>\n<\/div>\n<p style=\"text-align: justify;\" align=\"center\">Learn Flume \u2013 Flume tutorial \u2013\u00a0apache flume\u00a0\u2013 Flume examples \u2013 Flume programs<\/p>\n<p style=\"text-align: justify;\">Flume defines a simple pipeline structure with three roles:<\/p>\n<div class=\"Content\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>\n<li>Source<\/li>\n<li>Channel<\/li>\n<li>Sinks<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<div class=\"Content\" style=\"text-align: justify;\">\n<div class=\"hddn\">\n<ul>\n<li><b>Sources<\/b>\u00a0define where data comes from, e.g. a file, a message queue (Kafka,JMS).<\/li>\n<li><b>Channels<\/b>\u00a0are pipes connecting sources with sinks.<\/li>\n<li><b>Sinks<\/b>\u00a0are the destination of the data pipelined from sources.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"hddn\"><img decoding=\"async\" class=\"aligncenter size-medium\" src=\"https:\/\/cdn.wikitechy.com\/interview-questions\/apache-flume\/apache-flume.gif\" alt=\"Apache Flume\" width=\"668\" height=\"342\" \/><\/div>\n<h2 id=\"apache-flume-features\" class=\"color-red\" style=\"text-align: justify;\">Apache flume features<\/h2>\n<div class=\"hddn\"><img decoding=\"async\" class=\"aligncenter size-medium\" src=\"https:\/\/cdn.wikitechy.com\/interview-questions\/apache-flume\/apache-flume.gif\" alt=\"Apache Flume\" width=\"668\" height=\"342\" \/><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Answer-Apache Flume is a reliable, distributed and accessible service for efficiently aggregating, collecting,<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[369],"tags":[386,379,374,371,372,378,377,385,382,387,375,373,384,364,388,370,383,376,380],"class_list":["post-123","post","type-post","status-publish","format-standard","hentry","category-apache-flume","tag-apache-flume","tag-apache-flume-architecture","tag-apache-flume-download","tag-apache-flume-example","tag-apache-flume-tutorial","tag-apache-flume-use-cases","tag-apache-flume-vs-kafka","tag-failure-handling-in-flume","tag-flume-architecture-in-hadoop","tag-flume-big-data","tag-flume-kafka","tag-flume-vs-sqoopflume-vs-kafka","tag-flume-ng-command","tag-wells-fargo-interview-questions-and-answers","tag-what-is-apache-flume","tag-what-is-flume-in-hadoop","tag-what-is-flume-ng","tag-what-is-the-purpose-of-the-shuffle-operation-in-hadoop-mapreduce","tag-when-you-create-the-configuration-file-for-a-flume-agent"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>What is Apache flume ? - Flume Tutorial for beginners<\/title>\n<meta name=\"description\" content=\"What is Apache flume ? - flume tutorial for beginners - Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What is Apache flume ? - Flume Tutorial for beginners\" \/>\n<meta property=\"og:description\" content=\"What is Apache flume ? - flume tutorial for beginners - Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/\" \/>\n<meta property=\"og:site_name\" content=\"Wikitechy\" \/>\n<meta property=\"article:published_time\" content=\"2021-07-11T15:17:38+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-09-15T05:48:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cdn.wikitechy.com\/interview-questions\/apache-flume\/apache-flume.png\" \/>\n<meta name=\"author\" content=\"Editor\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editor\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/\"},\"author\":{\"name\":\"Editor\",\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/#\\\/schema\\\/person\\\/4d5a581fb5470d1560324bddc5e8b757\"},\"headline\":\"What is Apache flume ?\",\"datePublished\":\"2021-07-11T15:17:38+00:00\",\"dateModified\":\"2021-09-15T05:48:54+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/\"},\"wordCount\":125,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cdn.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/apache-flume.png\",\"keywords\":[\"apache flume\",\"apache flume architecture\",\"apache flume download\",\"apache flume example\",\"apache flume tutorial\",\"apache flume use cases\",\"apache flume vs kafka\",\"failure handling in flume\",\"flume architecture in hadoop\",\"flume big data\",\"flume kafka\",\"flume vs sqoopflume vs kafka\",\"flume-ng command\",\"Wells Fargo interview questions and answers\",\"what is apache flume\",\"what is flume in hadoop\",\"what is flume ng\",\"what is the purpose of the shuffle operation in hadoop mapreduce?\",\"when you create the configuration file for a flume agent\"],\"articleSection\":[\"Apache Flume\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/\",\"url\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/\",\"name\":\"What is Apache flume ? - Flume Tutorial for beginners\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cdn.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/apache-flume.png\",\"datePublished\":\"2021-07-11T15:17:38+00:00\",\"dateModified\":\"2021-09-15T05:48:54+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/#\\\/schema\\\/person\\\/4d5a581fb5470d1560324bddc5e8b757\"},\"description\":\"What is Apache flume ? - flume tutorial for beginners - Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/what-is-apache-flume\\\/#primaryimage\",\"url\":\"https:\\\/\\\/cdn.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/apache-flume.png\",\"contentUrl\":\"https:\\\/\\\/cdn.wikitechy.com\\\/interview-questions\\\/apache-flume\\\/apache-flume.png\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/#website\",\"url\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/\",\"name\":\"Wikitechy\",\"description\":\"Interview Questions\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/#\\\/schema\\\/person\\\/4d5a581fb5470d1560324bddc5e8b757\",\"name\":\"Editor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g\",\"caption\":\"Editor\"},\"url\":\"https:\\\/\\\/www.wikitechy.com\\\/interview-questions\\\/author\\\/editor\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What is Apache flume ? - Flume Tutorial for beginners","description":"What is Apache flume ? - flume tutorial for beginners - Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/","og_locale":"en_US","og_type":"article","og_title":"What is Apache flume ? - Flume Tutorial for beginners","og_description":"What is Apache flume ? - flume tutorial for beginners - Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating","og_url":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/","og_site_name":"Wikitechy","article_published_time":"2021-07-11T15:17:38+00:00","article_modified_time":"2021-09-15T05:48:54+00:00","og_image":[{"url":"https:\/\/cdn.wikitechy.com\/interview-questions\/apache-flume\/apache-flume.png","type":"","width":"","height":""}],"author":"Editor","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Editor","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/#article","isPartOf":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/"},"author":{"name":"Editor","@id":"https:\/\/www.wikitechy.com\/interview-questions\/#\/schema\/person\/4d5a581fb5470d1560324bddc5e8b757"},"headline":"What is Apache flume ?","datePublished":"2021-07-11T15:17:38+00:00","dateModified":"2021-09-15T05:48:54+00:00","mainEntityOfPage":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/"},"wordCount":125,"commentCount":0,"image":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/#primaryimage"},"thumbnailUrl":"https:\/\/cdn.wikitechy.com\/interview-questions\/apache-flume\/apache-flume.png","keywords":["apache flume","apache flume architecture","apache flume download","apache flume example","apache flume tutorial","apache flume use cases","apache flume vs kafka","failure handling in flume","flume architecture in hadoop","flume big data","flume kafka","flume vs sqoopflume vs kafka","flume-ng command","Wells Fargo interview questions and answers","what is apache flume","what is flume in hadoop","what is flume ng","what is the purpose of the shuffle operation in hadoop mapreduce?","when you create the configuration file for a flume agent"],"articleSection":["Apache Flume"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/","url":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/","name":"What is Apache flume ? - Flume Tutorial for beginners","isPartOf":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/#primaryimage"},"image":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/#primaryimage"},"thumbnailUrl":"https:\/\/cdn.wikitechy.com\/interview-questions\/apache-flume\/apache-flume.png","datePublished":"2021-07-11T15:17:38+00:00","dateModified":"2021-09-15T05:48:54+00:00","author":{"@id":"https:\/\/www.wikitechy.com\/interview-questions\/#\/schema\/person\/4d5a581fb5470d1560324bddc5e8b757"},"description":"What is Apache flume ? - flume tutorial for beginners - Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.wikitechy.com\/interview-questions\/apache-flume\/what-is-apache-flume\/#primaryimage","url":"https:\/\/cdn.wikitechy.com\/interview-questions\/apache-flume\/apache-flume.png","contentUrl":"https:\/\/cdn.wikitechy.com\/interview-questions\/apache-flume\/apache-flume.png"},{"@type":"WebSite","@id":"https:\/\/www.wikitechy.com\/interview-questions\/#website","url":"https:\/\/www.wikitechy.com\/interview-questions\/","name":"Wikitechy","description":"Interview Questions","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.wikitechy.com\/interview-questions\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.wikitechy.com\/interview-questions\/#\/schema\/person\/4d5a581fb5470d1560324bddc5e8b757","name":"Editor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e9531079fe7e07841b7b156c04d65e5f39d4adfd18b6ffe3edfff8ca5aab85b5?s=96&d=mm&r=g","caption":"Editor"},"url":"https:\/\/www.wikitechy.com\/interview-questions\/author\/editor\/"}]}},"_links":{"self":[{"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/posts\/123","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/comments?post=123"}],"version-history":[{"count":5,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/posts\/123\/revisions"}],"predecessor-version":[{"id":3797,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/posts\/123\/revisions\/3797"}],"wp:attachment":[{"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/media?parent=123"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/categories?post=123"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wikitechy.com\/interview-questions\/wp-json\/wp\/v2\/tags?post=123"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}