Apache flume<\/h2>\n<\/div>\n<\/div>\n

\n

\n

\n
• Apache Flume is a reliable, distributed and accessible service for efficiently aggregating, collecting, and moving\u00a0huge amounts of log data<\/b>.<\/li>\n
• It has an easy and flexible design based on\u00a0streaming data flows<\/b>. It’s robust and fault tolerant with tunable reliability mechanisms and recovery mechanisms.<\/li>\n
• It uses an easy extensible data model that enables for\u00a0on-line analytic application<\/b>.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n
  \n

  \n

  <\/div>\n<\/div>\n<\/div>\n

  \n

  <\/div>\n<\/div>\n

  Learn Flume – Flume tutorial –\u00a0apache flume\u00a0– Flume examples – Flume programs<\/p>\n

  Flume defines a simple pipeline structure with three roles:<\/p>\n

  \n

  \n

  \n
  1. \n
     \n
     1. Source<\/li>\n
     2. Channel<\/li>\n
     3. Sinks<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<\/div>\n<\/div>\n
        \n

        \n

        \n
        • Sources<\/b>\u00a0define where data comes from, e.g. a file, a message queue (Kafka,JMS).<\/li>\n
        • Channels<\/b>\u00a0are pipes connecting sources with sinks.<\/li>\n
        • Sinks<\/b>\u00a0are the destination of the data pipelined from sources.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n
          <\/div>\n

          Apache flume features<\/h2>\n

          <\/div>\n","protected":false},"excerpt":{"rendered":"

          Answer-Apache Flume is a reliable, distributed and accessible service for efficiently aggregating, collecting,<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"passster_activate_protection":false,"passster_protect_child_pages":"","passster_protection_type":"password","passster_password":"","passster_activate_overwrite_defaults":"","passster_headline":"","passster_instruction":"","passster_placeholder":"","passster_button":"","passster_id":"","passster_activate_misc_settings":"","passster_redirect_url":"","passster_hide":"no","passster_area_shortcode":"","gtb_hide_title":false,"gtb_wrap_title":false,"gtb_class_title":"","gtb_remove_headerfooter":false,"footnotes":""},"categories":[369],"tags":[386,379,374,371,372,378,377,385,382,387,375,373,384,364,388,370,383,376,380],"class_list":["post-123","post","type-post","status-publish","format-standard","hentry","category-apache-flume","tag-apache-flume","tag-apache-flume-architecture","tag-apache-flume-download","tag-apache-flume-example","tag-apache-flume-tutorial","tag-apache-flume-use-cases","tag-apache-flume-vs-kafka","tag-failure-handling-in-flume","tag-flume-architecture-in-hadoop","tag-flume-big-data","tag-flume-kafka","tag-flume-vs-sqoopflume-vs-kafka","tag-flume-ng-command","tag-wells-fargo-interview-questions-and-answers","tag-what-is-apache-flume","tag-what-is-flume-in-hadoop","tag-what-is-flume-ng","tag-what-is-the-purpose-of-the-shuffle-operation-in-hadoop-mapreduce","tag-when-you-create-the-configuration-file-for-a-flume-agent"],"yoast_head":"\n