What is Apache Spark<\/span><\/h2>\n<\/div>\n<\/div>\n

\n

\n

\n
• Apache Spark is an open-source distributed cluster-computing framework.<\/li>\n
• Spark is a data processing engine developed to provide faster and ease-of-use analytics than Hadoop MapReduce.<\/li>\n
• Before Apache Software Foundation took possession of Spark, it was under the control of University of California, Berkeley\u2019s AMP Lab.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n
  \n

  \n

  What is Apache Hadoop<\/h2>\n<\/div>\n<\/div>\n

  \n

  \n

  \n
  • Apache Hadoop is an open-source framework written in Java that allows us to store and process Big Data in a distributed environment, across various clusters of computers using simple programming constructs.<\/li>\n
  • To do this, Hadoop uses an algorithm called MapReduce, which divides the task into small parts and assigns them to a set of computers.<\/li>\n
  • Hadoop also has its own file system, Hadoop Distributed File System (HDFS), which is based on the Google File System (GFS).<\/li>\n
  • HDFS is designed to run on low-cost hardware.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n
    \n

    <\/div>\n

    \n

    \n\n\n\n\n\n\n\n\n\n\n

    CRITERIA<\/th>\n	SPARK<\/th>\n	HADOOP MAPREDUCE<\/th>\n<\/tr>\n
    Memory<\/td>\n	Let’s save data on memory with \nthe use of RDD’s.<\/td>\n	Does not leverage the memory of the hadoop cluster to maximum.<\/td>\n<\/tr>\n
    Disk usage<\/td>\n	Spark<\/a>\u00a0caches data in-memory \nand ensures low latency.<\/td>\n	MapReduce is disk oriented.<\/td>\n<\/tr>\n
    Processing<\/td>\n	Supports real-time processing through \nspark streaming.<\/td>\n	Only batch processing is supported<\/td>\n<\/tr>\n
    Installation<\/td>\n	Is not bound to Hadoop.<\/td>\n	Is bound to\u00a0hadoop<\/a>.<\/td>\n<\/tr>\n
    Storage<\/td>\n	Leverage exciting<\/td>\n	HDFS<\/td>\n<\/tr>\n
    Speed<\/td>\n	10 – 100X faster.<\/td>\n	Fast.<\/td>\n<\/tr>\n
    Rsource management<\/td>\n	standalone<\/td>\n	YARN<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n \n <\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":" Answer : Apache Spark is an open-source distributed cluster-computing…<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"passster_activate_protection":false,"passster_protect_child_pages":"","passster_protection_type":"password","passster_password":"","passster_activate_overwrite_defaults":"","passster_headline":"","passster_instruction":"","passster_placeholder":"","passster_button":"","passster_id":"","passster_activate_misc_settings":"","passster_redirect_url":"","passster_hide":"no","passster_area_shortcode":"","gtb_hide_title":false,"gtb_wrap_title":false,"gtb_class_title":"","gtb_remove_headerfooter":false,"footnotes":""},"categories":[878],"tags":[195,971,938,945,203,934,199,214,209,205,949,958,962,948,966,930,937,967,931,956,963,935,955,964,947,957,942,959,954,961,951,965,933,953,941,960,222,484,950,952,196,973,286,943,970,204,208,288,367,483,972,976,975,200,974,197,280,364,929,928,940,932,936,946,944,968,285,969],"class_list":["post-252","post","type-post","status-publish","format-standard","hentry","category-apache-spark","tag-accenture-interview-questions-and-answers","tag-altimetrik-india-pvt-ltd-interview-questions-and-answers","tag-big-data-vs-hadoop-difference","tag-can-you-explain-the-difference-between-hadoop-and-spark","tag-capgemini-interview-questions-and-answers","tag-cassandra-hadoop-difference","tag-casting-networks-india-pvt-limited-interview-questions-and-answers","tag-cgi-group-inc-interview-questions-and-answers","tag-collabera-technologies-interview-questions-and-answers","tag-dell-international-services-india-pvt-ltd-interview-questions-and-answers","tag-difference-between-apache-spark-and-hadoop","tag-difference-between-apache-spark-and-storm","tag-difference-between-apache-storm-and-spark","tag-difference-between-big-data-and-hadoop","tag-difference-between-cloudera-and-hadoop","tag-difference-between-hadoop-and-cassandra","tag-difference-between-hadoop-and-cloud-computing","tag-difference-between-hadoop-and-cloudera","tag-difference-between-hadoop-and-data-warehouse","tag-difference-between-hadoop-and-hbase","tag-difference-between-hadoop-and-hdfs","tag-difference-between-hadoop-and-hdfs-commands","tag-difference-between-hadoop-and-hive","tag-difference-between-hadoop-and-mapreduce","tag-difference-between-hadoop-and-spark","tag-difference-between-hadoop-and-sql","tag-difference-between-hdfs-and-mapreduce","tag-difference-between-hive-and-hadoop","tag-difference-between-hive-and-hbase","tag-difference-between-hive-and-spark","tag-difference-between-mapreduce-and-spark","tag-difference-between-mapreduce-and-yarn","tag-difference-between-node-and-cluster-in-hadoop","tag-difference-between-spark-and-mapreduce","tag-difference-between-spark-and-scala","tag-difference-between-sql-and-hadoop","tag-flipkart-interview-questions-and-answers","tag-genpact-interview-questions-and-answers","tag-hadoop-and-spark-difference","tag-hadoop-spark-difference","tag-ibm-interview-questions-and-answers","tag-jpmorgan-chase-and-go-interview-questions-and-answers","tag-lt-infotech-interview-questions-and-answers","tag-mapreduce-vs-spark-differences","tag-mindtree-interview-questions-and-answers","tag-oracle-corporation-interview-questions-and-answers","tag-prokarma-softech-pvt-ltd-interview-questions-and-answers","tag-r-systems-interview-questions-and-answers","tag-rbs-india-development-centre-pvt-ltd-interview-questions-and-answers","tag-reliance-industries-ltd-interview-questions-and-answers","tag-sapient-consulting-pvt-ltd-interview-questions-and-answers","tag-synechron-te-interview-questions-and-answers","tag-tata-consultancy-service-interview-questions-and-answers","tag-tech-mahindra-interview-questions-and-answers","tag-trigent-software-interview-questions-and-answers","tag-unitedhealth-group-interview-questions-and-answers","tag-virtusa-consulting-services-pvt-ltd-interview-questions-and-answers","tag-wells-fargo-interview-questions-and-answers","tag-what-is-difference-between-hadoop-and-bigdata","tag-what-is-the-difference-between-big-data-and-hadoop","tag-what-is-the-difference-between-hadoop-and-mapreduce","tag-what-is-the-difference-between-hadoop-and-spark","tag-what-is-the-difference-between-spark-and-hadoop","tag-what-is-the-difference-between-spark-and-hadoop-mapreduce","tag-what-is-the-relationship-between-hadoop-and-spark","tag-wipro-infotech-interview-questions-and-answers","tag-xoriant-solutions-pvt-ltd-interview-questions-and-answers","tag-yodlee-infotech-pvt-ltd-interview-questions-and-answers"],"yoast_head":"\n