Best practice indexing hdfs data into solr using hive<\/h2>\n<\/div>\n<\/div>\n

<\/div>\n

\n

Here,based on the requirement especially how typically your data gets updated, volume and architecture.<\/div>\n<\/div>\n

\n

\n

\n
• Run a MR job to index data using solrj.<\/li>\n
• Create Lucene index using mr job and duplicate to the appropriate shards.<\/li>\n
• Use Hbase indexer to populate Solr.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n
  \n

  \n

  Properly Size Index:<\/h2>\n<\/div>\n<\/div>\n

  \n

  \n

  \n
  • Understanding what to index typically requires deep business domain expertise on the data.<\/li>\n
  • This yields better indexing plan and increases accuracy for searching data.<\/li>\n
  • Not all data will be indexed but for an organization user have new data,Needs classification of all data untill it is understood what value it brings to the business.<\/li>\n
  • It implies is that data needs to be re-indexed so it is a good practice to store raw data somewhere low cost, often in HDFS or in the cloud object storage.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

    Answer : Here,based on the requirement especially how typically your data gets updated, volume and architecture.<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"passster_activate_protection":false,"passster_protect_child_pages":"","passster_protection_type":"password","passster_password":"","passster_activate_overwrite_defaults":"","passster_headline":"","passster_instruction":"","passster_placeholder":"","passster_button":"","passster_id":"","passster_activate_misc_settings":"","passster_redirect_url":"","passster_hide":"no","passster_area_shortcode":"","gtb_hide_title":false,"gtb_wrap_title":false,"gtb_class_title":"","gtb_remove_headerfooter":false,"footnotes":""},"categories":[3782],"tags":[195,971,3799,3904,3908,203,199,214,3909,3901,209,205,222,484,621,620,3905,196,3716,3907,712,970,366,477,208,288,483,3903,3902,3906,3900,976,975,200,974,197,280,364,968,216,2119,969],"class_list":["post-579","post","type-post","status-publish","format-standard","hentry","category-hive","tag-accenture-interview-questions-and-answers","tag-altimetrik-india-pvt-ltd-interview-questions-and-answers","tag-ani-technologies-pvt-ltd-interview-questions-and-answers","tag-apache-solr-analytics","tag-can-we-update-data-in-hadoop","tag-capgemini-interview-questions-and-answers","tag-casting-networks-india-pvt-limited-interview-questions-and-answers","tag-cgi-group-inc-interview-questions-and-answers","tag-change-data-capture-in-hive-example","tag-cloudera-solr-tutorial","tag-collabera-technologies-interview-questions-and-answers","tag-dell-international-services-india-pvt-ltd-interview-questions-and-answers","tag-flipkart-interview-questions-and-answers","tag-genpact-interview-questions-and-answers","tag-hive-query-based-interview-questions","tag-hive-scenario-based-interview-questions","tag-how-would-you-load-incremental-data-into-hive","tag-ibm-interview-questions-and-answers","tag-impetus-technologies-interview-questions-and-answers","tag-implementing-change-data-capture-using-hive","tag-indiabulls-technology-solutions-ltd-interview-questions-and-answers","tag-mindtree-interview-questions-and-answers","tag-netapp-interview-questions-and-answers","tag-pig-interview-questions","tag-prokarma-softech-pvt-ltd-interview-questions-and-answers","tag-r-systems-interview-questions-and-answers","tag-reliance-industries-ltd-interview-questions-and-answers","tag-solr-analytics-component","tag-solr-hadoop-example","tag-solr-hadoop-integration-example","tag-solr-index-hdfs-files","tag-synechron-te-interview-questions-and-answers","tag-tata-consultancy-service-interview-questions-and-answers","tag-tech-mahindra-interview-questions-and-answers","tag-trigent-software-interview-questions-and-answers","tag-unitedhealth-group-interview-questions-and-answers","tag-virtusa-consulting-services-pvt-ltd-interview-questions-and-answers","tag-wells-fargo-interview-questions-and-answers","tag-wipro-infotech-interview-questions-and-answers","tag-wipro-interview-questions-and-answers","tag-yash-technologies-interview-questions-and-answers","tag-yodlee-infotech-pvt-ltd-interview-questions-and-answers"],"yoast_head":"\n