solr architecture - Wikitechy https://www.wikitechy.com/interview-questions/tag/solr-architecture/ Interview Questions Tue, 14 Sep 2021 11:12:09 +0000 en-US hourly 1 https://wordpress.org/?v=6.9.4 https://www.wikitechy.com/interview-questions/wp-content/uploads/2025/10/cropped-wikitechy-icon-32x32.png solr architecture - Wikitechy https://www.wikitechy.com/interview-questions/tag/solr-architecture/ 32 32 What is Indexing and search full_text arabic field using apache solr ? https://www.wikitechy.com/interview-questions/apache-solr/what-is-indexing-and-search-full_text-arabic-field-using-apache-solr/ https://www.wikitechy.com/interview-questions/apache-solr/what-is-indexing-and-search-full_text-arabic-field-using-apache-solr/#respond Mon, 12 Jul 2021 15:45:41 +0000 https://www.wikitechy.com/interview-questions/?p=248

Arabic field using apache solr:

  • Apache Solr has an Arabic analysis.
  • If you open the default schema.xml file which comes with Solr, you will see an example of Arabic fieldtype.
  • You can use CopyField to copy your fields to the Arabic field type.
  • You have to reindex your content again to get the preferred results.
  • If each document consists of 3 fields, two fields are integers then the third field is Arabic text with diacritics, the user may use words with or without diacritics or else some letters have diacritics and others without diacritics, you can use schema.xml which helps in such situation.
<?xml version="1.0" encoding="UTF-8" ?>

<schema name="quran" version="1.5">

<fields>
    <field name="_version_" type="long" indexed="true" stored="true"/>
    <field name="_id" type="long" indexed="true" stored="true" />
    <field name="sura_number" type="int" indexed="true" stored="true" />
    <field name="verse_number" type="int" indexed="true" stored="true" />
    <field name="verse_text" type="text_ar" indexed="true" stored="true"/>
 </fields>

<types>
    <fieldType name="string" class="solr.StrField" sortMissingLast="true" />
    <fieldType name="boolean" class="solr.BoolField" sortMissingLast="true"/>

    <fieldType name="int" class="solr.TrieIntField" precisionStep="0" positionIncrementGap="0"/>
    <fieldType name="float" class="solr.TrieFloatField" precisionStep="0" positionIncrementGap="0"/>
    <fieldType name="long" class="solr.TrieLongField" precisionStep="0" positionIncrementGap="0"/>
    <fieldType name="double" class="solr.TrieDoubleField" precisionStep="0" positionIncrementGap="0"/>

    <fieldType name="date" class="solr.TrieDateField" precisionStep="0" positionIncrementGap="0"/>

    <fieldType name="location" class="solr.LatLonType" subFieldSuffix="_coordinate"/>
    <dynamicField name="*_coordinate"  type="tdouble" indexed="true"  stored="false"/>

   <!--  Arabic  -->
   <fieldType name="text_ar" class="solr.TextField" positionIncrementGap="100">
   <analyzer>
   <tokenizer class="solr.StandardTokenizerFactory"/>
   <!--  normalizes ﻯ to ﻱ, etc  -->
   <filter class="solr.ArabicNormalizationFilterFactory"/>
   <filter class="solr.ArabicStemFilterFactory"/>
   </analyzer>
   </fieldType>

</types>

</schema>
]]> https://www.wikitechy.com/interview-questions/apache-solr/what-is-indexing-and-search-full_text-arabic-field-using-apache-solr/feed/ 0 What is the most ideal approach to use Apache Solr for relational JOIN ? https://www.wikitechy.com/interview-questions/apache-solr/what-is-the-most-ideal-approach-to-use-apache-solr-for-relational-join/ https://www.wikitechy.com/interview-questions/apache-solr/what-is-the-most-ideal-approach-to-use-apache-solr-for-relational-join/#respond Mon, 12 Jul 2021 09:28:47 +0000 https://www.wikitechy.com/interview-questions/?p=224

Apache Solr for relational JOIN:

  • Run a single-use script that do the joins on the SOLR index (file) to replace the author_id and author_name, or include the field if you need both. Updating 10,000,000+ documents will get a while, however it is definitely achievable.
  • After that you can have new documents indexed with both fields, doing the JOIN one at a time.
  • In common, SOLR works with entirely denormalized information.
  • If it is more than just authors’ names, you could still denormalize the information, repeating your documents for every one of the related author documents.
  • Another technique is SOLR 4 has “JOIN” ability.
  • You’d first need to at least contain a pipeline wherever author information is indexed into SOLR in real-time.
  • Utilize Elastic Search to simply deal with the complex SOLR queries involving JOIN-like operations.
]]> https://www.wikitechy.com/interview-questions/apache-solr/what-is-the-most-ideal-approach-to-use-apache-solr-for-relational-join/feed/ 0 What is the internal architecture of Apache solr ? https://www.wikitechy.com/interview-questions/apache-solr/what-is-the-internal-architecture-of-apache-solr/ https://www.wikitechy.com/interview-questions/apache-solr/what-is-the-internal-architecture-of-apache-solr/#respond Mon, 12 Jul 2021 09:24:15 +0000 https://www.wikitechy.com/interview-questions/?p=221

Solr Architecture ─ Building Blocks

Following are the major building blocks of Apache Solr:

solr architecture

Solr Architecture ─ Building Blocks Request Handler:

  • The requests that send to Solr are processed by the request handlers.
  • The requests may be a query requests otherwise index update requests.
  • It is based on our requirement; we need to choose the request handler.
  • To pass a request to Solr, we generally map the handler to a certain URI end-point and the particular request will be served by it.
how apache solr works

Search Component:

  • The search component is a type of search provided in Apache Solr.
  • It might be spell checking, faceting, query, and hit highlighting and so on.
  • These search components are registered as search handlers. Multiple components can be registered to a search handler.

Query Parser:

  • The Apache Solr query parser parses the queries that we pass to Solr and verifies the queries for syntactical errors.
  • After parsing the queries, it translates them to a format which Lucene understands.

Response Writer:

  • A response writer is the component which generates the formatted outcome for the user queries.
  • Apache Solr supports response formats some are XML, JSON, CSV, etc.
  • We have different response writers for each type of response.

Analyser/tokenizer:

  • Lucene recognizes data in the form of tokens.
  • Apache Solr analyses the content, divides it into tokens, and passes these tokens to Lucene.
  • An analyser examines the text of fields and generates a token stream.
  • A tokenizer breaks the token stream prepared by the analyser into tokens.

Update Request Processor:

  • Whenever we send an update request to Apache Solr, the request is run through a set of plugins (signature, logging, indexing), collectively known as update request processor.
  • This processor is responsible for modifications that are adding a field, dropping a field, etc.
apache solr with hadoop
]]> https://www.wikitechy.com/interview-questions/apache-solr/what-is-the-internal-architecture-of-apache-solr/feed/ 0 What are the features of Apache Solr ? https://www.wikitechy.com/interview-questions/apache-solr/what-are-the-features-of-apache-solr/ https://www.wikitechy.com/interview-questions/apache-solr/what-are-the-features-of-apache-solr/#respond Mon, 12 Jul 2021 09:01:12 +0000 https://www.wikitechy.com/interview-questions/?p=218

Features of Apache Solr

Advanced Full-Text Search Capabilities:

  • Apache Solr contains powerful capabilities such as phrases, wildcards, grouping, joins and much more across several data type.

Optimized for High Volume Traffic:

  • It is proven at very large scales throughout the world.

Standards Based Open Interfaces – XML, JSON and HTTP:

  • Solr uses the tools that use to make application building a snap.

Comprehensive Administration Interfaces:

  • It ships with a built-in, responsive administrative UI to build it simple and to manage the Solr instances.

Ease Monitoring:

  • It publishes many of metric information via JMX.

Highly Scalable and Fault Tolerant:

  • Built on the battle-tested Apache Zookeeper, It makes ease to scale up and down.
  • It bakes in distribution, replication, and rebalancing as well as fault tolerance out of the box.

Flexible and Adaptable with easy configuration:

  • Solr’s is planned to adapt your needs as simplifying configuration.

Near Real-Time Indexing:

  • Apache Solr takes a benefit of Lucene’s Near Real-Time Indexing capabilities to ensure you to see your content when you would like to notice it
]]> https://www.wikitechy.com/interview-questions/apache-solr/what-are-the-features-of-apache-solr/feed/ 0