solr indexing tutorial - Wikitechy https://www.wikitechy.com/interview-questions/tag/solr-indexing-tutorial/ Interview Questions Tue, 14 Sep 2021 10:33:52 +0000 en-US hourly 1 https://wordpress.org/?v=6.9.4 https://www.wikitechy.com/interview-questions/wp-content/uploads/2025/10/cropped-wikitechy-icon-32x32.png solr indexing tutorial - Wikitechy https://www.wikitechy.com/interview-questions/tag/solr-indexing-tutorial/ 32 32 What is Indexing and search full_text arabic field using apache solr ? https://www.wikitechy.com/interview-questions/apache-solr/what-is-indexing-and-search-full_text-arabic-field-using-apache-solr/ https://www.wikitechy.com/interview-questions/apache-solr/what-is-indexing-and-search-full_text-arabic-field-using-apache-solr/#respond Mon, 12 Jul 2021 15:45:41 +0000 https://www.wikitechy.com/interview-questions/?p=248

Arabic field using apache solr:

  • Apache Solr has an Arabic analysis.
  • If you open the default schema.xml file which comes with Solr, you will see an example of Arabic fieldtype.
  • You can use CopyField to copy your fields to the Arabic field type.
  • You have to reindex your content again to get the preferred results.
  • If each document consists of 3 fields, two fields are integers then the third field is Arabic text with diacritics, the user may use words with or without diacritics or else some letters have diacritics and others without diacritics, you can use schema.xml which helps in such situation.
<?xml version="1.0" encoding="UTF-8" ?>

<schema name="quran" version="1.5">

<fields>
    <field name="_version_" type="long" indexed="true" stored="true"/>
    <field name="_id" type="long" indexed="true" stored="true" />
    <field name="sura_number" type="int" indexed="true" stored="true" />
    <field name="verse_number" type="int" indexed="true" stored="true" />
    <field name="verse_text" type="text_ar" indexed="true" stored="true"/>
 </fields>

<types>
    <fieldType name="string" class="solr.StrField" sortMissingLast="true" />
    <fieldType name="boolean" class="solr.BoolField" sortMissingLast="true"/>

    <fieldType name="int" class="solr.TrieIntField" precisionStep="0" positionIncrementGap="0"/>
    <fieldType name="float" class="solr.TrieFloatField" precisionStep="0" positionIncrementGap="0"/>
    <fieldType name="long" class="solr.TrieLongField" precisionStep="0" positionIncrementGap="0"/>
    <fieldType name="double" class="solr.TrieDoubleField" precisionStep="0" positionIncrementGap="0"/>

    <fieldType name="date" class="solr.TrieDateField" precisionStep="0" positionIncrementGap="0"/>

    <fieldType name="location" class="solr.LatLonType" subFieldSuffix="_coordinate"/>
    <dynamicField name="*_coordinate"  type="tdouble" indexed="true"  stored="false"/>

   <!--  Arabic  -->
   <fieldType name="text_ar" class="solr.TextField" positionIncrementGap="100">
   <analyzer>
   <tokenizer class="solr.StandardTokenizerFactory"/>
   <!--  normalizes ﻯ to ﻱ, etc  -->
   <filter class="solr.ArabicNormalizationFilterFactory"/>
   <filter class="solr.ArabicStemFilterFactory"/>
   </analyzer>
   </fieldType>

</types>

</schema>
]]> https://www.wikitechy.com/interview-questions/apache-solr/what-is-indexing-and-search-full_text-arabic-field-using-apache-solr/feed/ 0 How Solr represents data ? https://www.wikitechy.com/interview-questions/apache-solr/how-solr-represents-data/ https://www.wikitechy.com/interview-questions/apache-solr/how-solr-represents-data/#respond Mon, 12 Jul 2021 13:57:33 +0000 https://www.wikitechy.com/interview-questions/?p=238

Solr represents data

  • In Apache Solr, a Document is the part of search as well as index.
  • Index consists of one or more Documents and then Document consists of one or more Fields.
  • In database terminology,a Document corresponds to a row of the table, and a Field corresponds to a column of the table.
apache solr with hadoop

Schema

  • Before adding documents to Solr, you need to specify the schema, represented in a file called schema.xml.
  • It is not suitable to modify the schema after documents has added to the index.

The schema declares:

  1. what kinds of fields there are
  2. which field should be used as the unique/primary key
  3. which fields are required
  4. how to index and search each field

Field Types

  • In Solr, every field has a type.
  • Apache Solr expands the variety of field types offered in Lucene.

Examples of basic field types available in Solr include:

  1. float
  2. long
  3. double
  4. date
  5. text
]]> https://www.wikitechy.com/interview-questions/apache-solr/how-solr-represents-data/feed/ 0 How does the apache Solr works ? https://www.wikitechy.com/interview-questions/apache-solr/how-does-the-apache-solr-works/ https://www.wikitechy.com/interview-questions/apache-solr/how-does-the-apache-solr-works/#respond Mon, 12 Jul 2021 12:03:13 +0000 https://www.wikitechy.com/interview-questions/?p=236

Apache Solr works

Indexing

  • Apache Solr is capable to get quick search responses because, as a replacement for searching the text directly, it searches an index instead.
  • It stores index in a directory called index in the data directory.
how apache solr works

Working:

  • The Apache Solr creates inverted index of the documents that are posted in to its collection or core.
  • Core or collection is just part entity which can be used to post documents and running queries on that set of documents.
  • Inverted index is a main term in the domain of Information Retrieval and Natural Language Processing.
  • Now take a document, note down all the unique words appearing in that document as well as note the frequency of the words. Hence the inverted index is ready.
  • Solr creates similar inverted index of the documents posted to its core using a defined schema.
  • Schema is a blue print which helps Solr in creating inverted index of the documents by giving a set of predefined fields in the schema.xml file.
  • Once Solr completes indexing the documents posted to its core or collection it can be used to run queries.
solr work
  • Now a user can query Solr for related documents using its query parser or admin panel.
  • When a query is given to Solr, it breaks the query into different chunks or entities and matches it with the inverted index of the documents created previous.
  • The documents obtained accordingly of a Solr search is based on the same class and other constraints defined in its schema.xml and solr.config file.
]]> https://www.wikitechy.com/interview-questions/apache-solr/how-does-the-apache-solr-works/feed/ 0 Where does the Apache Solr store the actual data ? https://www.wikitechy.com/interview-questions/apache-solr/where-does-the-apache-solr-store-the-actual-data/ https://www.wikitechy.com/interview-questions/apache-solr/where-does-the-apache-solr-store-the-actual-data/#respond Mon, 12 Jul 2021 11:58:00 +0000 https://www.wikitechy.com/interview-questions/?p=234 Apache Solr store the actual data
  • Apache Solr creates an index of its own and stores it in inverted index format.
  • While generating these indexes you can use different tokens and analyzers so that your search becomes easier.
  • The purpose of Apache Solr is to search and then the purpose of NoSQL is to use it as WORM (Write Once Read Many).
  • In the event you want to create search engine and store in NoSQL then you can create index in search and while indexing you can also write to NoSQL Systems.
  • Care needs to be taken to make certain consistency in Apache Solr as well as NoSQL systems.
  • There are new tools these days that can transfer from NoSQL to Solr.
  • The Apache Solr index is a particularly designed data structure, stored on the file system as a set of index files.
  • The index is designed with capable data structures to maximize performance and to minimize resource usage.
Apache Solr Store Data
]]> https://www.wikitechy.com/interview-questions/apache-solr/where-does-the-apache-solr-store-the-actual-data/feed/ 0