apache solr indexing - Wikitechy https://www.wikitechy.com/interview-questions/tag/apache-solr-indexing/ Interview Questions Tue, 14 Sep 2021 10:20:23 +0000 en-US hourly 1 https://wordpress.org/?v=6.9.4 https://www.wikitechy.com/interview-questions/wp-content/uploads/2025/10/cropped-wikitechy-icon-32x32.png apache solr indexing - Wikitechy https://www.wikitechy.com/interview-questions/tag/apache-solr-indexing/ 32 32 What is Indexing and search full_text arabic field using apache solr ? https://www.wikitechy.com/interview-questions/apache-solr/what-is-indexing-and-search-full_text-arabic-field-using-apache-solr/ https://www.wikitechy.com/interview-questions/apache-solr/what-is-indexing-and-search-full_text-arabic-field-using-apache-solr/#respond Mon, 12 Jul 2021 15:45:41 +0000 https://www.wikitechy.com/interview-questions/?p=248

Arabic field using apache solr:

  • Apache Solr has an Arabic analysis.
  • If you open the default schema.xml file which comes with Solr, you will see an example of Arabic fieldtype.
  • You can use CopyField to copy your fields to the Arabic field type.
  • You have to reindex your content again to get the preferred results.
  • If each document consists of 3 fields, two fields are integers then the third field is Arabic text with diacritics, the user may use words with or without diacritics or else some letters have diacritics and others without diacritics, you can use schema.xml which helps in such situation.
<?xml version="1.0" encoding="UTF-8" ?>

<schema name="quran" version="1.5">

<fields>
    <field name="_version_" type="long" indexed="true" stored="true"/>
    <field name="_id" type="long" indexed="true" stored="true" />
    <field name="sura_number" type="int" indexed="true" stored="true" />
    <field name="verse_number" type="int" indexed="true" stored="true" />
    <field name="verse_text" type="text_ar" indexed="true" stored="true"/>
 </fields>

<types>
    <fieldType name="string" class="solr.StrField" sortMissingLast="true" />
    <fieldType name="boolean" class="solr.BoolField" sortMissingLast="true"/>

    <fieldType name="int" class="solr.TrieIntField" precisionStep="0" positionIncrementGap="0"/>
    <fieldType name="float" class="solr.TrieFloatField" precisionStep="0" positionIncrementGap="0"/>
    <fieldType name="long" class="solr.TrieLongField" precisionStep="0" positionIncrementGap="0"/>
    <fieldType name="double" class="solr.TrieDoubleField" precisionStep="0" positionIncrementGap="0"/>

    <fieldType name="date" class="solr.TrieDateField" precisionStep="0" positionIncrementGap="0"/>

    <fieldType name="location" class="solr.LatLonType" subFieldSuffix="_coordinate"/>
    <dynamicField name="*_coordinate"  type="tdouble" indexed="true"  stored="false"/>

   <!--  Arabic  -->
   <fieldType name="text_ar" class="solr.TextField" positionIncrementGap="100">
   <analyzer>
   <tokenizer class="solr.StandardTokenizerFactory"/>
   <!--  normalizes ﻯ to ﻱ, etc  -->
   <filter class="solr.ArabicNormalizationFilterFactory"/>
   <filter class="solr.ArabicStemFilterFactory"/>
   </analyzer>
   </fieldType>

</types>

</schema>
]]> https://www.wikitechy.com/interview-questions/apache-solr/what-is-indexing-and-search-full_text-arabic-field-using-apache-solr/feed/ 0 How to Index multiple tables using SOLR ? https://www.wikitechy.com/interview-questions/apache-solr/how-to-index-multiple-tables-using-solr/ https://www.wikitechy.com/interview-questions/apache-solr/how-to-index-multiple-tables-using-solr/#respond Mon, 12 Jul 2021 14:56:17 +0000 https://www.wikitechy.com/interview-questions/?p=240

Index multiple tables using SOLR

There are various ways to do it and it depends on your table schema. Some simple ones would be like:

  • If you have 2-3 different tables and they are kind of unrelated then in that case you need to have an extensive Solr schema and just index each table separately. You would perform this only when you desire to use Solr for just search on documents present in dissimilar tables.
  • It’s like you have a table STUDENT (id,name,roll) and TEACHER (id,name,subject,qualification), you need to have these fields in your solr schema (id,name,roll,subject,qualification).
  • Now index the two tables either by solrj or use Data Import Handler.
  • If you have different tables and have relations between them then you need to write SQL queries which perform joins between them and get the columns that you would like to index into solr.

Indexing either of the two tables (and not both the tables):

DB-config.xml

<dataConfig>
<dataSource driver="com.metamatrix.jdbc.MMDriver" url="jdbc:....." />
<document name="doc">
<entity name="table1"
query="select * from table1">
<field column="ID" name="ElementID" />
<field column="Name" name="ElementName" />
<field column="ElementType" name="ElementType" />
<field column="RepId" name="ElementRepId" />
</entity>

<entity name="table2"
query="select * from table2">
<field column="id" name="ElementPropertyID" />
<field column="Name" name="ElementPropertyName" />
<field column="DataType" name="ElementPropertyDataType" />
<field column="RepId" name="ElementPropertyRepId" />

</entity>
</document>
</dataConfig>

Schema.xml

<fields>

<field name="ElementID" type="string" indexed="true"
stored="true" />
<field name="ElementName" type="string" indexed="true"
stored="true" />
<field name="ElementType" type="string" indexed="true"
stored="true" />
<field name="ElementRepId" type="string" indexed="true"
stored="true" />

<field name="ElementPropertyID" type="string" indexed="true"
stored="true" />
<field name="ElementPropertyName" type="string" indexed="true"
stored="true" />
<field name="ElementPropertyDataType" type="string"
indexed="true" stored="true" />
<field name="ElementPropertyRepId" type="string" indexed="true"
stored="true" />


<dynamicField name="*" type="ignored" />
</fields>
<uniqueKey>ElementPropertyID</uniqueKey>
]]> https://www.wikitechy.com/interview-questions/apache-solr/how-to-index-multiple-tables-using-solr/feed/ 0