Solr Mongo Importer

Welcome to the Solr Mongo Importer project. This project provides MongoDb support for the Solr Data Import Handler.

Differences between this fork and the upstream

I'm writing this from memory as the author did not update the readme himself or provide detailed commit logs, but it should be accurate based on what I saw in the code comments and the conversation I had with him when he published the code.

BuyerQuest uses Mongodb replica sets which requires that the connector perform a discovery process through the MongoDB driver. The original code did not support that functionality, and so only supported connecting to an individual server instead of using a multi-server connection URI. There were also some tests added to validate this functionality.

The original README.md continues below.

Features

• Retrive data from a MongoDb collection
• Authenticate using MongoDb authentication
• Map Mongo fields to Solr fields
• Delta import available

Classes

• MongoDataSource - Provides a MongoDb datasource
  • database (required) - The name of the data base you want to connect to
  • host (optional - default: localhost)
  • port (optional - default: 27017)
  • username (optional)
  • password (optional)
• MongoEntityProcessor - Use with the MongoDataSource to query a MongoDb collection
  • collection (required)
  • query (required)
  • deltaQuery (optional)
  • deltaImportQuery (optional)
• MongoMapperTransformer - Map MongoDb fields to your Solr schema
  • mongoField (required)

Installation

1. Firstly you will need a copy of the Solr Mongo Importer jar.

   Getting Solr Mongo Importer

   1. Download the latest JAR from github
   2. Build your own using the ant build script you will need the JDK installed as well as Ant and Ivy

2. You will also need the [Mongo Java driver JAR] (https://github.com/mongodb/mongo-java-driver/downloads)

3. Place both of these jar's in your Solr libaries folder ( I put mine in 'dist' folder with the other jar's)

4. Add lib directives to your solrconfig.xml

    <lib path="../../dist/solr-mongo-importer-{version}.jar" />
    <lib path="../../dist/mongo.jar" />

##Usage Here is a sample data-config.xml showing the use of all components

<?xml version="1.0" encoding="UTF-8" ?>
<dataConfig>
     <dataSource name="MyMongo" type="MongoDataSource" database="Inventory" />
     <document name="Products">
         <entity processor="MongoEntityProcessor"
                 query="{'Active':1}"
                 collection="ProductData"
                 datasource="MyMongo"
                 deltaQuery="{'UpdateDate':{$gt:{$date:'${dih.last_index_time}'}}}"
                 deltaImportQuery="{'_id':'${dih.delta._id}'}"
                 transformer="MongoMapperTransformer" >
             <field column="title"           name="title"       mongoField="Title"/>
             <field column="description"     name="description" mongoField="Long Description"/>
             <field column="brand"           name="brand"  />
         </entity>
     </document>
 </dataConfig>