Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-6536

Migrate HDFSDirectory from solr to lucene-hadoop

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Lucene Fields:
      New, Patch Available

      Description

      I am currently working on a search engine that is throughput orientated and works entirely in apache-spark.

      As part of this, I need a directory implementation that can operate on HDFS directly. This got me thinking, can I take the one that was worked on so hard for solr hadoop.

      As such I migrated the HDFS and blockcache directories out to a lucene-hadoop module.

      Having done this work, I am not sure if it is actually a good change, it feels a bit messy, and I dont like how the Metrics class gets extended and abused.

      Thoughts anyone

        Attachments

        1. LUCENE-6536.patch
          291 kB
          Greg Bowyer

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              gbowyer@fastmail.co.uk Greg Bowyer
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: