Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1895

Finish implementing MetaStore file system abstraction layer (MetaStoreFS and HiveMetaStoreFSImpl)

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.7.0
    • Fix Version/s: None
    • Component/s: Metastore
    • Labels:
      None

      Description

      HIVE-1881 added MetaStoreFS which is a pluggable extension point for
      altering how the MetaStore interacts with the warehouse file system. This
      interface needs to be extended so that it is possible to route all MetaStore
      interaction with the warehouse file system through an implementation of this
      interface.

      The other problem I see is that the MetaStoreFS interface that this patch added is incomplete -
      it only defines a deleteDir() method. What about createDir(), isDir(), etc? It seems like any MetaStore
      code that directly references Hadoop's FileSystem class needs to get moved into HiveMetaStoreFsImpl.

      I don't think this needs to be done right away, but the problem with waiting is that any changes to MetaStoreFS
      will break classes that implement older versions of that interface. Since MetaStoreFS is a public API we
      need to get this done before it appears in an official release.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                cwsteinbach Carl Steinbach
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: