Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-5447

HttpFS support in Ozone

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Ozone Client, Ozone Manager
    • Labels:
      None

      Description

      There are several tools out there mainly written in Python, that uses the webhdfs interface to connect to HDFS. Even there are quite a few other filesystem implementations that provide access via the same rest interface that HDFS provides.
      HUE also implements the HDFS file browser by accessing HDFS via the REST API either on the NameNodes or on HTTPFS Server instances added to the HDFS service.

      This gave the inspiration to check and experiment what is required to support a similar REST endpoint over Ozone.

      The advantage is that we can ease the migration of tools developed in-house that are using this interface of HDFS, while we can add the possibility to browse Ozone from HUE.
      There is literally no disadvantage of having such an interface, as we can implement it as a separate module which does not have any interference with the rest of the code, as the REST endpoint as with HTTPFS will use a regular Java based Ozone client to serve any requests.

        Attachments

        1. HTTPFS interface for Ozone.pdf
          43 kB
          István Fajth

          Activity

            People

            • Assignee:
              pifta István Fajth
              Reporter:
              avijayan Aravindan Vijayan
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: