Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9806 Allow HDFS block replicas to be provided by an external storage system
  3. HDFS-12591

[READ] Implement LevelDBFileRegionFormat

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 3.1.0
    • hdfs
    • None
    • Reviewed

    Description

      The existing work for HDFS-9806 uses an implementation of the FileRegion read from a csv file. This is good for testability and diagnostic purposes, but it is not very efficient for larger systems.

      There should be a version that is similar to the TextFileRegionFormat that instead uses LevelDB.

      Attachments

        1. HDFS-12591-HDFS-9806.001.patch
          25 kB
          Ewan Higgs
        2. HDFS-12591-HDFS-9806.002.patch
          16 kB
          Virajith Jalaparti
        3. HDFS-12591-HDFS-9806.003.patch
          16 kB
          Ewan Higgs
        4. HDFS-12591-HDFS-9806.004.patch
          15 kB
          Virajith Jalaparti
        5. HDFS-12591-HDFS-9806.005.patch
          15 kB
          Virajith Jalaparti
        6. HDFS-12591-HDFS-9806.006.patch
          14 kB
          Virajith Jalaparti
        7. HDFS-12591-HDFS-9806.007.patch
          14 kB
          Christopher Douglas

        Issue Links

        depends upon

        Sub-task - The sub-task of the issue HDFS-11902 [READ] Merge BlockFormatProvider and FileRegionProvider.

        • Major - Major loss of function.
        • Resolved

        Sub-task - The sub-task of the issue HDFS-12665 [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ehiggs Ewan Higgs
            ehiggs Ewan Higgs
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment