Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8707 Implement an async pure c++ HDFS client
  3. HDFS-9144

Refactor libhdfs into stateful/ephemeral objects

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: HDFS-8707
    • Fix Version/s: None
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      In discussion for other efforts, we decided that we should separate several concerns:

      • A posix-like FileSystem/FileHandle object (stream-based, positional reads)
      • An ephemeral ReadOperation object that holds the state for reads-in-progress, which consumes
      • An immutable FileInfo object which holds the block map and file size (and other metadata about the file that we assume will not change over the life of the file)

        Attachments

        1. HDFS-9144.HDFS-8707.001.patch
          15 kB
          Bob Hansen
        2. HDFS-9144.HDFS-8707.002.patch
          128 kB
          Bob Hansen
        3. HDFS-9144.HDFS-8707.003.patch
          126 kB
          Bob Hansen
        4. HDFS-9144.HDFS-8707.004.patch
          141 kB
          Bob Hansen
        5. HDFS-9144.HDFS-8707.005.patch
          144 kB
          Bob Hansen
        6. HDFS-9144.HDFS-8707.006.patch
          153 kB
          James Clampffer

          Issue Links

            Activity

              People

              • Assignee:
                bobhansen Bob Hansen
                Reporter:
                bobhansen Bob Hansen
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: