Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8707 Implement an async pure c++ HDFS client
  3. HDFS-9144

Refactor libhdfs into stateful/ephemeral objects

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-8707
    • None
    • hdfs-client
    • None

    Description

      In discussion for other efforts, we decided that we should separate several concerns:

      • A posix-like FileSystem/FileHandle object (stream-based, positional reads)
      • An ephemeral ReadOperation object that holds the state for reads-in-progress, which consumes
      • An immutable FileInfo object which holds the block map and file size (and other metadata about the file that we assume will not change over the life of the file)

      Attachments

        1. HDFS-9144.HDFS-8707.006.patch
          153 kB
          James Clampffer
        2. HDFS-9144.HDFS-8707.005.patch
          144 kB
          Bob Hansen
        3. HDFS-9144.HDFS-8707.004.patch
          141 kB
          Bob Hansen
        4. HDFS-9144.HDFS-8707.003.patch
          126 kB
          Bob Hansen
        5. HDFS-9144.HDFS-8707.002.patch
          128 kB
          Bob Hansen
        6. HDFS-9144.HDFS-8707.001.patch
          15 kB
          Bob Hansen

        Issue Links

          Activity

            People

              bobhansen Bob Hansen
              bobhansen Bob Hansen
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: