Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8136

Client gets and uses EC schema when reads and writes a stripping file

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-7285
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      Discussed with umamaheswararao and vinayrpet, in client when reading and writing a stripping file, it can invoke a separate call to NameNode to request the EC schema associated with the EC zone where the file is in. Then the schema can be used to guide the reading and writing. Currently it uses hard-coded values.

      Optionally, as an optimization consideration, client may cache schema info per file or per zone or per schema name. We could add schema name in HdfsFileStatus for that.

      Attachments

        1. HDFS-8136.1.patch
          4 kB
          Kai Sasaki
        2. HDFS-8136.2.patch
          11 kB
          Kai Sasaki
        3. HDFS-8136.3.patch
          15 kB
          Kai Sasaki
        4. HDFS-8136.4.patch
          16 kB
          Kai Sasaki
        5. HDFS-8136.6.patch
          12 kB
          Kai Sasaki
        6. HDFS-8136.7.patch
          13 kB
          Kai Sasaki
        7. HDFS-8136-005.patch
          11 kB
          Li Bo

        Issue Links

          Activity

            People

              kaisasak Kai Sasaki
              drankye Kai Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: