Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8136

Client gets and uses EC schema when reads and writes a stripping file

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-7285
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      Discussed with Uma Maheswara Rao G and [~vinayrpet], in client when reading and writing a stripping file, it can invoke a separate call to NameNode to request the EC schema associated with the EC zone where the file is in. Then the schema can be used to guide the reading and writing. Currently it uses hard-coded values.

      Optionally, as an optimization consideration, client may cache schema info per file or per zone or per schema name. We could add schema name in HdfsFileStatus for that.

      Attachments

        1. HDFS-8136.1.patch
          4 kB
          Kai Sasaki
        2. HDFS-8136.2.patch
          11 kB
          Kai Sasaki
        3. HDFS-8136.3.patch
          15 kB
          Kai Sasaki
        4. HDFS-8136.4.patch
          16 kB
          Kai Sasaki
        5. HDFS-8136.6.patch
          12 kB
          Kai Sasaki
        6. HDFS-8136.7.patch
          13 kB
          Kai Sasaki
        7. HDFS-8136-005.patch
          11 kB
          Li Bo

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kaisasak Kai Sasaki
            drankye Kai Zheng
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment