Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.0
    • Fix Version/s: 2.7.0
    • Component/s: documentation
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      With the addition of a major new feature to filesystems, the filesystem specification in hadoop-common/site is now out of sync.

      This means that

      1. there's no strict specification of what it should do
      2. you can't derive tests from that specification
      3. other people trying to implement the API will have to infer what to do from the HDFS source
      4. there's no way to decide whether or not the HDFS implementation does what it is intended.
      5. without matching tests against the raw local FS, differences between the HDFS impl and the Posix standard one won't be caught until it is potentially too late to fix.

      The operation should be relatively easy to define (after a truncate, the files bytes [0...len-1] must equal the original bytes, length(file)==len, etc)

      The truncate tests already written could then be pulled up into contract tests which any filesystem implementation can run against.

        Attachments

        1. HDFS-7665.patch
          3 kB
          Konstantin Shvachko
        2. HADOOP-11579-branch-2.patch
          3 kB
          Konstantin Shvachko
        3. HADOOP-11579-01.patch
          3 kB
          Konstantin Shvachko

          Issue Links

            Activity

              People

              • Assignee:
                shv Konstantin Shvachko
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: