Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8649

ChecksumFileSystem should have an overriding implementation of listStatus(Path, PathFilter) for improved performance

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 1.0.3, 2.0.0-alpha
    • None
    • None
    • None

    Description

      Currently, ChecksumFileSystem implements only listStatus(Path).

      The other form of listStatus(Path, customFilter) results in parsing the list twice to apply each of the filters - custom and checksum filter.

      By using a composite filter instead, we limit the parsing to once.

      Attachments

        1. branch1-HADOOP-8649.patch
          9 kB
          Karthik Kambatla
        2. branch1-HADOOP-8649.patch
          9 kB
          Karthik Kambatla
        3. HADOOP-8649_branch1.patch
          9 kB
          Karthik Kambatla
        4. HADOOP-8649_branch1.patch
          5 kB
          Karthik Kambatla
        5. HADOOP-8649_branch1.patch_v2
          6 kB
          Karthik Kambatla
        6. HADOOP-8649_branch1.patch_v3
          7 kB
          Karthik Kambatla
        7. TestChecksumFileSystemOnDFS.java
          2 kB
          Karthik Kambatla
        8. trunk-HADOOP-8649.patch
          8 kB
          Karthik Kambatla
        9. trunk-HADOOP-8649.patch
          8 kB
          Karthik Kambatla

        Activity

          People

            kasha Karthik Kambatla
            kasha Karthik Kambatla
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: