Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance
  3. HADOOP-13162

Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:

      Description

      getFileStatus is relatively expensive call and mkdirs invokes it multiple times depending on how deep the directory structure is. It would be good to reduce the number of getFileStatus calls in such cases.

        Attachments

        1. HADOOP-13162.001.patch
          3 kB
          Rajesh Balamohan
        2. HADOOP-13162-branch-2-002.patch
          3 kB
          Rajesh Balamohan
        3. HADOOP-13162-branch-2-003.patch
          5 kB
          Rajesh Balamohan
        4. HADOOP-13162-branch-2-004.patch
          5 kB
          Rajesh Balamohan

          Activity

            People

            • Assignee:
              rajesh.balamohan Rajesh Balamohan
              Reporter:
              rajesh.balamohan Rajesh Balamohan
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: