Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance
  3. HADOOP-13162

Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • fs/s3
    • None

    Description

      getFileStatus is relatively expensive call and mkdirs invokes it multiple times depending on how deep the directory structure is. It would be good to reduce the number of getFileStatus calls in such cases.

      Attachments

        1. HADOOP-13162.001.patch
          3 kB
          Rajesh Balamohan
        2. HADOOP-13162-branch-2-002.patch
          3 kB
          Rajesh Balamohan
        3. HADOOP-13162-branch-2-003.patch
          5 kB
          Rajesh Balamohan
        4. HADOOP-13162-branch-2-004.patch
          5 kB
          Rajesh Balamohan

        Activity

          People

            rajesh.balamohan Rajesh Balamohan
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: