Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
  3. HADOOP-16432

Review S3A documentation to make sure it is consistent with the current codebase

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.3.0
    • Fix Version/s: None
    • Component/s: documentation, fs/s3
    • Labels:
      None

      Description

      We need to review the hadoop-aws docs and make sure that it is consistent with the current codebase

      • The performance.md doc is out of date w.r.t DDB on-demand and the threads, distcp (no -direct); maybe more.
      • We should review the assumed role doc and combine the S3 and S3Guard permissions into one list
      • the list of AWS regions is out of date (china 1 & 2, hong-kong, osaka)
      • benchmark rename performance of large & huge files
      • see if there is any current work on time-to-consistency for lists and updates

      We also need to pull up the classpath problems "don't mix JARs unless you like stack traces" as the #1 entry on the list, as its the recurrent problem downstream, someone adding a new hadoop-aws JAR to a spark installation and then complaining about CNFEs

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: