Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We should add more on how to go about diagnosing s3a auth problems.

      When it happens, the need to keep the credentials secret makes it hard to automate diagnostics; we can at least provide a better runbook for users

      1. HADOOP-13540-001.patch
        3 kB
        Steve Loughran
      2. HADOOP-13540-branch-2-002.patch
        6 kB
        Steve Loughran
      3. HADOOP-13540-branch-2-003.patch
        5 kB
        Steve Loughran
      4. HADOOP-13540-branch-2-004.patch
        6 kB
        Steve Loughran

        Activity

        Hide
        stevel@apache.org Steve Loughran added a comment -

        Patch 001; text emphasising common problems and a sequence of steps to try and diagnose things

        Show
        stevel@apache.org Steve Loughran added a comment - Patch 001; text emphasising common problems and a sequence of steps to try and diagnose things
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 17s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 mvninstall 6m 39s trunk passed
        +1 mvnsite 0m 23s trunk passed
        +1 mvnsite 0m 21s the patch passed
        -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
        +1 asflicense 0m 15s The patch does not generate ASF License warnings.
        8m 16s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825263/HADOOP-13540-001.patch
        JIRA Issue HADOOP-13540
        Optional Tests asflicense mvnsite
        uname Linux 44e21a9cb6e5 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 092b4d5
        whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/10358/artifact/patchprocess/whitespace-eol.txt
        modules C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10358/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 mvninstall 6m 39s trunk passed +1 mvnsite 0m 23s trunk passed +1 mvnsite 0m 21s the patch passed -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply +1 asflicense 0m 15s The patch does not generate ASF License warnings. 8m 16s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825263/HADOOP-13540-001.patch JIRA Issue HADOOP-13540 Optional Tests asflicense mvnsite uname Linux 44e21a9cb6e5 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 092b4d5 whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/10358/artifact/patchprocess/whitespace-eol.txt modules C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10358/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        fabbri Aaron Fabbri added a comment -

        Thanks for continuing to improve docs. +1 (non-binding)

        Show
        fabbri Aaron Fabbri added a comment - Thanks for continuing to improve docs. +1 (non-binding)
        Hide
        cnauroth Chris Nauroth added a comment -

        Steve Loughran, thank you for the patch. Aaron Fabbri, thank you for reviewing.

        I see one very minor fix to make in the line below. Remove one of the two spaces after "Finally," and switch "If" to lower-case.

        After that, +1 from me. That change is minor enough to make on check-in without another code review IMO.

        Finally,  If you set the environment variables, you can take advantage of S3A's
        
        Show
        cnauroth Chris Nauroth added a comment - Steve Loughran , thank you for the patch. Aaron Fabbri , thank you for reviewing. I see one very minor fix to make in the line below. Remove one of the two spaces after "Finally," and switch "If" to lower-case. After that, +1 from me. That change is minor enough to make on check-in without another code review IMO. Finally, If you set the environment variables, you can take advantage of S3A's
        Hide
        stevel@apache.org Steve Loughran added a comment -

        Got one more to add; encountered in during VM testing today

        "Clock on host too out of sync with S3 endpoint"

        symptoms. ls working, but attempts to write failing with 403. No cues from S3 about clock issues. Even Kerberos is more informative here.

        Show
        stevel@apache.org Steve Loughran added a comment - Got one more to add; encountered in during VM testing today "Clock on host too out of sync with S3 endpoint" symptoms. ls working, but attempts to write failing with 403. No cues from S3 about clock issues. Even Kerberos is more informative here.
        Hide
        stevel@apache.org Steve Loughran added a comment -

        patch 003; remove title for section I hadn't written

        Show
        stevel@apache.org Steve Loughran added a comment - patch 003; remove title for section I hadn't written
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 18s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 mvninstall 6m 34s branch-2 passed
        +1 mvnsite 0m 24s branch-2 passed
        +1 mvnsite 0m 21s the patch passed
        -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
        +1 asflicense 0m 17s The patch does not generate ASF License warnings.
        8m 18s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:b59b8b7
        JIRA Issue HADOOP-13540
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12827737/HADOOP-13540-branch-2-003.patch
        Optional Tests asflicense mvnsite
        uname Linux 955d8d0dbe66 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2 / 72ea641
        whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/10469/artifact/patchprocess/whitespace-eol.txt
        modules C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10469/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 mvninstall 6m 34s branch-2 passed +1 mvnsite 0m 24s branch-2 passed +1 mvnsite 0m 21s the patch passed -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply +1 asflicense 0m 17s The patch does not generate ASF License warnings. 8m 18s Subsystem Report/Notes Docker Image:yetus/hadoop:b59b8b7 JIRA Issue HADOOP-13540 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12827737/HADOOP-13540-branch-2-003.patch Optional Tests asflicense mvnsite uname Linux 955d8d0dbe66 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2 / 72ea641 whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/10469/artifact/patchprocess/whitespace-eol.txt modules C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10469/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        stevel@apache.org Steve Loughran added a comment -

        patch 004 rearrange things a bit, improve introductory text, and pull up a mention of JVM/system config

        Show
        stevel@apache.org Steve Loughran added a comment - patch 004 rearrange things a bit, improve introductory text, and pull up a mention of JVM/system config
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 mvninstall 6m 40s branch-2 passed
        +1 mvnsite 0m 24s branch-2 passed
        +1 mvnsite 0m 21s the patch passed
        -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
        +1 asflicense 0m 17s The patch does not generate ASF License warnings.
        8m 20s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:b59b8b7
        JIRA Issue HADOOP-13540
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12827738/HADOOP-13540-branch-2-004.patch
        Optional Tests asflicense mvnsite
        uname Linux 13509eb60e6e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2 / 72ea641
        whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/10470/artifact/patchprocess/whitespace-eol.txt
        modules C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10470/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 mvninstall 6m 40s branch-2 passed +1 mvnsite 0m 24s branch-2 passed +1 mvnsite 0m 21s the patch passed -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply +1 asflicense 0m 17s The patch does not generate ASF License warnings. 8m 20s Subsystem Report/Notes Docker Image:yetus/hadoop:b59b8b7 JIRA Issue HADOOP-13540 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12827738/HADOOP-13540-branch-2-004.patch Optional Tests asflicense mvnsite uname Linux 13509eb60e6e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2 / 72ea641 whitespace https://builds.apache.org/job/PreCommit-HADOOP-Build/10470/artifact/patchprocess/whitespace-eol.txt modules C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10470/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        cnauroth Chris Nauroth added a comment -

        +1 for patch 004. Thank you, Steve.

        Show
        cnauroth Chris Nauroth added a comment - +1 for patch 004. Thank you, Steve.
        Hide
        stevel@apache.org Steve Loughran added a comment -

        committed to 2.8

        Show
        stevel@apache.org Steve Loughran added a comment - committed to 2.8
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10419 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10419/)
        HADOOP-13540 improve section on troubleshooting s3a auth problems. (stevel: rev 4b6d795f28591df7761186bc5c8d31dcd1a5a99d)

        • (edit) hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10419 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10419/ ) HADOOP-13540 improve section on troubleshooting s3a auth problems. (stevel: rev 4b6d795f28591df7761186bc5c8d31dcd1a5a99d) (edit) hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md

          People

          • Assignee:
            stevel@apache.org Steve Loughran
            Reporter:
            stevel@apache.org Steve Loughran
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development