Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6875

[Herriot] Cleanup of temp. configurations is needed upon restart of a cluster

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.21.0
    • 0.21.0
    • test
    • None
    • Reviewed
    • herriot

    Description

      1. New configuration directory is not cleaning up after resetting to default configuration directory in a pushconfig functionality. Because of this reason, it's giving permission denied problem for a folder, if other user tried running the tests in the same cluster with pushconfig functionality. I could see this issue while running the tests on a cluster with security enabled and different user.

      I have added the functionality for above issue and attaching the patch

      2. Throwing IOException and it says token is expired while running the tests. I could see this issue in a secure cluster.

      This issue has been resolved by setting the following attribute in the configuration.

      mapreduce.job.complete.cancel.delegation.tokens=false

      adding/updating this attribute in the push configuration functionality while creating the new configuration.

      Attachments

        1. 1913-ydist-security.patch
          2 kB
          Vinay Kumar Thota
        2. MAPREDUCE-1913.patch
          1 kB
          Vinay Kumar Thota
        3. HADOOP-6875.patch
          2 kB
          Vinay Kumar Thota
        4. 6875-ydist-security.patch
          1 kB
          Vinay Kumar Thota
        5. 6875-ydist-security.patch
          1 kB
          Vinay Kumar Thota
        6. HADOOP-6875.patch
          0.8 kB
          Vinay Kumar Thota

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vinaythota Vinay Kumar Thota
            vinaythota Vinay Kumar Thota
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment