Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4112

Got ArrayOutOfBound exception while analyzing the job history

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.19.0
    • 0.19.0
    • None
    • None
    • Reviewed

    Description

      HADOOP-3150 introduced 2 new type of tasks called the cleanup tasks. These are logged to history either as map tasks or reduce tasks. The number of maps/reducers is also logged to history. Since the number of maps will be less than the total number of map tasks logged to history (actual num maps + cleanup tasks), I think thats the reason for this exception. The important question is to investigate the effect of HADOOP-3150 on job history and code related to it.

      Attachments

        1. patch-4112.txt
          21 kB
          Amareshwari Sriramadasu
        2. patch-4112.txt
          20 kB
          Amareshwari Sriramadasu
        3. patch-4112.txt
          29 kB
          Amareshwari Sriramadasu
        4. patch-4112.txt
          35 kB
          Amareshwari Sriramadasu

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            amareshwari Amareshwari Sriramadasu
            amar_kamat Amar Kamat
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment