Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4112

Got ArrayOutOfBound exception while analyzing the job history

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.19.0
    • 0.19.0
    • None
    • None
    • Reviewed

    Description

      HADOOP-3150 introduced 2 new type of tasks called the cleanup tasks. These are logged to history either as map tasks or reduce tasks. The number of maps/reducers is also logged to history. Since the number of maps will be less than the total number of map tasks logged to history (actual num maps + cleanup tasks), I think thats the reason for this exception. The important question is to investigate the effect of HADOOP-3150 on job history and code related to it.

      Attachments

        1. patch-4112.txt
          21 kB
          Amareshwari Sriramadasu
        2. patch-4112.txt
          20 kB
          Amareshwari Sriramadasu
        3. patch-4112.txt
          29 kB
          Amareshwari Sriramadasu
        4. patch-4112.txt
          35 kB
          Amareshwari Sriramadasu

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-3245 Provide ability to persist running jobs (extend HADOOP-1876)

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-2165 Augment JobHistory to store tasks' userlogs

          • Major - Major loss of function.
          • Closed

          Activity

            People

              amareshwari Amareshwari Sriramadasu
              amar_kamat Amar Kamat
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: