Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5858 [Umbrella] MR should make use of the timeline server
  3. MAPREDUCE-6134

Add entity-level info or primary filters to facilitate job history data query

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • jobhistoryserver
    • None

    Description

      Per discussion in MAPREDUCE-5933, we may need to add some properties in the events to MR job or task entity's otherInfo or primaryFilter to support some particular query.

      For example, getting all the tasks of one MR job:

      http://localhost:8188/ws/v1/timeline/MAPREDUCE_TASK?primaryFilter=PARENT_JOB:job_1413998833197_0001

      By adding {PARENT_JOB:job_1413998833197_0001} to the primary filter of each task entity of job_1413998833197_0001 is going to significantly shorten the time to search the target task entities.

      Attachments

        Activity

          People

            Unassigned Unassigned
            zjshen Zhijie Shen
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: