Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1461

Feature to instruct rumen-folder utility to skip jobs worth of specific duration

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: tools/rumen
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Added a ''-starts-after' option to Rumen's Folder utility. The time duration specified after the '-starts-after' option is an offset with respect to the submit time of the first job in the input trace. Jobs in the input trace having a submit time (relative to the first job's submit time) lesser than the specified offset will be ignored.
      Show
      Added a ''-starts-after' option to Rumen's Folder utility. The time duration specified after the '-starts-after' option is an offset with respect to the submit time of the first job in the input trace. Jobs in the input trace having a submit time (relative to the first job's submit time) lesser than the specified offset will be ignored.
    • Tags:
      rumen, folder, skip-jobs

      Description

      JSON outputs of rumen on production logs can be huge in the order of multiple GB. Rumen's folder utility helps in getting a smaller snapshot of this JSON data.
      It would be helpful to have an option in rumen-folder, wherein user can specify a duration from which rumen-folder should start processing data.

      Related JIRA link: https://issues.apache.org/jira/browse/MAPREDUCE-1295

        Attachments

        1. mapreduce-1461--2010-02-05.patch
          2 kB
          Rajesh Balamohan
        2. mapreduce-1461--2010-03-04.patch
          2 kB
          Rajesh Balamohan
        3. MR-1461-trunk.patch
          6 kB
          Rajesh Balamohan
        4. mr-1461-trunk-with-testcases.patch
          8 kB
          Rajesh Balamohan

          Activity

            People

            • Assignee:
              rajesh.balamohan Rajesh Balamohan
              Reporter:
              rajesh.balamohan Rajesh Balamohan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: