Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1461

Feature to instruct rumen-folder utility to skip jobs worth of specific duration

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: tools/rumen
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Added a ''-starts-after' option to Rumen's Folder utility. The time duration specified after the '-starts-after' option is an offset with respect to the submit time of the first job in the input trace. Jobs in the input trace having a submit time (relative to the first job's submit time) lesser than the specified offset will be ignored.
      Show
      Added a ''-starts-after' option to Rumen's Folder utility. The time duration specified after the '-starts-after' option is an offset with respect to the submit time of the first job in the input trace. Jobs in the input trace having a submit time (relative to the first job's submit time) lesser than the specified offset will be ignored.
    • Tags:
      rumen, folder, skip-jobs

      Description

      JSON outputs of rumen on production logs can be huge in the order of multiple GB. Rumen's folder utility helps in getting a smaller snapshot of this JSON data.
      It would be helpful to have an option in rumen-folder, wherein user can specify a duration from which rumen-folder should start processing data.

      Related JIRA link: https://issues.apache.org/jira/browse/MAPREDUCE-1295

      1. mr-1461-trunk-with-testcases.patch
        8 kB
        Rajesh Balamohan
      2. MR-1461-trunk.patch
        6 kB
        Rajesh Balamohan
      3. mapreduce-1461--2010-03-04.patch
        2 kB
        Rajesh Balamohan
      4. mapreduce-1461--2010-02-05.patch
        2 kB
        Rajesh Balamohan

        Activity

          People

          • Assignee:
            Rajesh Balamohan
            Reporter:
            Rajesh Balamohan
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development