Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4059

The history server should have a separate pluggable storage/query interface

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 2.0.0-alpha
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: mrv2
    • Labels:
      None

      Description

      The history server currently caches all parsed jobs in RAM. These jobs can be very large because of counters. It would be nice to have a pluggable interface for the cacheing and querying of the cached data so that we can play around with different implementations. Also just for cleanness of the code it would be nice to split the very large JobHistoryServer.java into a few smaller ones that are more understandable and readable.

        Attachments

        1. MR-4059.txt
          97 kB
          Robert Joseph Evans
        2. MR-4059.txt
          113 kB
          Robert Joseph Evans
        3. MR-4059.txt
          116 kB
          Robert Joseph Evans
        4. MR-4059.txt
          117 kB
          Robert Joseph Evans
        5. MR-4059.txt
          117 kB
          Robert Joseph Evans
        6. MR-4059.txt
          117 kB
          Robert Joseph Evans
        7. MR-4059.txt
          121 kB
          Robert Joseph Evans

          Issue Links

            Activity

              People

              • Assignee:
                revans2 Robert Joseph Evans
                Reporter:
                revans2 Robert Joseph Evans
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: