Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4059

The history server should have a separate pluggable storage/query interface

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.3, 2.0.0-alpha
    • 0.23.3, 2.0.2-alpha
    • mrv2
    • None

    Description

      The history server currently caches all parsed jobs in RAM. These jobs can be very large because of counters. It would be nice to have a pluggable interface for the cacheing and querying of the cached data so that we can play around with different implementations. Also just for cleanness of the code it would be nice to split the very large JobHistoryServer.java into a few smaller ones that are more understandable and readable.

      Attachments

        1. MR-4059.txt
          121 kB
          Robert Joseph Evans
        2. MR-4059.txt
          117 kB
          Robert Joseph Evans
        3. MR-4059.txt
          117 kB
          Robert Joseph Evans
        4. MR-4059.txt
          117 kB
          Robert Joseph Evans
        5. MR-4059.txt
          116 kB
          Robert Joseph Evans
        6. MR-4059.txt
          113 kB
          Robert Joseph Evans
        7. MR-4059.txt
          97 kB
          Robert Joseph Evans

        Issue Links

          Activity

            People

              revans2 Robert Joseph Evans
              revans2 Robert Joseph Evans
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: