Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4059

The history server should have a separate pluggable storage/query interface

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.24.0, 0.23.3
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: mrv2
    • Labels:
      None

      Description

      The history server currently caches all parsed jobs in RAM. These jobs can be very large because of counters. It would be nice to have a pluggable interface for the cacheing and querying of the cached data so that we can play around with different implementations. Also just for cleanness of the code it would be nice to split the very large JobHistoryServer.java into a few smaller ones that are more understandable and readable.

      1. MR-4059.txt
        121 kB
        Robert Joseph Evans
      2. MR-4059.txt
        117 kB
        Robert Joseph Evans
      3. MR-4059.txt
        117 kB
        Robert Joseph Evans
      4. MR-4059.txt
        117 kB
        Robert Joseph Evans
      5. MR-4059.txt
        116 kB
        Robert Joseph Evans
      6. MR-4059.txt
        113 kB
        Robert Joseph Evans
      7. MR-4059.txt
        97 kB
        Robert Joseph Evans

        Issue Links

          Activity

          Robert Joseph Evans created issue -
          Robert Joseph Evans made changes -
          Field Original Value New Value
          Attachment MR-4059.txt [ 12519635 ]
          Robert Joseph Evans made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Robert Joseph Evans made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Robert Joseph Evans made changes -
          Attachment MR-4059.txt [ 12519694 ]
          Robert Joseph Evans made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Robert Joseph Evans made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Robert Joseph Evans made changes -
          Link This issue depends on MAPREDUCE-4024 [ MAPREDUCE-4024 ]
          Robert Joseph Evans made changes -
          Attachment MR-4059.txt [ 12521156 ]
          Robert Joseph Evans made changes -
          Attachment MR-4059.txt [ 12521166 ]
          Robert Joseph Evans made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Robert Joseph Evans made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Robert Joseph Evans made changes -
          Attachment MR-4059.txt [ 12521311 ]
          Robert Joseph Evans made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Robert Joseph Evans made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Robert Joseph Evans made changes -
          Attachment MR-4059.txt [ 12521964 ]
          Robert Joseph Evans made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Robert Joseph Evans made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Robert Joseph Evans made changes -
          Attachment MR-4059.txt [ 12522112 ]
          Robert Joseph Evans made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.23.3 [ 12320060 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Fix Version/s 2.0.2-alpha [ 12322471 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue depends on MAPREDUCE-4024 [ MAPREDUCE-4024 ]
          Gavin made changes -
          Link This issue depends upon MAPREDUCE-4024 [ MAPREDUCE-4024 ]

            People

            • Assignee:
              Robert Joseph Evans
              Reporter:
              Robert Joseph Evans
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development