Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7295

Add support to read history files from the done directory

    XMLWordPrintableJSON

    Details

    • Type: Wish
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.9.2, 3.2.1
    • Fix Version/s: None
    • Component/s: jobhistoryserver
    • Labels:
      None

      Description

      We would like to add a configuration option that enables a history-server to read files directly from done directory, instead of moving them from intermediate to done directory.

      Current setup of mapreduce code, displays files that our moved by a history server from intermediate to done. We cannot have two servers (job cluster and static history server) doing this as it could lead to race conditions. 

      Our service wants to configure a static history server that displays jobs run on multiple clusters. We would like this server to only read from log directories.

       

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              gaurangi Gaurangi Saxena
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: