Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1778

CompletedJobStatusStore initialization should fail if {mapred.job.tracker.persist.jobstatus.dir} is unwritable

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.22.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If

      {mapred.job.tracker.persist.jobstatus.dir} points to an unwritable location or mkdir of {mapred.job.tracker.persist.jobstatus.dir}

      fails, then CompletedJobStatusStore silently ignores the failure and disables CompletedJobStatusStore. Ideally the JobTracker should bail out early indicating a misconfiguration.

      1. mapred-1778-4.patch
        4 kB
        Krishna Ramachandran
      2. mapred-1778-3.patch
        6 kB
        Krishna Ramachandran
      3. mapred-1778-2.patch
        6 kB
        Krishna Ramachandran
      4. mapred-1778-1.patch
        6 kB
        Krishna Ramachandran
      5. mapred-1778.patch
        6 kB
        Krishna Ramachandran
      6. mapred-1778.20S-1.patch
        4 kB
        Krishna Ramachandran
      7. mapred-1778.20S.patch
        4 kB
        Krishna Ramachandran

        Activity

        Amar Kamat created issue -
        Amar Kamat made changes -
        Field Original Value New Value
        Assignee Amar Kamat [ amar_kamat ]
        Krishna Ramachandran made changes -
        Attachment mapred-1778.patch [ 12445802 ]
        Krishna Ramachandran made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Krishna Ramachandran made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Krishna Ramachandran made changes -
        Attachment mapred-1778-1.patch [ 12445821 ]
        Krishna Ramachandran made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Chris Douglas made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Krishna Ramachandran made changes -
        Attachment mapred-1778-2.patch [ 12446543 ]
        Krishna Ramachandran made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Krishna Ramachandran made changes -
        Attachment mapred-1778-3.patch [ 12446618 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Assignee Amar Kamat [ amar_kamat ] Krishna Ramachandran [ ramach ]
        Krishna Ramachandran made changes -
        Attachment mapred-1778-4.patch [ 12446825 ]
        Krishna Ramachandran made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Krishna Ramachandran made changes -
        Attachment mapred-1778.20S.patch [ 12446889 ]
        Krishna Ramachandran made changes -
        Attachment mapred-1778.20S-1.patch [ 12447100 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Konstantin Shvachko made changes -
        Fix Version/s 0.22.0 [ 12314184 ]
        Konstantin Shvachko made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Krishna Ramachandran
            Reporter:
            Amar Kamat
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development