Hadoop Common
  1. Hadoop Common
  2. HADOOP-4389

allow use of Torque per-job temporary directories

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Won't Fix
    • Affects Version/s: 0.18.1
    • Fix Version/s: None
    • Component/s: contrib/hod
    • Labels:
      None

      Description

      Torque can be configured to create a per-job temporary directory that will automatically be cleaned up at the completion of a Torque job. At our site, we are strongly encouraged to use this directory and not /tmp. The name of the per-job temp dir is in the environment variable TMPDIR in the Torque job's environment. It would be very useful for HOD to be extended so that one could write in hodrc:

      [ringmaster]
      temp-dir = $TMPDIR
      work-dirs = $TMPDIR/1

      [hodring]
      temp-dir = $TMPDIR

      such that $TMPDIR is evaluated inside the Torque job.

        Activity

        Hide
        Nigel Daley added a comment -

        hod contrib was removed

        Show
        Nigel Daley added a comment - hod contrib was removed
        Hide
        Vinod Kumar Vavilapalli added a comment -

        I think this works out of the box if $TMPDIR is available in Torque job's environment. Also, please see HADOOP-2862.

        Show
        Vinod Kumar Vavilapalli added a comment - I think this works out of the box if $TMPDIR is available in Torque job's environment. Also, please see HADOOP-2862 .

          People

          • Assignee:
            Unassigned
            Reporter:
            David Chiang
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development