Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4389

allow use of Torque per-job temporary directories

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 0.18.1
    • Fix Version/s: None
    • Component/s: contrib/hod
    • Labels:
      None

      Description

      Torque can be configured to create a per-job temporary directory that will automatically be cleaned up at the completion of a Torque job. At our site, we are strongly encouraged to use this directory and not /tmp. The name of the per-job temp dir is in the environment variable TMPDIR in the Torque job's environment. It would be very useful for HOD to be extended so that one could write in hodrc:

      [ringmaster]
      temp-dir = $TMPDIR
      work-dirs = $TMPDIR/1

      [hodring]
      temp-dir = $TMPDIR

      such that $TMPDIR is evaluated inside the Torque job.

        Activity

        Hide
        vinodkv Vinod Kumar Vavilapalli added a comment -

        I think this works out of the box if $TMPDIR is available in Torque job's environment. Also, please see HADOOP-2862.

        Show
        vinodkv Vinod Kumar Vavilapalli added a comment - I think this works out of the box if $TMPDIR is available in Torque job's environment. Also, please see HADOOP-2862 .
        Hide
        nidaley Nigel Daley added a comment -

        hod contrib was removed

        Show
        nidaley Nigel Daley added a comment - hod contrib was removed

          People

          • Assignee:
            Unassigned
            Reporter:
            dwchiang David Chiang
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development