Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3844

Problem in setting the childTmpDir in MapReduceChildJVM

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Duplicate
    • 0.23.0, 0.23.1
    • None
    • mrv2
    • None

    Description

      We have seen this issue during a Hive test. Where Hive tries to create a temp file using File.createTempFile(..) and it throws:

      Exception in thread "main" java.io.IOException: No such file or directory
      	at java.io.UnixFileSystem.createFileExclusively(Native Method)
      	at java.io.File.checkAndCreate(File.java:1704)
      	at java.io.File.createTempFile(File.java:1792)
      	at java.io.File.createTempFile(File.java:1828)
      	at Test.main(Test.java:13)
      

      Because it literally sees "$PWD/tmp" as the temp directory path.

      $PWD need to be evaluated before being used in setting the property "java.io.tmpdir" in MapReduceChildJVM.java.

      Attachments

        1. MAPREDUCE-3844_rev2.patch
          2 kB
          Ahmed Radwan
        2. MAPREDUCE-3844.patch
          0.9 kB
          Ahmed Radwan

        Issue Links

          Activity

            People

              ahmed.radwan Ahmed Radwan
              ahmed.radwan Ahmed Radwan
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: