Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12979

IOE in S3a: ${hadoop.tmp.dir}/s3a not configured

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0
    • Component/s: None
    • Labels:
      None

      Description

      Running some spark s3a tests trigger an NPE in Hadoop <=2/7l IOE in 2.8 saying

      ${hadoop.tmp.dir}/s3a not configured.
      

      That's correct: there is no configuration option on the conf called

      ${hadoop.tmp.dir}/s3a
      

      There may be one called hadoop.tmp.dir, however.

      Essentially s3a is sending the wrong config option down, if it can't find fs.s3a.buffer.dir

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                1 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: