Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13852

hadoop build to allow hadoop version property to be explicitly set

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0-alpha1, 3.0.0-alpha2
    • 3.0.0-alpha2
    • build
    • None
    • Reviewed

    Description

      Hive (and transitively) Spark, won't start on Hadoop 3.x as the shim layer rejects Hadoop v3. As a workaround pending a Hive fix, allow the build to have the Hadoop version (currently set to pom.version) to be overridden manually.

      This will not affect version names of artifacts, merely the declared Hadoop version visible in VersionInfo.getVersion()

      Attachments

        1. HADOOP-13582-003.patch
          2 kB
          Steve Loughran
        2. HADOOP-13852-001.patch
          1 kB
          Steve Loughran
        3. HADOOP-13852-002.patch
          2 kB
          Steve Loughran
        4. HADOOP-13852-003.patch
          4 kB
          Mingliang Liu

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-13913 maven issuing pom.version being deprecation warnings

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          incorporates

          Improvement - An improvement or enhancement to an existing feature or task. YARN-5989 hadoop build to allow hadoop version property to be explicitly set (YARN test)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-13345 S3Guard: Improved Consistency for S3A

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue SPARK-18673 Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: