Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: build
    • Labels:
      None
    • Target Version/s:

      Description

      As per HADOOP-12036, the CMake infrastructure should be refactored and made common across all Hadoop components. This bug covers the migration of HDFS to the new CMake infrastructure. This change will also add support for building HDFS Native components on Solaris.

      1. HDFS-8635.002.patch
        14 kB
        Alan Burlison
      2. HDFS-8635.001.patch
        11 kB
        Alan Burlison

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #243 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/243/)
          HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48)

          • hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #243 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/243/ ) HDFS-8635 . Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48) hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2191 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2191/)
          HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2191 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2191/ ) HDFS-8635 . Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48) hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #233 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/233/)
          HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48)

          • hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #233 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/233/ ) HDFS-8635 . Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48) hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2172 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2172/)
          HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48)

          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2172 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2172/ ) HDFS-8635 . Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48) hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #245 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/245/)
          HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #245 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/245/ ) HDFS-8635 . Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #975 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/975/)
          HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48)

          • hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake
          • hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #975 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/975/ ) HDFS-8635 . Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48) hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-trunk-Commit #8098 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8098/)
          HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48)

          • hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake
          • hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-trunk-Commit #8098 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8098/ ) HDFS-8635 . Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) (cmccabe: rev 29df73dc0572cf8e450568f1d0301e8d55d64b48) hadoop-hdfs-project/hadoop-hdfs/src/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/CMakeLists.txt hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/contrib/libwebhdfs/resources/FindJansson.cmake hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/CMakeLists.txt
          Hide
          cmccabe Colin P. McCabe added a comment -

          +1. Thanks, Alan Burlison.

          Show
          cmccabe Colin P. McCabe added a comment - +1. Thanks, Alan Burlison .
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 5m 14s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 7m 30s There were no new javac warning messages.
          +1 release audit 0m 19s The applied patch does not increase the total number of release audit warnings.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 33s mvn install still works.
          +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
          +1 native 1m 10s Pre-build of native portion
          +1 hdfs tests 161m 35s Tests passed in hadoop-hdfs.
              177m 57s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12741878/HDFS-8635.002.patch
          Optional Tests javac unit
          git revision trunk / 076948d
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/11552/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/11552/testReport/
          Java 1.7.0_55
          uname Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/11552/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 5m 14s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 30s There were no new javac warning messages. +1 release audit 0m 19s The applied patch does not increase the total number of release audit warnings. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 native 1m 10s Pre-build of native portion +1 hdfs tests 161m 35s Tests passed in hadoop-hdfs.     177m 57s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12741878/HDFS-8635.002.patch Optional Tests javac unit git revision trunk / 076948d hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/11552/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/11552/testReport/ Java 1.7.0_55 uname Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/11552/console This message was automatically generated.
          Hide
          alanburlison Alan Burlison added a comment -

          Prevent unused CMake variable warning when building FUSE

          Show
          alanburlison Alan Burlison added a comment - Prevent unused CMake variable warning when building FUSE
          Hide
          alanburlison Alan Burlison added a comment -

          Patch to migrate HDFS over to the new CMake infrastructure. Requires HADOOP-12036

          Show
          alanburlison Alan Burlison added a comment - Patch to migrate HDFS over to the new CMake infrastructure. Requires HADOOP-12036
          Hide
          alanburlison Alan Burlison added a comment -

          Requires CMake infrastructure introduced by HADOOP-12036

          Show
          alanburlison Alan Burlison added a comment - Requires CMake infrastructure introduced by HADOOP-12036

            People

            • Assignee:
              alanburlison Alan Burlison
              Reporter:
              alanburlison Alan Burlison
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development