Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16441

if use -Dbundle.openssl=true, bundled with unnecessary libk5crypto.*

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.2
    • Fix Version/s: 3.3.0
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If use -Dbundle.openssl to copy the contents of the openssl.lib directory into the final tar file,
      finally bundled with unnecessary libk5crypto.*

      build log

      + bundle_native_lib true openssl.lib crypto /usr/lib64
      + declare bundleoption=true
      + declare liboption=openssl.lib
      + declare libpattern=crypto
      + declare libdir=/usr/lib64
      + echo 'Checking to bundle with:'
      + echo 'bundleoption=true, liboption=openssl.lib, pattern=crypto libdir=/usr/lib64'
      + [[ true != \t\r\u\e ]]
      + [[ -z /usr/lib64 ]]
      + [[ ! -d /usr/lib64 ]]
      + cd /usr/lib64
      + cd /home/magnum/hadoop-hdp/hadoop-common-project/hadoop-common/target/hadoop-common-3.1.1.3.1.2.3.1.0.0-78/lib/native/
      + tar xfBp -
      + tar cf - ./libcrypto.so ./libcrypto.so.10 ./libcrypto.so.1.0.2k ./libk5crypto.so ./libk5crypto.so.3 ./libk5crypto.so.3.1
      
      

       
      bundled native library list

      [magnum@0dabe9f5564d hadoop-hdp]$ ls -al hadoop-dist/target/hadoop-3.1.1.3.1.2.3.1.0.0-78/lib/native/
      total 22704
      drwxrwxr-x 3 magnum magnum    4096 Jul 22 04:22 .
      drwxrwxr-x 3 magnum magnum      20 Jul 22 04:30 ..
      drwxrwxr-x 2 magnum magnum      94 Jul 22 04:22 examples
      lrwxrwxrwx 1 magnum magnum      19 Jul  9 03:20 libcrypto.so -> libcrypto.so.1.0.2k
      lrwxrwxrwx 1 magnum magnum      19 Jul  9 03:20 libcrypto.so.10 -> libcrypto.so.1.0.2k
      -rwxr-xr-x 1 magnum magnum 2516624 Mar 12 10:12 libcrypto.so.1.0.2k
      -rw-rw-r-- 1 magnum magnum 1820202 Jul 22 04:13 libhadoop.a
      -rw-rw-r-- 1 magnum magnum 1607168 Jul 22 04:22 libhadooppipes.a
      lrwxrwxrwx 1 magnum magnum      18 Jul 22 04:13 libhadoop.so -> libhadoop.so.1.0.0
      -rwxrwxr-x 1 magnum magnum 1026006 Jul 22 04:13 libhadoop.so.1.0.0
      -rw-rw-r-- 1 magnum magnum  475720 Jul 22 04:22 libhadooputils.a
      -rw-rw-r-- 1 magnum magnum  458600 Jul 22 04:16 libhdfs.a
      lrwxrwxrwx 1 magnum magnum      16 Jul 22 04:16 libhdfs.so -> libhdfs.so.0.0.0
      -rwxrwxr-x 1 magnum magnum  286052 Jul 22 04:16 libhdfs.so.0.0.0
      -rw-r--r-- 1 magnum magnum 1393974 Jul  9 04:47 libisal.a
      -rwxr-xr-x 1 magnum magnum     915 Jul  9 04:47 libisal.la
      lrwxrwxrwx 1 magnum magnum      17 Jul  9 04:47 libisal.so -> libisal.so.2.0.27
      lrwxrwxrwx 1 magnum magnum      17 Jul  9 04:47 libisal.so.2 -> libisal.so.2.0.27
      -rwxr-xr-x 1 magnum magnum  767778 Jul  9 04:47 libisal.so.2.0.27
      ==================================================================
      lrwxrwxrwx 1 magnum magnum      18 Aug  3  2018 libk5crypto.so -> libk5crypto.so.3.1
      lrwxrwxrwx 1 magnum magnum      18 Aug  3  2018 libk5crypto.so.3 -> libk5crypto.so.3.1
      -rwxr-xr-x 1 magnum magnum  210840 May  9  2018 libk5crypto.so.3.1
      ==================================================================
      -rw-rw-r-- 1 magnum magnum 8584562 Jul 22 04:21 libnativetask.a
      lrwxrwxrwx 1 magnum magnum      22 Jul 22 04:21 libnativetask.so -> libnativetask.so.1.0.0
      -rwxrwxr-x 1 magnum magnum 3393065 Jul 22 04:21 libnativetask.so.1.0.0
      lrwxrwxrwx 1 magnum magnum      18 Jul  9 04:45 libsnappy.so -> libsnappy.so.1.1.4
      lrwxrwxrwx 1 magnum magnum      18 Jul  9 04:45 libsnappy.so.1 -> libsnappy.so.1.1.4
      -rwxr-xr-x 1 magnum magnum   23800 Jun 10  2014 libsnappy.so.1.1.4
      lrwxrwxrwx 1 magnum magnum      16 Jul  9 04:45 libzstd.so -> libzstd.so.1.4.0
      lrwxrwxrwx 1 magnum magnum      16 Jul  9 04:45 libzstd.so.1 -> libzstd.so.1.4.0
      -rwxr-xr-x 1 magnum magnum  649784 Apr 29 16:58 libzstd.so.1.4.0
      

        Attachments

        1. HADOOP-16441.001.patch
          1 kB
          KWON BYUNGCHANG
        2. HADOOP-16441.002.patch
          1 kB
          KWON BYUNGCHANG

          Activity

            People

            • Assignee:
              magnum KWON BYUNGCHANG
              Reporter:
              magnum KWON BYUNGCHANG
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: