Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1903

Not all native libs are listed as dependencies in hadoop

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.0.0, 1.1.0
    • Fix Version/s: None
    • Component/s: debian
    • Labels:
      None

      Description

      root@node2:/usr/lib/hadoop/lib/native# hadoop checknative
      15/06/17 09:26:44 WARN bzip2.Bzip2Factory: Failed to load/initialize native-bzip2 library system-native, will use pure-Java version
      15/06/17 09:26:44 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
      Native library checking:
      hadoop:  true /usr/lib/hadoop/lib/native/libhadoop.so.1.0.0
      zlib:    true /lib/x86_64-linux-gnu/libz.so.1
      snappy:  true /usr/lib/hadoop/lib/native/libsnappy.so.1
      lz4:     true revision:99
      bzip2:   false
      openssl: false Cannot load libcrypto.so (libcrypto.so: cannot open shared object file: No such file or directory)!
      

      after apt-get install libssl-dev I get

      root@node2:/usr/lib/hadoop/lib/native# hadoop checknative
      15/06/17 09:27:55 WARN bzip2.Bzip2Factory: Failed to load/initialize native-bzip2 library system-native, will use pure-Java version
      15/06/17 09:27:55 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
      Native library checking:
      hadoop:  true /usr/lib/hadoop/lib/native/libhadoop.so.1.0.0
      zlib:    true /lib/x86_64-linux-gnu/libz.so.1
      snappy:  true /usr/lib/hadoop/lib/native/libsnappy.so.1
      lz4:     true revision:99
      bzip2:   false
      openssl: true /usr/lib/x86_64-linux-gnu/libcrypto.so
      

      so at least

      {libssl-dev}

      is missing from package dependencies at debian.

      Will have to check other platforms and bzip2 as well. ( Maybe TBD in bigtop_tests)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                oflebbe Olaf Flebbe
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: