Details

    • Sub-task
    • Status: Resolved
    • Blocker
    • Resolution: Cannot Reproduce
    • 3.0.0-alpha-1
    • None
    • shell
    • None

    Description

      $ JAVA_HOME=/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home ./bin/hbase shell
      WARNING: An illegal reflective access operation has occurred
      WARNING: Illegal reflective access by org.apache.hadoop.hbase.util.UnsafeAvailChecker (file:/Users/ndimiduk/repos/apache/hbase/hbase-common/target/hbase-common-3.0.0-SNAPSHOT.jar) to method java.nio.Bits.unaligned()
      WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.hbase.util.UnsafeAvailChecker
      WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
      WARNING: All illegal access operations will be denied in a future release
      HBase Shell
      Use "help" to get list of supported commands.
      Use "exit" to quit this interactive shell.
      For Reference, please visit: http://hbase.apache.org/book.html#shell
      Version 3.0.0-SNAPSHOT, rbcacc4ce939e60fd69891df6315a39aef852b567, Tue Apr 21 15:47:27 PDT 2020
      Took 0.0000 seconds                                                                                                                                                                                         
      ArgumentError: wrong number of arguments (1 for 0)
                 ` at uri:classloader:/jruby/kernel/jruby/process_manager.rb:32
                 ` at uri:classloader:/jruby/kernel/jruby/process_manager.rb:54
        initialize at /Users/ndimiduk/repos/apache/hbase/hbase-shell/src/main/ruby/irb/hirb.rb:46
             start at /Users/ndimiduk/repos/apache/hbase/bin/../bin/hirb.rb:207
            <main> at /Users/ndimiduk/repos/apache/hbase/bin/../bin/hirb.rb:219
      

      Attachments

        Activity

          janh Jan Hentschel added a comment -

          ndimiduk I tried the same on the current master, but are not able to reproduce it (see below).

          ❯ java -version
          openjdk version "11.0.2" 2019-01-15
          OpenJDK Runtime Environment 18.9 (build 11.0.2+9)
          OpenJDK 64-Bit Server VM 18.9 (build 11.0.2+9, mixed mode)
          
          ❯ bin/hbase shell
          HBase Shell
          Use "help" to get list of supported commands.
          Use "exit" to quit this interactive shell.
          For Reference, please visit: http://hbase.apache.org/book.html#shell
          Version 3.0.0-SNAPSHOT, r3781ac9dacebea38fc9f6276591c6349dc893258, Wed Apr 29 18:49:03 CEST 2020
          Took 0.0007 seconds                                                                                                                                                                                     
          Ignoring byebug-9.0.6 because its extensions are not built.  Try: gem pristine byebug --version 9.0.6
          Ignoring eventmachine-1.2.7 because its extensions are not built.  Try: gem pristine eventmachine --version 1.2.7
          Ignoring executable-hooks-1.3.2 because its extensions are not built.  Try: gem pristine executable-hooks --version 1.3.2
          Ignoring ffi-1.9.23 because its extensions are not built.  Try: gem pristine ffi --version 1.9.23
          Ignoring gem-wrappers-1.2.7 because its extensions are not built.  Try: gem pristine gem-wrappers --version 1.2.7
          Ignoring http_parser.rb-0.6.0 because its extensions are not built.  Try: gem pristine http_parser.rb --version 0.6.0
          Ignoring jaro_winkler-1.5.4 because its extensions are not built.  Try: gem pristine jaro_winkler --version 1.5.4
          Ignoring json-2.1.0 because its extensions are not built.  Try: gem pristine json --version 2.1.0
          Ignoring json-1.8.6 because its extensions are not built.  Try: gem pristine json --version 1.8.6
          Ignoring nokogiri-1.8.2 because its extensions are not built.  Try: gem pristine nokogiri --version 1.8.2
          Ignoring oga-2.15 because its extensions are not built.  Try: gem pristine oga --version 2.15
          Ignoring oga-2.14 because its extensions are not built.  Try: gem pristine oga --version 2.14
          Ignoring redcarpet-2.3.0 because its extensions are not built.  Try: gem pristine redcarpet --version 2.3.0
          Ignoring ruby-ll-2.1.2 because its extensions are not built.  Try: gem pristine ruby-ll --version 2.1.2
          Ignoring unf_ext-0.0.7.5 because its extensions are not built.  Try: gem pristine unf_ext --version 0.0.7.5
          2.3.0 :001 > create 'test', 'cf'
          2020-04-29 19:00:42,159 WARN  [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
          Created table test
          Took 1.3021 seconds                                                                                                                                                                                     
           => Hbase::Table - test 
          2.3.0 :002 > list
          TABLE                                                                                                                                                                                                               
          test                                                                                                                                                                                                                  
          1 row(s)
          Took 0.0146 seconds                                                                                                                                                                                     
           => ["test"]
          

          Am I missing something?

          janh Jan Hentschel added a comment - ndimiduk  I tried the same on the current master, but are not able to reproduce it (see below). ❯ java -version openjdk version "11.0.2" 2019-01-15 OpenJDK Runtime Environment 18.9 (build 11.0.2+9) OpenJDK 64-Bit Server VM 18.9 (build 11.0.2+9, mixed mode) ❯ bin/hbase shell HBase Shell Use "help" to get list of supported commands. Use "exit" to quit this interactive shell. For Reference, please visit: http: //hbase.apache.org/book.html#shell Version 3.0.0-SNAPSHOT, r3781ac9dacebea38fc9f6276591c6349dc893258, Wed Apr 29 18:49:03 CEST 2020 Took 0.0007 seconds                                                                                                                                                                                     Ignoring byebug-9.0.6 because its extensions are not built.  Try: gem pristine byebug --version 9.0.6 Ignoring eventmachine-1.2.7 because its extensions are not built.  Try: gem pristine eventmachine --version 1.2.7 Ignoring executable-hooks-1.3.2 because its extensions are not built.  Try: gem pristine executable-hooks --version 1.3.2 Ignoring ffi-1.9.23 because its extensions are not built.  Try: gem pristine ffi --version 1.9.23 Ignoring gem-wrappers-1.2.7 because its extensions are not built.  Try: gem pristine gem-wrappers --version 1.2.7 Ignoring http_parser.rb-0.6.0 because its extensions are not built.  Try: gem pristine http_parser.rb --version 0.6.0 Ignoring jaro_winkler-1.5.4 because its extensions are not built.  Try: gem pristine jaro_winkler --version 1.5.4 Ignoring json-2.1.0 because its extensions are not built.  Try: gem pristine json --version 2.1.0 Ignoring json-1.8.6 because its extensions are not built.  Try: gem pristine json --version 1.8.6 Ignoring nokogiri-1.8.2 because its extensions are not built.  Try: gem pristine nokogiri --version 1.8.2 Ignoring oga-2.15 because its extensions are not built.  Try: gem pristine oga --version 2.15 Ignoring oga-2.14 because its extensions are not built.  Try: gem pristine oga --version 2.14 Ignoring redcarpet-2.3.0 because its extensions are not built.  Try: gem pristine redcarpet --version 2.3.0 Ignoring ruby-ll-2.1.2 because its extensions are not built.  Try: gem pristine ruby-ll --version 2.1.2 Ignoring unf_ext-0.0.7.5 because its extensions are not built.  Try: gem pristine unf_ext --version 0.0.7.5 2.3.0 :001 > create 'test' , 'cf' 2020-04-29 19:00:42,159 WARN  [main] util.NativeCodeLoader: Unable to load native -hadoop library for your platform... using builtin-java classes where applicable Created table test Took 1.3021 seconds                                                                                                                                                                                     => Hbase::Table - test 2.3.0 :002 > list TABLE                                                                                                                                                                                                               test                                                                                                                                                                                                                  1 row(s) Took 0.0146 seconds                                                                                                                                                                                     => [ "test" ] Am I missing something?
          adityakishore Aditya Kishore added a comment -

          I am noticing the same error when attempting to run HBase Shell 1.4.12 with JDK 11.

          root@node8:~# export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
          root@node8:~# hbase shell
          OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
          WARNING: An illegal reflective access operation has occurred
          WARNING: Illegal reflective access by org.jruby.java.invokers.RubyToJavaInvoker (file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar) to method java.lang.Object.registerNatives()
          WARNING: Please consider reporting this to the maintainers of org.jruby.java.invokers.RubyToJavaInvoker
          WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
          WARNING: All illegal access operations will be denied in a future release
          ArgumentError: wrong number of arguments (0 for 1)
            method_added at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/javasupport/core_ext/object.rb:10
            method_added at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/javasupport/core_ext/object.rb:129
                 Pattern at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/java/java.util.regex.rb:2
                  (root) at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/java/java.util.regex.rb:1
                 require at org/jruby/RubyKernel.java:1062
                  (root) at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/java/java.util.regex.rb:42
                  (root) at /opt/mapr/hbase/hbase-1.4.12/bin/hirb.rb:38
          

          Works as expected with JDK 8.

          root@node8:~# export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
          root@node8:~# hbase shell
          HBase Shell
          Use "help" to get list of supported commands.
          Use "exit" to quit this interactive shell.
          Version 1.4.12.0-mapr-SNAPSHOT, rbee5e35222f5088df5ca3f7108c3b6aef261aabd, Fri May 29 07:58:04 PDT 2020
          hbase(main):001:0>
          

          Although this is with HBase version 1.4.12, I suspect the similar issue exists with 3.0.0-SNAPSHOT as well.

          janh, what is the value of $JAVA_HOME picked by HBase Shell in your environment?

          hbase(main):001:0> system 'env | grep JAVA_HOME'
          JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
          => true
          hbase(main):002:0>
          
          adityakishore Aditya Kishore added a comment - I am noticing the same error when attempting to run HBase Shell 1.4.12 with JDK 11. root@node8:~# export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64 root@node8:~# hbase shell OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.jruby.java.invokers.RubyToJavaInvoker (file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar) to method java.lang.Object.registerNatives() WARNING: Please consider reporting this to the maintainers of org.jruby.java.invokers.RubyToJavaInvoker WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release ArgumentError: wrong number of arguments (0 for 1) method_added at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/javasupport/core_ext/object.rb:10 method_added at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/javasupport/core_ext/object.rb:129 Pattern at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/java/java.util.regex.rb:2 (root) at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/java/java.util.regex.rb:1 require at org/jruby/RubyKernel.java:1062 (root) at file:/opt/mapr/hbase/hbase-1.4.12/lib/jruby-complete-1.6.8.jar!/builtin/java/java.util.regex.rb:42 (root) at /opt/mapr/hbase/hbase-1.4.12/bin/hirb.rb:38 Works as expected with JDK 8. root@node8:~# export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 root@node8:~# hbase shell HBase Shell Use "help" to get list of supported commands. Use "exit" to quit this interactive shell. Version 1.4.12.0-mapr-SNAPSHOT, rbee5e35222f5088df5ca3f7108c3b6aef261aabd, Fri May 29 07:58:04 PDT 2020 hbase(main):001:0> Although this is with HBase version 1.4.12, I suspect the similar issue exists with 3.0.0-SNAPSHOT as well. janh , what is the value of $JAVA_HOME picked by HBase Shell in your environment? hbase(main):001:0> system 'env | grep JAVA_HOME' JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 => true hbase(main):002:0>
          janh Jan Hentschel added a comment -

          adityakishore See the following output done on the recent master.

          2.3.0 :001 > system 'env | grep JAVA_HOME'
          JAVA_HOME=/Users/jan/.jenv/versions/11.0.2
           => true 
          2.3.0 :002 > create 'test', 'cf'
          2020-06-02 21:14:40,999 WARN  [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
          Created table test
          Took 1.9711 seconds                                                             
           => Hbase::Table - test 
          2.3.0 :003 > list
          TABLE                                                                           
          test                                                                            
          1 row(s)
          Took 0.0161 seconds                                                             
           => ["test"] 
          
          janh Jan Hentschel added a comment - adityakishore See the following output done on the recent master. 2.3.0 :001 > system 'env | grep JAVA_HOME' JAVA_HOME=/Users/jan/.jenv/versions/11.0.2 => true 2.3.0 :002 > create 'test' , 'cf' 2020-06-02 21:14:40,999 WARN [main] util.NativeCodeLoader: Unable to load native -hadoop library for your platform... using builtin-java classes where applicable Created table test Took 1.9711 seconds => Hbase::Table - test 2.3.0 :003 > list TABLE test 1 row(s) Took 0.0161 seconds => [ "test" ]
          ndimiduk Nick Dimiduk added a comment -

          Thanks for trying it out adityakishore. We don't support JDK11 for any version of HBase 1.x, so I'm not surprised that you find an issue. My report was focused on master branch/HBase 3.x.

          ndimiduk Nick Dimiduk added a comment - Thanks for trying it out adityakishore . We don't support JDK11 for any version of HBase 1.x, so I'm not surprised that you find an issue. My report was focused on master branch/HBase 3.x.
          GeorryHuang Zhuoyue Huang added a comment -

          Can't reproduce it

          $ JAVA_HOME=/home/georry/Develop/environment/java/openjdk-11 ./bin/hbase shell 
          WARNING: An illegal reflective access operation has occurred
          WARNING: Illegal reflective access by org.apache.hadoop.hbase.util.UnsafeAvailChecker (file:/home/georry/Develop/hbase-community-master/hbase-assembly/target/hbase-3.0.0-SNAPSHOT/lib/hbase-common-3.0.0-SNAPSHOT.jar) to method java.nio.Bits.unaligned()
          WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.hbase.util.UnsafeAvailChecker
          WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
          WARNING: All illegal access operations will be denied in a future release
          HBase Shell
          Use "help" to get list of supported commands.
          Use "exit" to quit this interactive shell.
          For Reference, please visit: http://hbase.apache.org/book.html#shell
          Version 3.0.0-SNAPSHOT, rUnknown, Mon Sep 14 21:46:14 CST 2020
          Took 0.0008 seconds                                                                                                                                                                                                              
          hbase(main):001:0> list
          TABLE                                                                                                                                                                                                                            
          2020-09-15 21:11:24,655 WARN  [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
          test1                                                                                                                                                                                                                            
          test2                                                                                                                                                                                                                            
          2 row(s)
          Took 0.6523 seconds                                                                                                                                                                                                              
          => ["test1", "test2"]
          hbase(main):002:0> quit
          
          
          
          GeorryHuang Zhuoyue Huang added a comment - Can't reproduce it $ JAVA_HOME=/home/georry/Develop/environment/java/openjdk-11 ./bin/hbase shell WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.hadoop.hbase.util.UnsafeAvailChecker (file:/home/georry/Develop/hbase-community-master/hbase-assembly/target/hbase-3.0.0-SNAPSHOT/lib/hbase-common-3.0.0-SNAPSHOT.jar) to method java.nio.Bits.unaligned() WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.hbase.util.UnsafeAvailChecker WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release HBase Shell Use "help" to get list of supported commands. Use "exit" to quit this interactive shell. For Reference, please visit: http: //hbase.apache.org/book.html#shell Version 3.0.0-SNAPSHOT, rUnknown, Mon Sep 14 21:46:14 CST 2020 Took 0.0008 seconds hbase(main):001:0> list TABLE 2020-09-15 21:11:24,655 WARN [main] util.NativeCodeLoader: Unable to load native -hadoop library for your platform... using builtin-java classes where applicable test1 test2 2 row(s) Took 0.6523 seconds => [ "test1" , "test2" ] hbase(main):002:0> quit
          ndimiduk Nick Dimiduk added a comment -

          Thanks for checking.

          ndimiduk Nick Dimiduk added a comment - Thanks for checking.

          People

            Unassigned Unassigned
            ndimiduk Nick Dimiduk
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: