Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11118

non environment variable solution for "IllegalAccessError: class com.google.protobuf.ZeroCopyLiteralByteString cannot access its superclass com.google.protobuf.LiteralByteString"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.98.2
    • 0.99.0, 0.98.4
    • mapreduce
    • None
    • Hide
      The workaround documented in HBASE-10304 for running a mapreduce job with a "fat jar" is no longer required. Such applications can be launched without adding hbase-protocol.jar to the HADOOP_CLASSPATH.
      Show
      The workaround documented in HBASE-10304 for running a mapreduce job with a "fat jar" is no longer required. Such applications can be launched without adding hbase-protocol.jar to the HADOOP_CLASSPATH.

    Description

      I am running into the problem described in https://issues.apache.org/jira/browse/HBASE-10304, while trying to use a newer version within cascading.hbase (https://github.com/cascading/cascading.hbase).

      One of the features of cascading.hbase is that you can use it from lingual (http://www.cascading.org/projects/lingual/), our SQL layer for hadoop. lingual has a notion of providers, which are fat jars that we pull down dynamically at runtime. Those jars give users the ability to talk to any system or format from SQL. They are added to the classpath programmatically before we submit jobs to a hadoop cluster.

      Since lingual does not know upfront , which providers are going to be used in a given run, the HADOOP_CLASSPATH trick proposed in the JIRA above is really clunky and breaks the ease of use we had before. No other provider requires this right now.

      It would be great to have a programmatical way to fix this, when using fat jars.

      Attachments

        1. shade_attempt.patch
          2 kB
          Nick Dimiduk
        2. HBASE-11118-0.98.patch.gz
          621 kB
          Andrew Kyle Purtell
        3. HBASE-11118-trunk.patch.gz
          626 kB
          Andrew Kyle Purtell
        4. 1118.suggested.undoing.optimization.on.clientside.txt
          65 kB
          Michael Stack
        5. 1118.suggested.undoing.optimization.on.clientside.txt
          65 kB
          Michael Stack
        6. 11118.bytestringer.txt
          102 kB
          Michael Stack
        7. 11118.098.txt
          106 kB
          Michael Stack
        8. 11118.098-0.txt
          106 kB
          Nick Dimiduk
        9. HBASE-11118-0.98.00.patch
          103 kB
          Nick Dimiduk
        10. HBASE-11118.00.patch
          107 kB
          Nick Dimiduk
        11. HBASE-11118-0.98.01.patch
          104 kB
          Nick Dimiduk
        12. HBASE-11118.01.patch
          108 kB
          Nick Dimiduk
        13. HBASE-11118-0.98.02.patch
          105 kB
          Nick Dimiduk
        14. HBASE-11118.02.patch
          108 kB
          Nick Dimiduk
        15. HBASE-11118-0.98.03.patch
          105 kB
          Nick Dimiduk
        16. HBASE-11118_master_addendum.patch
          5 kB
          Anoop Sam John
        17. HBASE-11118_0.98_addendum.patch
          3 kB
          Anoop Sam John

        Issue Links

          Activity

            People

              stack Michael Stack
              fs111 André Kelpe
              Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: