Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11118

non environment variable solution for "IllegalAccessError: class com.google.protobuf.ZeroCopyLiteralByteString cannot access its superclass com.google.protobuf.LiteralByteString"

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.98.2
    • Fix Version/s: 0.99.0, 0.98.4
    • Component/s: mapreduce
    • Labels:
      None
    • Release Note:
      Hide
      The workaround documented in HBASE-10304 for running a mapreduce job with a "fat jar" is no longer required. Such applications can be launched without adding hbase-protocol.jar to the HADOOP_CLASSPATH.
      Show
      The workaround documented in HBASE-10304 for running a mapreduce job with a "fat jar" is no longer required. Such applications can be launched without adding hbase-protocol.jar to the HADOOP_CLASSPATH.

      Description

      I am running into the problem described in https://issues.apache.org/jira/browse/HBASE-10304, while trying to use a newer version within cascading.hbase (https://github.com/cascading/cascading.hbase).

      One of the features of cascading.hbase is that you can use it from lingual (http://www.cascading.org/projects/lingual/), our SQL layer for hadoop. lingual has a notion of providers, which are fat jars that we pull down dynamically at runtime. Those jars give users the ability to talk to any system or format from SQL. They are added to the classpath programmatically before we submit jobs to a hadoop cluster.

      Since lingual does not know upfront , which providers are going to be used in a given run, the HADOOP_CLASSPATH trick proposed in the JIRA above is really clunky and breaks the ease of use we had before. No other provider requires this right now.

      It would be great to have a programmatical way to fix this, when using fat jars.

        Attachments

        1. 11118.098.txt
          106 kB
          stack
        2. 11118.098-0.txt
          106 kB
          Nick Dimiduk
        3. 11118.bytestringer.txt
          102 kB
          stack
        4. 1118.suggested.undoing.optimization.on.clientside.txt
          65 kB
          stack
        5. 1118.suggested.undoing.optimization.on.clientside.txt
          65 kB
          stack
        6. HBASE-11118_0.98_addendum.patch
          3 kB
          Anoop Sam John
        7. HBASE-11118_master_addendum.patch
          5 kB
          Anoop Sam John
        8. HBASE-11118.00.patch
          107 kB
          Nick Dimiduk
        9. HBASE-11118.01.patch
          108 kB
          Nick Dimiduk
        10. HBASE-11118.02.patch
          108 kB
          Nick Dimiduk
        11. HBASE-11118-0.98.00.patch
          103 kB
          Nick Dimiduk
        12. HBASE-11118-0.98.01.patch
          104 kB
          Nick Dimiduk
        13. HBASE-11118-0.98.02.patch
          105 kB
          Nick Dimiduk
        14. HBASE-11118-0.98.03.patch
          105 kB
          Nick Dimiduk
        15. HBASE-11118-0.98.patch.gz
          621 kB
          Andrew Purtell
        16. HBASE-11118-trunk.patch.gz
          626 kB
          Andrew Purtell
        17. shade_attempt.patch
          2 kB
          Nick Dimiduk

          Issue Links

            Activity

              People

              • Assignee:
                stack stack
                Reporter:
                fs111 André Kelpe
              • Votes:
                0 Vote for this issue
                Watchers:
                20 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: