Uploaded image for project: 'Apache HAWQ'
  1. Apache HAWQ
  2. HAWQ-1427

PXF JSON Profile lang3 dependency error

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0.0-incubating
    • PXF
    • None

    Description

      Issue with querying JSON data with PXF
      Getting the following error
      ```
      ERROR: remote component error (500) from '10.101.170.74:51200': type Exception report message java.lang.Exception: java.lang.NoClassDefFoundError: org/apache/commons/lang3/StringUtils description The server encountered an internal error that prevented it from fulfilling this request. exception javax.servlet.ServletException: java.lang.Exception: java.lang.NoClassDefFoundError: org/apache/commons/lang3/StringUtils (libchurl.c:897) (seg9 AYCAPSU01TS205:40000 pid=500623) (dispatcher.c:1801)
      ```
      We solved it by manually adding `/usr/local/lib/commons-lang3-3.1.jar` on Advanced pxf-public-classpath through Ambari. We were also to reproduce it internally just by following the example from the documentation (http://hdb.docs.pivotal.io/212/hawq/pxf/JsonPXF.html).
      Also noticed the libraries loaded for pxf-service are 2.6 instead:
      ```[root@hdp1 ~]# pgrep -fl pxf-service | cut -f1 -d' ' | xargs lsof -p | grep commons-lang
      java 372246 pxf mem REG 8,2 284220 1319168 /usr/hdp/2.5.0.0-1245/hadoop/lib/commons-lang-2.6.jar
      java 372246 pxf 62r REG 8,2 284220 1319168 /usr/hdp/2.5.0.0-1245/hadoop/lib/commons-lang-2.6.jar
      ```
      So for some reason PXF needs `commons-lang3-3.1.jar`?

      Attachments

        Issue Links

          Activity

            People

              shivram Shivram Mani
              shivram Shivram Mani
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: