Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1588

Current Bigtop Pig does not build because of API Change in Hive

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 1.0.0
    • Component/s: general
    • Labels:
      None

      Description

      Current pig does not build because of API Change in Hive.

      ByteStream.Output getCount() does not exist any more.

      compile:
           [echo]  *** Compiling Pig UDFs ***
          [javac] /net/os2-debian80/fs1/olaf/bigtop/output/pig/pig-0.12.1/contrib/piggybank/java/build.xml:94: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
          [javac] Compiling 164 source files to /net/os2-debian80/fs1/olaf/bigtop/output/pig/pig-0.12.1/contrib/piggybank/java/build/classes
          [javac] warning: [options] bootstrap class path not set in conjunction with -source 1.6
          [javac] /net/os2-debian80/fs1/olaf/bigtop/output/pig/pig-0.12.1/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/HiveColumnarStorage.java:106: error: cannot find symbol
          [javac]             colValRefs[i].set(byteStream.getData(), startPos, byteStream.getCount() - startPos);
          [javac]                                                                         ^
          [javac]   symbol:   method getCount()
          [javac]   location: variable byteStream of type Output
          [javac] /net/os2-debian80/fs1/olaf/bigtop/output/pig/pig-0.12.1/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/HiveColumnarStorage.java:107: error: cannot find symbol
          [javac]             startPos = byteStream.getCount();
          [javac]                                  ^
          [javac]   symbol:   method getCount()
          [javac]   location: variable byteStream of type Output
          [javac] Note: Some input files use or override a deprecated API.
          [javac] Note: Recompile with -Xlint:deprecation for details.
          [javac] Note: Some input files use unchecked or unsafe operations.
          [javac] Note: Recompile with -Xlint:unchecked for details.
          [javac] 2 errors
          [javac] 1 warning
      

        Activity

        Hide
        oflebbe Olaf Flebbe added a comment -

        The patch is easy: use getLength() rather getCount(), since both return the same value (but through different classes)

        I am using this to demo how to implement BIGTOP-1579

        the patch to be applied is appended

        Show
        oflebbe Olaf Flebbe added a comment - The patch is easy: use getLength() rather getCount(), since both return the same value (but through different classes) I am using this to demo how to implement BIGTOP-1579 the patch to be applied is appended
        Hide
        oflebbe Olaf Flebbe added a comment -

        The patch which has to be integrated into the gradle process

        Show
        oflebbe Olaf Flebbe added a comment - The patch which has to be integrated into the gradle process
        Hide
        cos Konstantin Boudnik added a comment -

        Olaf Flebbe, is that patch ready for the commit? Or you are planning to do it along with BIGTOP-1579?

        Show
        cos Konstantin Boudnik added a comment - Olaf Flebbe , is that patch ready for the commit? Or you are planning to do it along with BIGTOP-1579 ?
        Hide
        oflebbe Olaf Flebbe added a comment -

        Patch (Demo of BIGTOP-1579)

        Show
        oflebbe Olaf Flebbe added a comment - Patch (Demo of BIGTOP-1579 )
        Hide
        oflebbe Olaf Flebbe added a comment -

        Updated patch see BIGTOP-1579

        Show
        oflebbe Olaf Flebbe added a comment - Updated patch see BIGTOP-1579
        Hide
        warwithin YoungWoo Kim added a comment -

        Olaf,
        I submitted a patch for BIGTOP-1594 – Upgrade Pig version to 0.14.0

        Show
        warwithin YoungWoo Kim added a comment - Olaf, I submitted a patch for BIGTOP-1594 – Upgrade Pig version to 0.14.0
        Hide
        rvs Roman Shaposhnik added a comment -

        YoungWoo Kim are you saying the issues is gone with Pig 0.14? If so I'd be super exited to upgrade.

        Show
        rvs Roman Shaposhnik added a comment - YoungWoo Kim are you saying the issues is gone with Pig 0.14? If so I'd be super exited to upgrade.
        Hide
        oflebbe Olaf Flebbe added a comment -

        Yes indeed, pig-0.14 fixes this issue.

        I recommennd to apply BIGTOP-1594 (with the additional change I proposed)

        Show
        oflebbe Olaf Flebbe added a comment - Yes indeed, pig-0.14 fixes this issue. I recommennd to apply BIGTOP-1594 (with the additional change I proposed)
        Hide
        oflebbe Olaf Flebbe added a comment -

        I am closing this issue an propose to apply BIGTOP-1594 instead

        Show
        oflebbe Olaf Flebbe added a comment - I am closing this issue an propose to apply BIGTOP-1594 instead

          People

          • Assignee:
            oflebbe Olaf Flebbe
            Reporter:
            oflebbe Olaf Flebbe
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development