Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3222

New UDFContextSignature assignments in Pig 0.11 breaks HCatalog.HCatStorer

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.11
    • None
    • impl

    Description

      Pig 0.11 assigns different UDFContextSignature for different invocations of the same load/store statement. This change breaks the HCatStorer which assumes all front-end and back-end invocations of the same store statement has the same UDFContextSignature so that it can read the previously stored information correctly.

      The related HCatalog code is in https://svn.apache.org/repos/asf/incubator/hcatalog/branches/branch-0.5/hcatalog-pig-adapter/src/main/java/org/apache/hcatalog/pig/HCatStorer.java (the setStoreLocation() function).

      Attachments

        1. hcat.trace
          14 kB
          Daniel Dai
        2. hcatstorer.trace.txt
          2 kB
          Feng Peng
        3. PigStorerDemo.java
          3 kB
          Feng Peng

        Issue Links

          Activity

            People

              Unassigned Unassigned
              pengfeng Feng Peng
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: