Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-2869

CassandraStorage does not function properly when used multiple times in a single pig script due to UDFContext sharing issues

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Fix Version/s: 0.7.9, 0.8.2
    • Component/s: None
    • Labels:
      None

      Description

      CassandraStorage appears to have threading issues along the lines of those described at http://pig.markmail.org/message/oz7oz2x2dwp66eoz due to the sharing of the UDFContext.

      I believe the fix lies in implementing

      public void setStoreFuncUDFContextSignature(String signature)
          {
          }
      

      and then using that signature when getting the UDFContext.

      From the Pig manual:

      setStoreFunc!UDFContextSignature(): This method will be called by Pig both in the front end and back end to pass a unique signature to the Storer. The signature can be used to store into the UDFContext any information which the Storer needs to store between various method invocations in the front end and back end. The default implementation in StoreFunc has an empty body. This method will be called before other methods.

        Attachments

        1. 2869-2.txt
          5 kB
          Jeremy Hanna
        2. 2869.txt
          4 kB
          Jeremy Hanna

          Activity

            People

            • Assignee:
              jeromatron Jeremy Hanna
              Reporter:
              gsingers Grant Ingersoll
              Reviewer:
              Brandon Williams
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: