Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1341

BinStorage cannot convert DataByteArray to Chararray and results in FIELD_DISCARDED_TYPE_CONVERSION_FAILED

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.9.0
    • Component/s: impl
    • Labels:
      None

      Description

      Script reads in BinStorage data and tries to convert a column which is in DataByteArray to Chararray.

      raw = load 'sampledata' using BinStorage() as (col1,col2, col3);
      --filter out null columns
      A = filter raw by col1#'bcookie' is not null;
      
      B = foreach A generate col1#'bcookie'  as reqcolumn;
      describe B;
      --B: {regcolumn: bytearray}
      X = limit B 5;
      dump X;
      
      B = foreach A generate (chararray)col1#'bcookie'  as convertedcol;
      describe B;
      --B: {convertedcol: chararray}
      X = limit B 5;
      dump X;
      
      

      The first dump produces:

      (36co9b55onr8s)
      (36co9b55onr8s)
      (36hilul5oo1q1)
      (36hilul5oo1q1)
      (36l4cj15ooa8a)

      The second dump produces:
      ()
      ()
      ()
      ()
      ()

      It also throws an error message: FIELD_DISCARDED_TYPE_CONVERSION_FAILED 5 time(s).
      Viraj

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                alangates Alan Gates
                Reporter:
                viraj Viraj Bhat
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: