Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3312

Pig duplicates avro records

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 0.8.1
    • 0.10.1
    • impl
    • None

    Description

      Pig will report avro records twice.

      To Reproduce:

      • Place attached files on hdfs
      • run pig
        > register lib/piggybank.jar
        > register lib/avro-1.7.4.jar
        > register lib/json-simple-1.1.jar
        > register lib/jackson-mapper-asl-1.6.0.jar
        > register lib/jackson-core-asl-1.6.0.jar
        > user_data= LOAD 'twitter.avro' using org.apache.pig.piggybank.storage.avro.AvroStorage();
        > dump user_data;

      Result:
      (miguno,Rock: Nerf paper, scissors is fine.,1366150681)
      (BlizzardCS,Works as intended. Terran is IMBA.,1366154481)
      (Test1,One Tweet,1366154490)
      (miguno,Rock: Nerf paper, scissors is fine.,1366150681)
      (BlizzardCS,Works as intended. Terran is IMBA.,1366154481)
      (Test1,One Tweet,1366154490)

      Attachments

        1. twitter.avro
          0.5 kB
          Hans Uhlig
        2. twitter.avsc
          0.5 kB
          Hans Uhlig
        3. twitter.json
          0.2 kB
          Hans Uhlig

        Activity

          People

            Unassigned Unassigned
            huhlig Hans Uhlig
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: