[PIG-1561] XMLLoader in Piggybank does not support bz2 or gzip compressed XML files

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.0, 0.8.0
• Fix Version/s: 0.8.1
• Component/s: impl
• Hadoop Flags: Reviewed
• Assignee: Vivek Padmanabhan
• Reporter: Viraj Bhat
• Created: 24/Aug/10 00:50
• Updated: 25/Apr/11 21:27
• Resolved: 20/Jan/11 01:17

Description

I have a simple Pig script which uses the XMLLoader after the Piggybank is built.

register piggybank.jar;
A = load '/user/viraj/capacity-scheduler.xml.gz' using org.apache.pig.piggybank.storage.XMLLoader('property') as (docs:chararray);
B = limit A 1;
dump B;
--store B into '/user/viraj/handlegz' using PigStorage();

returns empty tuple

()

If you supply the uncompressed XML file, you get

(<property>
    <name>mapred.capacity-scheduler.queue.my.capacity</name>
    <value>10</value>
    <description>Percentage of the number of slots in the cluster that are
      guaranteed to be available for jobs in this queue.
    </description>    
  </property>)