[PIG-4901] To use Multistorage for each Group

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.11.1, 0.16.0
• Fix Version/s: 0.17.0
• Component/s: piggybank

Environment

Hadoop 1.2.0

• Hadoop Flags: Reviewed
• Assignee: Ádám Szita
• Reporter: Divya
• Created: 20/May/16 15:37
• Updated: 21/Jun/17 09:15
• Resolved: 01/Dec/16 21:19

Description

I am trying to group my data and store in hdfs with a folder for each 'name' and subfolders for each 'YearMonth' under each name folder.

Input:
(Date) (name) (col3) (col4)
2015-02-02 abc y z
2016-01-02 xyz i j
2015-03-02 abc f b
2015-02-06 abc y z
2016-03-02 xyz a q

Expected out in hdfs:
abc folder
->201502 subfolder
2015-02-02 abc y z
2015-02-06 abc y z
->201503 subfolder
2015-03-02 abc f b
xyz folder
->201601
2016-01-02 xyz i j
->201603
2016-03-02 xyz a q

I am not sure of how to use the Multistorage option on Name column after grouping the tuples by date.

Any help is appreciated.