[PIG-5036] Remove biggish from e2e input dataset

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.17.0
• Component/s: e2e harness
• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Daniel Dai
• Created: 06/Oct/16 19:04
• Updated: 21/Jun/17 09:15
• Resolved: 02/Nov/16 21:52

Description

To reduce e2e runtime. It takes around 10 min to generate it and more time to run the tests involving the file (Rank_4, Rank_5). Actually it is not necessary, the purpose is to run multiple map and we can do that with "mapreduce.input.fileinputformat.split.maxsize" parameter.