[METRON-381] Add support for multiple reducers in pcap_query.sh

• Type: New Feature
• Status: Done
• Priority: Major
• Resolution: Done
• Fix Version/s: 0.2.1BETA
• Assignee: Casey Stella
• Reporter: Casey Stella
• Created: 19/Aug/16 00:14
• Updated: 27/Sep/16 15:04
• Resolved: 27/Sep/16 14:07

Description

As a stopgap, the pcap_query.sh MapReduce job uses a single reducer to ensure that the packets captured come in the correct order. This has issues on large queries because it forces all of the data to go through one reducer. Instead, we should have a custom partitioner that will allow us to use multiple reducers.

Issue Links

• links to: GitHub Pull Request #217