[PIG-662] Add a queries to pig mix that tests scalability of joins

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: tools
• Assignee: Unassigned
• Reporter: Alan Gates
• Created: 09/Feb/09 17:23
• Updated: 09/Feb/09 17:23

Description

We need to test how well our symmetric hash join scales. We need to add a couple of tests. One will test a join of data with a key that has many instances of the same value. This can be accomplished by self join the page_view data on user. For another we should join a large number of tables (say 10) together to see that we can handle many way joins. We should also consider adding one where the join has many keys (say 10 or 15) to test joins with large keys.