[HIVE-75] limit does not work if applied to outer most block and it is not a query

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.3.0
• Component/s: Query Processor
• Hadoop Flags: Reviewed
• Assignee: Namit Jain
• Reporter: Namit Jain
• Created: 20/Nov/08 17:48
• Updated: 17/Dec/11 00:09
• Resolved: 20/Nov/08 23:44

Description

limit does not work if applied to outer most block and it is not a query

For eg

insert into T1 select ... from T2 limit 10;

will be executed as a map-job only.

which means that the total number of rows in T1 is bounded by 10 * number of mappers.

We need another map-reduce job to fix this or the move task needs to be modified.

For now, the simpler fix of another map-reduce job should be ok, in future we can further optimize it by modifying the move task