[HADOOP-4183] select * to console issues in Hive

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.19.0
• Assignee: Unassigned
• Reporter: Joydeep Sen Sarma
• Created: 16/Sep/08 07:24
• Updated: 08/Jul/09 17:06
• Resolved: 21/Oct/08 18:56

Description

the biggest problem is that select * is assuming that the output is a regular text file. it can't read out from compressed text files. (which is what happens when we start using the output compression options).

the core issue is that select * is special code. and it should not be. it should go through the same 'fileinputformat' and serde code that any map-side task goes through.

the second issue is that a select * without any data transformations/filters goes through a map-reduce task unnecessarily. we need to fix this. this seems related to the limit N jira that ashish opened. (see hadoop-4086)

Issue Links

• is related to: HADOOP-4086 Add limit to Hive QL