[HIVE-5272] Column statistics on a invalid column name results in IndexOutOfBoundsException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.13.0
• Fix Version/s: 0.13.0
• Component/s: Statistics
• Labels: statistics
• Assignee: Prasanth Jayachandran
• Reporter: Prasanth Jayachandran
• Created: 11/Sep/13 19:12
• Updated: 28/Sep/13 11:51
• Resolved: 27/Sep/13 20:59

Description

When invalid column name is specified for column statistics IndexOutOfBoundsException is thrown.

hive> analyze table customer_staging compute statistics for columns c_first_name, invalid_name, c_customer_sk;
FAILED: IndexOutOfBoundsException Index: 2, Size: 1

If the invalid column name appears at first or last then INVALID_COLUMN_REFERENCE is thrown at query planning stage. But if the invalid column name appears somewhere in the middle of column lists then IndexOutOfBoundsException is thrown at semantic analysis step. The problem is with getTableColumnType() and getPartitionColumnType() methods. The following segment

    for (int i=0; i <numCols; i++) {
      colName = colNames.get(i);
      for (FieldSchema col: cols) {
        if (colName.equalsIgnoreCase(col.getName())) {
          colTypes.add(i, new String(col.getType()));
        }
      }
    }

is the reason for it. If the invalid column names appears in the middle of column list then the equalsIgnoreCase() skips the invalid name and increments the i. Since the list is not initialized it results in exception.