[IMPALA-3047] impala-cdh5.7.0-non-partitioned-hash-and-aggs failing due to select query querying nested types

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.5.0
• Fix Version/s: Impala 2.5.0
• Component/s: Infrastructure
• Labels: broken-build
• Target Version: Impala 2.5.0
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 21/Feb/16 18:57
• Updated: 24/Feb/16 04:28
• Resolved: 24/Feb/16 04:28

Description

A test was added that involved querying nested types, which broke the impala-cdh5.7.0-non-partitioned-hash-and-aggs build.

-- executing against localhost:21000
create table ddl_test_db.struct_keywords (
  s struct<table:int,`comment`:string,`select`:decimal(8,2)>,
  a array<struct<`replace`:boolean,`location`:varchar(10)>>,
  m map<string,struct<`fields`:int,from:timestamp>>
)
partitioned by (year int, month int);

-- executing against localhost:21000

describe ddl_test_db.struct_keywords;

-- executing against localhost:21000
select
  s.`table`, s.`comment`, s.`select`,
  a.`replace`, a.`location`,
  m.key, m.`fields`, m.`from`,
  year, month
from ddl_test_db.struct_keywords t, t.a, t.m;

Took 2 min 50 sec.
add description
Error Message

ImpalaBeeswaxException: ImpalaBeeswaxException:  Query aborted: Query referencing nested types is not supported because the --enable_partitioned_hash_join and/or --enable_partitioned_aggregation Impala Daemon start-up flags are set to false. To enable nested types support please set those flags to true (they are enabled by default).

Stacktrace

metadata/test_ddl.py:220: in test_create_table
    multiple_impalad=self._use_multiple_impalad(vector))
common/impala_test_suite.py:256: in run_test_case
    result = self.__execute_query(target_impalad_client, query, user=user)
common/impala_test_suite.py:451: in __execute_query
    return impalad_client.execute(query, user=user)
common/impala_connection.py:161: in execute
    return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:163: in execute
    handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:329: in __execute_query
    self.wait_for_completion(handle)
beeswax/impala_beeswax.py:349: in wait_for_completion
    raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
E   ImpalaBeeswaxException: ImpalaBeeswaxException:
E    Query aborted:
E   Query referencing nested types is not supported because the --enable_partitioned_hash_join and/or --enable_partitioned_aggregation Impala Daemon start-up flags are set to false.
E   To enable nested types support please set those flags to true (they are enabled by default).

Issue Links

• duplicates: IMPALA-2820 Impala does not support reserved words in complex types