Description
In profile, we have two lines for query options, e.g.
Query Options (set by configuration): TIMEZONE=PRC,CLIENT_IDENTIFIER=impala shell build version not available Query Options (set by configuration and planner): MT_DOP=0,TIMEZONE=PRC,CLIENT_IDENTIFIER=impala shell build version not available,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE
However, in a query failed in planning, the query options are missing. E.g. the following query failed:
set EXPAND_COMPLEX_TYPES=1; select nested_struct.* from functional_orc_def.complextypestbl; ERROR: AnalysisException: Struct containing a collection type is not allowed in the select list.
The query options are missing in the profile:
Query (id=de4937a73a52641e:c6a4222d00000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Summary: Session ID: 17460c7881ecd021:371c407cc4ef018b Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2023-02-06 16:44:55.964666000 End Time: 2023-02-06 16:44:56.041596000 Query Type: N/A Query State: EXCEPTION Impala Query State: ERROR Query Status: AnalysisException: Struct containing a collection type is not allowed in the select list. Impala Version: impalad version 4.3.0-SNAPSHOT DEBUG (build cda41146902dfebd101b5906c031f562e3094889) User: quanlong Connected User: quanlong Delegated User: Network Address: 127.0.0.1:58814 Default Db: default Sql Statement: select nested_struct.* from functional_orc_def.complextypestbl Coordinator: quanlong-OptiPlex-BJ:27000 Query Timeline: 76.911ms - Query submitted: 76.643us (76.643us) - Unregister query: 76.911ms (76.835ms) - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns Frontend: - InactiveTotalTime: 0.000ns - TotalTime: 0.000ns
Query options are important in reproducing an issue. We should log them in profile for all cases.