[ZEPPELIN-1330] hive JDBC SqlCompleter takes very long time to load column/schema meta info when hive has a lot of tables

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.0
• Component/s: interpreter-auto-completion, Interpreters
• Assignee: Unassigned
• Reporter: Qiuzhuang Lian
• Created: 15/Aug/16 07:54
• Updated: 23/Jul/18 16:48
• Resolved: 23/Jul/18 16:48

Description

When use %hive, it takes very long time(at least 3 mins) to connect to HS2. As check HS2 log, we see it loads a lot of hive schema/column meta which takes long time to complete as in SqlCompleter code as follows:

public static Set<String> getDataModelMetadataCompletions(Connection connection)
throws SQLException {
Set<String> completions = new TreeSet<>();
if (null != connection)

{ getColumnNames(connection.getMetaData(), completions); getSchemaNames(connection.getMetaData(), completions); }

return completions;
}

This class seems to be for web auto-completion. However, I don't see this feature in web instead BTW.

Issue Links

• is required by: ZEPPELIN-2360 [Umbrella] Improve Note editing experience