[HIVE-10511] Replacing the implementation of Hive CLI using Beeline

• Type: Bug
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.10.0
• Component/s: CLI
• Assignee: Ferdinand Xu
• Reporter: Xuefu Zhang
• Created: 28/Apr/15 00:29
• Updated: 14/Feb/17 03:41

Description

Hive CLI is a legacy tool which had two main use cases:
1. a thick client for SQL on hadoop
2. a command line tool for HiveServer1.

HiveServer1 is already deprecated and removed from Hive code base, so use case #2 is out of the question. For #1, Beeline provides or is supposed to provides equal functionality, yet is implemented differently from Hive CLI.

As it has been a while that Hive community has been recommending Beeline + HS2 configuration, ideally we should deprecating Hive CLI. Because of wide use of Hive CLI, we instead propose replacing Hive CLI's implementation with Beeline plus embedded HS2 so that Hive community only needs to maintain a single code path. In this way, Hive CLI is just an alias to Beeline at either shell script level or at high code level. The goal is that no changes or minimum changes are expected from existing user scrip using Hive CLI.

This is an Umbrella JIRA covering all tasks related to this initiative. Over the last year or two, Beeline has been improved significantly to match what Hive CLI offers. Still, there may still be some gaps or deficiency to be discovered and fixed. In the meantime, we also want to make sure the enough tests are included and performance impact is identified and addressed.

Issue Links

• is related to: HIVE-10304 Add deprecation message to HiveCLI
• is related to: HIVE-6791 Support variable substition for Beeline shell command
• is related to: HIVE-11274 Support executing script file from hdfs in beeline
• relates to: HIVE-11779 Beeline-cli: Format the output of describe pretty table command in new CLI[beeline-cli branch]

Sub-Tasks

• Create tests to cover existing (supported) Hive CLI functionality: Resolved
• Measure Hive CLI's performance difference before and after implementation is switched: Resolved
• Implement hive cli options using beeline functionality: Resolved
• Update the initial script to make beeline bucked cli as default and allow user choose old hive cli by env: Resolved
• Add deprecation message to HiveCLI: Reopened
• Beeline-CLI: Implement in-place update UI for CLI compatibility: Open
• Document Beeline/CLI changes: Resolved
• Beeline-CLI: Implement CLI source command using Beeline functionality: Resolved
• CLI start script throwing error message on console: Resolved
• CLI start script throwing error message on console: Resolved
• Need to update start script changes in .cmd files: Resolved
• Support CLI specific configurations with beeline functionality: Resolved
• Quit&Exit fails ending with ';' [beeline-cli Branch]: Resolved
• Use beeline-log4j.properties for migrated CLI [beeline-cli Branch]: Resolved
• Beeline-cli: Enable precommit for beelie-cli branch: Resolved
• Beeline-cli: support hive.cli.errors.ignore in new CLI: Resolved
• BeeLine-Cli: support hive.cli.prompt in new CLI: Resolved
• BeeLine-Cli: use the same output format as old CLI in the new CLI: Resolved
• Merge master to beeline-cli branch 07/14/2015: Resolved
• Support executing script file from hdfs in new CLI [Beeline-CLI branch]: Resolved
• Support initial file option for new CLI [beeline-cli branch]: Resolved
• Avoid the double connections with 'e' option[beeline-cli branch]: Resolved
• Support HCAT command in new Hive CLI[beeline-cli branch]: Resolved
• Invoke the set command will close standard error output[beeline-cli]: Resolved
• Beeline-cli: support hive.cli.print.header in new CLI[beeline-cli branch]: Resolved
• Support hive.cli.print.current.db in new CLI[beeline-cli branch]: Resolved
• Shell command doesn't work for new CLI[Beeline-cli branch]: Resolved
• Discrepency in INSERT OVERWRITE LOCAL DIRECTORY between Beeline and CLI: Open
• nohup mode is not support for new hive cli: Resolved
• Connect command should not to be allowed from user[beeline-cli branch]: Resolved
• Merge master to beeline-cli branch 09/09/2015: Resolved
• Use the static variable from beeline instead of untils from JDBC: Resolved
• Merge beeline-cli branch to trunk: Closed
• CLI option is not updated when executing the initial files[beeline-cli]: Resolved
• Set old CLI as the default Client when using hive script: Resolved
• Address the review items on HIVE-11778: Resolved
• Merge master to beeline-cli branch 09/25/2015: Resolved
• Fix default value of USE_DEPRECATED_CLI in cli.cmd: Resolved