Source changes - FishEye

Shows the 20 most recent commits for Hive.

Anoop Sharma <anoop.sharma@esgyn.com> committed 5a244d532425a6a4aff19a5cd2cd6ab637ea9b0a (20 files)
Reviews: none

Few fixes, details listed below.
-- fix an issue where multiple values inserted from a list would return
  error but each value inserted on its own would succeed.
  ex: create table ts (a timestamp);
      insert into ts values ('2017-01-01 10:10:10'), ('2018-01-01 10:10:10');

-- sometimes errors returned from child during hive inserts were not
   being returned. That has been fixed.

-- TRAFODION-2683 extension.
   added a 'p' (prune) option which would cleanse and filter unneeded
   explain output. This helps in reducing output especially
   for larger explains.
Ex:
>>explain option 'p' select * from dual;

------------------------------------------------------ PLAN SUMMARY
STATEMENT_NAME ........... NOT NAMED
STATEMENT ................ select * from dual;

------------------------------------------------------- NODE LISTING
ROOT ====================================== SEQ_NO 2 ONLY CHILD 1
DESCRIPTION
  fragment_id ............ 0
  parent_frag ............ (none)
  fragment_type .......... master
  xn_access_mode ......... read_only
  auto_query_retry ....... enabled
  embedded_arkcmp ........ used
  select_list ............ %(0)
  input_variables ........ %(0), %(0), %(0)

VALUES ==================================== SEQ_NO 1 NO CHILDREN
DESCRIPTION
  fragment_id ............ 0
  parent_frag ............ (none)
  fragment_type .......... master
  tuple_expr ............. %(0)

--- SQL operation complete.
>>

Anoop Sharma <anoop.sharma@esgyn.com> committed b21f2a946dc00ffade5d7f7e7452f3a5cdf6fd24 (11 files)
Reviews: none

removed obsolete code that used libhdfs to write to hive/text files
Traf had code to write to hive/text files using direct libhdfs
interface from C or through java interface. hive/sequence files
were added later and they are written using java interface.
libhdfs code was made obsolete a while back and is no longer used.
That code has now been removed.
Traf now uses common java interface to write to hive/text and
hive/sequence files.

Roberta Marton <rmarton@edev07.esgyn.local> committed 012d65405984358044853529184967b407c55457 (7 files)
Reviews: none

TRAFODION [2641] User who has MANAGE_STATISTICS privilege can't do update statistics on HIVE tables
TRAFODION [2175] a user should only see specific schemas/tables that he has
   privileges to
Updated the following get commands:
  get schemas (in catalog)
  get tables, indexes (in schema)
  get sequences, views (in schema, in catalog)
  get libraries, procedures, functions, table mapping functions

TRAFODION [1573] Additional GET commands for privileges
  get privileges on table
  get privileges on view
New regression test privs1/TEST125

Fixed bug: user granted MANAGE privilege does not have MANAGE sub-privs
Changed REGISTER_HIVE_OBJECT to be treated as a sub-priv under CREATE
Changed UNREGISTER_HIVE_OBJECT to be treaed as a sub-priv under DROP

Anoop Sharma <anoop.sharma@esgyn.com> committed 59926c845be4b9ee30228ed49511c6b69ba97e52 (0 files)
Reviews: none

PR-1120 [TRAFODION-2584] Add support to register hive schemas in traf MD

Anoop Sharma <anoop.sharma@esgyn.com> committed 8e67ca9e49dffc0d1ed1d5e744c9607b1155adcb (16 files)
Reviews: none

ra TRAFODION-2584 Add support to register hive schemas in traf MD
This checkin extends jira TRAFODION-2584 to add support to register
hive schemas(referred to as databases in hive) in trafodion metadata.
Until now, only hive tables and views were registered.
Registering hive schemas would allow certain operations, like
granting/revoking privileges, to be done on a hive schema/database.

Syntax to register/unregister hive schema
  -- register/unregister hive schema hive.sch;

Syntax to show registred hive schemas
  -- get hive registered schemas in catalog trafodion

"showddl schema hive.sch" will now show the ddl for hive database
creation and whether this schema is registered.

showddl and 'get tables in schema' will now return error if that
schema doesn't exist.

regress/hive/TEST007 has been extended with additional tests.

selvaganesang <selva@apache.org> committed cb0a7242eb4bdb8e40575a4caf258156f85c1963 (0 files)
Reviews: none

Merge PR 1108 [TRAFODION-2631] Disk IO counter is not populated for hdfs/hive IOs

Roberta Marton <rmarton@edev07.esgyn.local> committed 63b275d406e29bcaba1ab42e57a656bb8dd8ce31 (6 files)
Reviews: none

TRAFODION - 2632 Performing update statistics on metadata tables causes issues
Added code to return error and cleanup code a bit:
*** ERROR[9205] UPDATE STATISTICS is not supported for object <metadata table>

Also fixed a problem where privileges on Hive tables that included external
table gave false "no priv" error for the SHOWDDL <hive table> command.

selvaganesang <selva.govindarajan@esgyn.com> committed b3594b338b1a4acd3c0e2f8cb0f37482e42a4ef7 (6 files)
Anoop Sharma <anoop.sharma@esgyn.com> committed b109e2cf5883f8e763af853ab6fad7ce7110d9e8 (16 files)
Reviews: none

jira trafodion-2621, trafodion-2619 + others
-- trafodion-2621: add support to create like native hive or hbase tables
-- trafodion-2619: support to_date format 'yyyy/mm/dd'
-- alter table drop column on a table with user indexes would sometime
   fail. That has been fixed.
-- get schemas in a session where default catalog is set to hive,
   now correctly returns hive schemas
-- update stats on hive tables succeeds
-- update stats on hive view returns error as this operation
   is not supported

Liu Ming <ovis_poly@sina.com> committed ced104a79eab9ff886047f8c03b271db3335d958 (0 files)
Reviews: none

Merge Fix for [TRAFODION-2549] update sql reference manual about new hive data type

liu.yu <yu.liu@esgyn.cn> committed a5329dd3fd32618a820e0296a24e5b003eea06bd (1 file)
Reviews: none

add data-type mappings of hive and trafodion

Paul Rogers <progers@maprtech.com> committed aa39c66d92ec03c90f3715df7cc4fde49d76a334 (6 files)
Reviews: none

DRILL-5496: Fix for failed Hive connection
If the Hive server restarts, Drill either hangs or continually reports
errors when retrieving schemas. The problem is that the Hive plugin
tries to handle connection failures, but does not do so correctly for
the secure connection case. The problem is complex, see DRILL-5496 for
details.

This is a workaround: we discard the entire Hive schema cache when we
encounter an unhandled connection exception, then we rebuild a new one.

This is not a proper fix; for that we'd have to restructure the code.

This will, however, solve the immediate problem until we do the needed
restructuring.

Sandhya Sundaresan <sandhyasun@edev08.esgyn.local> committed c9c0060339a8574313497993df04569c85b64fef (1 file)
Reviews: none

Additional check in regr test env script to test for existence of ship_mode hdfs directory to decide whther to shortcut the hive setup process

selvaganesang <selva@apache.org> committed 57629a01ab4d40c987cf0640ce0b5868bca11898 (1 file)
Reviews: none

Merge [TRAFODION-2483] PR 1055 Trafodion treat '\' as NULL in hive table

Yongjun Zhang <yzhang@cloudera.com> committed 22553645fbaf8031ab7877135014fd8e09130c20 (2 files)
Yongjun Zhang <yzhang@cloudera.com> committed 31d7d470709555cbee14f0fdf59b9e15c3c02ff1 (2 files)
Reviews: none

HDFS-11689. New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code. Contributed by Yongjun Zhang.
(cherry picked from commit 5078df7be317e635615c05c5da3285798993ff1f)