Uploaded image for project: 'Hive'

Hive

Source changes - FishEye

Shows the 20 most recent commits for Hive.

Anoop Sharma <anoop.sharma@esgyn.com> committed b109e2cf5883f8e763af853ab6fad7ce7110d9e8 (16 files)
Reviews: none

jira trafodion-2621, trafodion-2619 + others
-- trafodion-2621: add support to create like native hive or hbase tables
-- trafodion-2619: support to_date format 'yyyy/mm/dd'
-- alter table drop column on a table with user indexes would sometime
   fail. That has been fixed.
-- get schemas in a session where default catalog is set to hive,
   now correctly returns hive schemas
-- update stats on hive tables succeeds
-- update stats on hive view returns error as this operation
   is not supported

Liu Ming <ovis_poly@sina.com> committed ced104a79eab9ff886047f8c03b271db3335d958 (0 files)
Reviews: none

Merge Fix for [TRAFODION-2549] update sql reference manual about new hive data type

liu.yu <yu.liu@esgyn.cn> committed a5329dd3fd32618a820e0296a24e5b003eea06bd (1 file)
Reviews: none

add data-type mappings of hive and trafodion

Paul Rogers <progers@maprtech.com> committed aa39c66d92ec03c90f3715df7cc4fde49d76a334 (6 files)
Reviews: none

DRILL-5496: Fix for failed Hive connection
If the Hive server restarts, Drill either hangs or continually reports
errors when retrieving schemas. The problem is that the Hive plugin
tries to handle connection failures, but does not do so correctly for
the secure connection case. The problem is complex, see DRILL-5496 for
details.

This is a workaround: we discard the entire Hive schema cache when we
encounter an unhandled connection exception, then we rebuild a new one.

This is not a proper fix; for that we'd have to restructure the code.

This will, however, solve the immediate problem until we do the needed
restructuring.

Sandhya Sundaresan <sandhyasun@edev08.esgyn.local> committed c9c0060339a8574313497993df04569c85b64fef (1 file)
Reviews: none

Additional check in regr test env script to test for existence of ship_mode hdfs directory to decide whther to shortcut the hive setup process

selvaganesang <selva@apache.org> committed 57629a01ab4d40c987cf0640ce0b5868bca11898 (1 file)
Reviews: none

Merge [TRAFODION-2483] PR 1055 Trafodion treat '\' as NULL in hive table

Yongjun Zhang <yzhang@cloudera.com> committed 22553645fbaf8031ab7877135014fd8e09130c20 (2 files)
Yongjun Zhang <yzhang@cloudera.com> committed 31d7d470709555cbee14f0fdf59b9e15c3c02ff1 (2 files)
Reviews: none

HDFS-11689. New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code. Contributed by Yongjun Zhang.
(cherry picked from commit 5078df7be317e635615c05c5da3285798993ff1f)

Yongjun Zhang <yzhang@cloudera.com> committed 5078df7be317e635615c05c5da3285798993ff1f (2 files)
Yongjun Zhang <yzhang@cloudera.com> committed c6493df088e34a2a27f2b504bb3579b7ead9b9e9 (2 files)
Reviews: none

HDFS-11689. New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code. Contributed by Yongjun Zhang.
(cherry picked from commit 5078df7be317e635615c05c5da3285798993ff1f)

Yongjun Zhang <yzhang@cloudera.com> committed c88e5e1836103d7abc6cdb40588bce8d245c897c (2 files)
Reviews: none

HDFS-11689. New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code. Contributed by Yongjun Zhang.
(cherry picked from commit 5078df7be317e635615c05c5da3285798993ff1f)

Anoop Sharma <anoop.sharma@esgyn.com> committed 2b345cb0b7094a220e7eb8df0ccb552cec381437 (1 file)
Reviews: none

fixed an issue related to hive register command

Anoop Sharma <anoop.sharma@esgyn.com> committed a7148eb1e79e181c0a8ab4d9bfd60bf457d1dd6c (26 files)
Reviews: none

JIRA 2485,2540,2582,2591, plus other bug fixes
[TRAFODION-2485] Add support for REVERSE function
     (OperTypeEnum.h, exp/*, sqlparser.y,
      BindItemExpr.cpp, ItemExpr.cpp, SynthType.cpp,
      GenItemFunc.cpp)

[TRAFODION-2540] Alter Drop column on table with identity
                 "generated always" fails
                 (file CmpSeabaseDDLtable.cpp)

[TRAFODION-2582] "timestamp - timestamp" returns "days" instead of "seconds"
                 (file: BindItemExpr.cpp)

[TRAFODION-2591] Create index on added column returns incorrect results.
                 (file generator/GenRelScan.cpp)

Bug: Invalid "set transaction" stmt syntax no longer causes assertion failure
              or abend. An error is issued instead.
                 (file BindRelExpr.cpp)

Bug: Hive inserts with mismatched tgt/src datatypes would sometimes do not
     insert or insert incorrect values.
                 (file GenFastTransport.cpp)

Bug: an error indication is now returned if buildEncodeTree method is
    called to encode a "NULL" value for a non-null column.
                  (file EncodedKeyValue.cpp)

hive/TEST007 now does initialize auth and register user

Anoop Sharma <anoop.sharma@esgyn.com> committed f894c3f10748f319e32290f9be834569d7a0e7b0 (3 files)
Reviews: none

Merge [TRAFODION-2584] PR-1066 Add support to register hive objects in traf metadata

Anoop Sharma <anoop.sharma@esgyn.com> committed 9c58649f930a799f03a2703d012371e4e66fa1a2 (53 files)
Reviews: none

[TRAFODION-2584] Add support to register hive objects in traf metadata
Syntax:
  register hive table/view [if not exists] <object-name> [cascade]
  unregister hive table/view [if exists] <object-name> [cascade]
  cascade option: register/unregister all underlying objects that are
                  part of the specified view

update statistics, grant/revoke, traf views or external table creation
on hive objects will automatically and internally register those objects
in trafodion metadata.

invoke/showddl will show if this object is registered and whether
that registration was internal or explicit.

Get command extensions:
  get hive registered tables/view/objects in catalog trafodion;
  get hive external tables in catalog trafodion;

Cleanup command extensions:
  cleanup metadata command will clean up inconsistent hive objects
   (underlying hive object is missing but object is registered or
    an external table exists)

   cleanup [hive table | hive view] on <object-name>;

Existing hive objects that had implicit or explicit external tables
created prior to this checkin will have no change in behavior.
ObjectUID of those external tables will continue to be used for
relevant operations.
One can drop those external tables and explicitly register them,
or a subsequent operation(upd stats, grant, etc) that needs objectUID will
automatically register them.

minor changes based on review comments of previous checkin

get all objects command on hive metadata no longer fails.
get views on objects return 3-part name that could be used to
  differentiate between a traf and hive view.

regress/hive/TEST007 has been extended.

TBD: Add register/unregister privileges

Andy Yang <yongfeng.yang@esgyn.cn> committed af1652d5f50836d0524aab33186d97ffc85e0a47 (1 file)
Reviews: none

[TRAFODION-2483] Trafodion treat '\' as NULL in hive table