[HIVE-18247] Use DB auto-increment for indexes

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Hive, Metastore
• Labels: datanucleus perfomance
• Assignee: Unassigned
• Reporter: Alex Kolbasov
• Created: 07/Dec/17 22:42
• Updated: 09/Oct/18 21:02

Description

I initially noticed this problem in Apache Sentry - see SENTRY-1960. Hive has the same issue. DataNucleus uses SEQUENCE table to allocate IDs which requires raw locks on multiple tables during transactions and this creates scalability problems.

Instead DN should rely on DB auto-increment mechanisms which are much more scalable.

See SENTRY-1960 for extra details.

Issue Links

• links to: HIVE-11553