Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-16865 Handle replication bootstrap of large databases
  3. HIVE-16895

Multi-threaded execution of bootstrap dump of partitions

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • HiveServer2
    • None
    • Reviewed

    Description

      to allow faster execution of bootstrap dump phase we dump multiple partitions from same table simultaneously.

      even though dumping functions is not going to be a blocker, moving to similar execution modes for all metastore objects will make code more coherent.

      Bootstrap dump at db level does :

      • boostrap of all tables
        • boostrap of all partitions in a table. (scope of current jira)
      • boostrap of all functions

      Attachments

        1. HIVE-16895.1.patch
          11 kB
          Anishek Agarwal
        2. HIVE-16895.2.patch
          11 kB
          Anishek Agarwal

        Issue Links

          Activity

            People

              anishek Anishek Agarwal
              anishek Anishek Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: