Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-16865 Handle replication bootstrap of large databases
  3. HIVE-16893

move replication dump related work in semantic analysis phase to execution phase using a task

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • HiveServer2
    • None
    • Reviewed

    Description

      Since we run in to the possibility of creating a large number tasks during replication bootstrap dump

      • we may not be able to hold all of them in memory for really large databases, which might not hold true once we complete HIVE-16892
      • Also a compile time lock is taken such that only one query is run in this phase which in replication bootstrap scenario is going to be a very long running task and hence moving it to execution phase will limit the lock period in compile phase.

      Attachments

        1. HIVE-16893.2.patch
          47 kB
          Anishek Agarwal
        2. HIVE-16893.3.patch
          55 kB
          Anishek Agarwal
        3. HIVE-16893.4.patch
          55 kB
          Anishek Agarwal

        Issue Links

          Activity

            People

              anishek Anishek Agarwal
              anishek Anishek Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: