Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21948

Implement parallel processing in Pre Upgrade Tool

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 4.0.0-alpha-1
    • Transactions
    • None

    Description

      Pre Upgrade Tool scans for all databases and tables in the warehouse sequentially which can be very slow in case of lots of tables.

      Example: It took the process 8-10 hours to complete on ~500k tables.

      Attachments

        1. HIVE-21948.5.patch
          45 kB
          Krisztian Kasa
        2. HIVE-21948.4.patch
          45 kB
          Krisztian Kasa
        3. HIVE-21948.3.patch
          47 kB
          Krisztian Kasa
        4. HIVE-21948.2.patch
          47 kB
          Krisztian Kasa
        5. HIVE-21948.1.patch
          59 kB
          Krisztian Kasa

        Issue Links

          links to

          Web Link Review Board

          Activity

            People

              kkasa Krisztian Kasa
              kkasa Krisztian Kasa
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: