Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11777

implement an option to have single ETL strategy for multiple directories

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None

    Description

      In case of metastore footer PPD we don't want to call PPD call with all attendant SARG, MS and HBase overhead for each directory. If we wait for some time (10ms? some fraction of inputs?) we can do one call without losing overall perf.

      For now make it time based.

      Attachments

        1. HIVE-11777.patch
          17 kB
          Sergey Shelukhin
        2. HIVE-11777.01.patch
          16 kB
          Sergey Shelukhin
        3. HIVE-11777.02.patch
          16 kB
          Sergey Shelukhin
        4. HIVE-11777.03.patch
          16 kB
          Sergey Shelukhin
        5. HIVE-11777.04.patch
          17 kB
          Sergey Shelukhin
        6. HIVE-11777.05.patch
          17 kB
          Sergey Shelukhin
        7. HIVE-11777.06.patch
          25 kB
          Sergey Shelukhin

        Issue Links

          Activity

            People

              sershe Sergey Shelukhin
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: