Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11777

implement an option to have single ETL strategy for multiple directories

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None

    Description

      In case of metastore footer PPD we don't want to call PPD call with all attendant SARG, MS and HBase overhead for each directory. If we wait for some time (10ms? some fraction of inputs?) we can do one call without losing overall perf.

      For now make it time based.

      Attachments

        1. HIVE-11777.01.patch
          16 kB
          Sergey Shelukhin
        2. HIVE-11777.02.patch
          16 kB
          Sergey Shelukhin
        3. HIVE-11777.03.patch
          16 kB
          Sergey Shelukhin
        4. HIVE-11777.04.patch
          17 kB
          Sergey Shelukhin
        5. HIVE-11777.05.patch
          17 kB
          Sergey Shelukhin
        6. HIVE-11777.06.patch
          25 kB
          Sergey Shelukhin
        7. HIVE-11777.patch
          17 kB
          Sergey Shelukhin

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-11675 make use of file footer PPD API in ETL strategy or separate strategy

          • Major - Major loss of function.
          • Closed
          is part of

          Sub-task - The sub-task of the issue HIVE-11500 implement file footer / splits cache in HBase metastore

          • Major - Major loss of function.
          • Open
          links to

          Web Link RB

          Activity

            People

              sershe Sergey Shelukhin
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: