Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18644

archived partitions check is very slow

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      See ArchiveUtils.
      Does # of affected partitions x # of part keys calls to metastore.
      This can take insane amount of time for a feature that I've never seen anyone actually use.
      At the very least, we should have an API on metastore that will return list of tables with archived partitions, to be able to skip these checks after one MS call if we know that the table doesn't have any.
      Or we could remove the feature altogether

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-18643 don't check for archived partitions for ACID ops

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: