Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22453

Describe table unnecessarily fetches partitions

    XMLWordPrintableJSON

Details

    Description

      The simple describe table command without EXTENDED and FORMATTED (i.e., DESCRIBE table_name) fetches all partitions when no partition is specified, although it does not display partition statistics in nature.
      The command should not fetch partitions since it can take a long time for a large amount of partitions.
      For instance, in our environment, the command takes around 8 seconds for a table with 8760 (24 * 365) partitions.

      Attachments

        1. HIVE-22453.2.patch
          4 kB
          Toshihiko Uchida
        2. HIVE-22453.2.patch
          4 kB
          Toshihiko Uchida
        3. HIVE-22453.3.patch
          4 kB
          Vineet Garg
        4. HIVE-22453.4.patch
          4 kB
          Toshihiko Uchida
        5. HIVE-22453.patch
          4 kB
          Toshihiko Uchida

        Issue Links

          Activity

            People

              touchida Toshihiko Uchida
              touchida Toshihiko Uchida
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m