Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13925 ETL optimizations
  3. HIVE-13901

Hivemetastore add partitions can be slow depending on filesystems

    XMLWordPrintableJSON

Details

    Description

      Depending on FS, creating external tables & adding partitions can be expensive (e.g msck which adds all partitions).

      Attachments

        1. HIVE-13901.1.patch
          10 kB
          Rajesh Balamohan
        2. HIVE-13901.2.patch
          11 kB
          Rajesh Balamohan
        3. HIVE-13901.6.patch
          13 kB
          Ashutosh Chauhan
        4. HIVE-13901.7.patch
          13 kB
          Rajesh Balamohan
        5. HIVE-13901.8.patch
          13 kB
          Rajesh Balamohan
        6. HIVE-13901.9.patch
          13 kB
          Ashutosh Chauhan

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-15137 metastore add partitions background thread should use current username

          • Major - Major loss of function.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-14423 S3: Fetching partition sizes from FS can be expensive when stats are not available in metastore

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-13925 ETL optimizations

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              rajesh.balamohan Rajesh Balamohan
              rajesh.balamohan Rajesh Balamohan
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: