Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13925 ETL optimizations
  3. HIVE-13901

Hivemetastore add partitions can be slow depending on filesystems

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      Depending on FS, creating external tables & adding partitions can be expensive (e.g msck which adds all partitions).

      Attachments

        1. HIVE-13901.1.patch
          10 kB
          Rajesh Balamohan
        2. HIVE-13901.2.patch
          11 kB
          Rajesh Balamohan
        3. HIVE-13901.6.patch
          13 kB
          Ashutosh Chauhan
        4. HIVE-13901.7.patch
          13 kB
          Rajesh Balamohan
        5. HIVE-13901.8.patch
          13 kB
          Rajesh Balamohan
        6. HIVE-13901.9.patch
          13 kB
          Ashutosh Chauhan

        Issue Links

        breaks

        Bug - A problem which impairs or prevents the functions of the product. HIVE-15137 metastore add partitions background thread should use current username

        • Major - Major loss of function.
        • Closed
        is related to

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-14423 S3: Fetching partition sizes from FS can be expensive when stats are not available in metastore

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-13925 ETL optimizations

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rajesh.balamohan Rajesh Balamohan Assign to me
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment