Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13925

ETL optimizations

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Click to add description

      Attachments

        Issue Links

        is related to

        Sub-task - The sub-task of the issue HIVE-13984 Use multi-threaded approach to listing files for msck

        • Major - Major loss of function.
        • Closed

        Sub-task - The sub-task of the issue HIVE-13901 Hivemetastore add partitions can be slow depending on filesystems

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-14128 Parallelize jobClose phases

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-14204 Optimize loading dynamic partitions

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-14323 Reduce number of FS permissions and redundant FS operations

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-14129 Execute move tasks in parallel

        • Major - Major loss of function.
        • Patch Available
        relates to

        Sub-task - The sub-task of the issue HIVE-13922 Optimize the code path that analyzes/updates col stats

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-13788 hive msck listpartitions need to make use of directSQL instead of datanucleus

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-14803 S3: Stats gathering for insert queries can be expensive for partitioned dataset

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-14828 Cloud/S3: Stats publishing should be on HDFS instead of S3

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-13799 Optimize TableScanRule::checkBucketedTable

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-14423 S3: Fetching partition sizes from FS can be expensive when stats are not available in metastore

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-14462 Reduce number of partition check calls in add_partitions

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-15250 Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            abhisolanki94 Abhishek Assign to me
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment