Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17974

If the job resource jar already exists in the HDFS fileSystem, do not upload!

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 1.2.2
    • 1.2.3
    • Hive, Query Processor, Tez
    • None

    Description

      For Mr or tez application, if the jar resources already exists on the HDFS, the application will still upload the jars to the HDFS when it starts.I thind this is not need.
      So, if the original resource file is already on HDFS,I will record it ,and when the application starts, it will use the original file on HDFS.

      Attachments

        1. HIVE-17974-branch-1.2.patch
          5 kB
          wan kun
        2. HIVE-17974.2-branch-1.2.patch
          6 kB
          wan kun

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            wankunde wan kun Assign to me
            wankunde wan kun

            Dates

              Created:
              Updated:

              Time Tracking

              Estimated:
              Original Estimate - 168h
              168h
              Remaining:
              Remaining Estimate - 168h
              168h
              Logged:
              Time Spent - Not Specified
              Not Specified

              Slack

                Issue deployment