Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6374

Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.11.0, 0.12.0, 0.13.0
    • 0.14.0
    • CLI
    • None
    • Any

    Description

      Create table/index/database and add partition DDL doesn't work properly if all following conditions are true:

      • Metastore service is used
      • fs.default.name is specified and it differs from the default one
      • Location is not specified or specified as a not fully qualified URI

      The root cause of this behavior is that Hive client doesn't pass configuration context to the metastore services which tries to resolve the paths. The fix is it too resolve the path in the Hive client if fs.default.name is specified and it differs from the default one (it is must easier then start passing the context, which would be a major change).

      The CR will submitted shortly after tests are done

      Attachments

        1. Design of the fix HIVE-6374.docx
          16 kB
          Benjamin Zhitomirsky
        2. hive-6374.patch
          22 kB
          Benjamin Zhitomirsky
        3. hive-6374.1.patch
          22 kB
          Benjamin Zhitomirsky
        4. hive-6374.3.patch
          22 kB
          Benjamin Zhitomirsky

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            benjzh Benjamin Zhitomirsky Assign to me
            benjzh Benjamin Zhitomirsky
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 168h
              168h
              Remaining:
              Remaining Estimate - 168h
              168h
              Logged:
              Time Spent - Not Specified
              Not Specified

              Slack

                Issue deployment