Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6374

Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.11.0, 0.12.0, 0.13.0
    • 0.14.0
    • CLI
    • None
    • Any

    Description

      Create table/index/database and add partition DDL doesn't work properly if all following conditions are true:

      • Metastore service is used
      • fs.default.name is specified and it differs from the default one
      • Location is not specified or specified as a not fully qualified URI

      The root cause of this behavior is that Hive client doesn't pass configuration context to the metastore services which tries to resolve the paths. The fix is it too resolve the path in the Hive client if fs.default.name is specified and it differs from the default one (it is must easier then start passing the context, which would be a major change).

      The CR will submitted shortly after tests are done

      Attachments

        1. Design of the fix HIVE-6374.docx
          16 kB
          Benjamin Zhitomirsky
        2. hive-6374.1.patch
          22 kB
          Benjamin Zhitomirsky
        3. hive-6374.3.patch
          22 kB
          Benjamin Zhitomirsky
        4. hive-6374.patch
          22 kB
          Benjamin Zhitomirsky
        There are no Sub-Tasks for this issue.

        Activity

          People

            benjzh Benjamin Zhitomirsky
            benjzh Benjamin Zhitomirsky
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 168h
                168h
                Remaining:
                Remaining Estimate - 168h
                168h
                Logged:
                Time Spent - Not Specified
                Not Specified