Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3431

Avoid race conditions while downloading resources from non-local filesystem

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.11.0
    • Component/s: Configuration
    • Labels:
      None

      Description

      "add resource <remote-uri>" command downloads the resource file to location specified by conf "hive.downloaded.resources.dir" in local file system. But when the command above is executed concurrently to hive-server for same file, some client fails by VM crash, which is caused by overwritten file by other requests.

      So there should be a configuration to provide per request location for add resource command, something like "set hiveconf:hive.downloaded.resources.dir=temporary"

        Attachments

        1. HIVE-3431.D5199.4.patch
          3 kB
          Phabricator
        2. HIVE-3431.D5199.3.patch
          5 kB
          Phabricator
        3. HIVE-3431.D5199.2.patch
          5 kB
          Phabricator
        4. HIVE-3431.1.patch.txt
          2 kB
          Navis

          Issue Links

            Activity

              People

              • Assignee:
                navis Navis
                Reporter:
                navis Navis
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: