Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11824

Insert to local directory causes staging directory to be copied

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 2.0.0
    • Fix Version/s: 1.3.0, 2.0.0
    • Component/s: None
    • Labels:
      None

      Description

      While running tez_insert_overwrite_local_directory_1.q test under tez and llap, the results were flaky. The reason being insert into local directory copies .staging directory to destination directory. This causes dfs -cat dest-dir/* to fail, failing the tests. Non local insert directory works fine as MoveTask performs move operation with hidden files removal filter before moving whereas local directory insert uses DFS.copyToLocalFile without hidden files filter.

        Attachments

        1. HIVE-11824.1.patch
          2 kB
          Prasanth Jayachandran
        2. HIVE-11824.2.patch
          1 kB
          Prasanth Jayachandran

          Activity

            People

            • Assignee:
              prasanth_j Prasanth Jayachandran
              Reporter:
              prasanth_j Prasanth Jayachandran
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: