Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11824

Insert to local directory causes staging directory to be copied

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.3.0, 2.0.0
    • 1.3.0, 2.0.0
    • None
    • None

    Description

      While running tez_insert_overwrite_local_directory_1.q test under tez and llap, the results were flaky. The reason being insert into local directory copies .staging directory to destination directory. This causes dfs -cat dest-dir/* to fail, failing the tests. Non local insert directory works fine as MoveTask performs move operation with hidden files removal filter before moving whereas local directory insert uses DFS.copyToLocalFile without hidden files filter.

      Attachments

        1. HIVE-11824.1.patch
          2 kB
          Prasanth Jayachandran
        2. HIVE-11824.2.patch
          1 kB
          Prasanth Jayachandran

        Activity

          People

            prasanth_j Prasanth Jayachandran
            prasanth_j Prasanth Jayachandran
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: