Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3833

TestDFSShell fails on Windows due to file concurrent read write

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1-win, 3.0.0-alpha1
    • Fix Version/s: 1-win, 2.0.2-alpha
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      TestDFSShell sometimes fails due to the race between the write issued by the test and blockscanner. Example stack trace:

      Error Message
      
      c:\A\HM\build\test\data\dfs\data\data1\current\blk_-7735708801221347790 (The requested operation cannot be performed on a file with a user-mapped section open)
      
      Stacktrace
      
      java.io.FileNotFoundException: c:\A\HM\build\test\data\dfs\data\data1\current\blk_-7735708801221347790 (The requested operation cannot be performed on a file with a user-mapped section open)
      	at java.io.FileOutputStream.open(Native Method)
      	at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
      	at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
      	at java.io.PrintWriter.<init>(PrintWriter.java:218)
      	at org.apache.hadoop.hdfs.TestDFSShell.corrupt(TestDFSShell.java:1133)
      	at org.apache.hadoop.hdfs.TestDFSShell.testGet(TestDFSShell.java:1231)
      

        Attachments

        1. HDFS-3833.patch
          1 kB
          Brandon Li
        2. HDFS-3833.branch-1-win.patch
          0.9 kB
          Brandon Li

          Issue Links

            Activity

              People

              • Assignee:
                brandonli Brandon Li
                Reporter:
                brandonli Brandon Li
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: