Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3833

TestDFSShell fails on Windows due to file concurrent read write

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1-win, 3.0.0-alpha1
    • 1-win, 2.0.2-alpha
    • test
    • None
    • Reviewed

    Description

      TestDFSShell sometimes fails due to the race between the write issued by the test and blockscanner. Example stack trace:

      Error Message
      
      c:\A\HM\build\test\data\dfs\data\data1\current\blk_-7735708801221347790 (The requested operation cannot be performed on a file with a user-mapped section open)
      
      Stacktrace
      
      java.io.FileNotFoundException: c:\A\HM\build\test\data\dfs\data\data1\current\blk_-7735708801221347790 (The requested operation cannot be performed on a file with a user-mapped section open)
      	at java.io.FileOutputStream.open(Native Method)
      	at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
      	at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
      	at java.io.PrintWriter.<init>(PrintWriter.java:218)
      	at org.apache.hadoop.hdfs.TestDFSShell.corrupt(TestDFSShell.java:1133)
      	at org.apache.hadoop.hdfs.TestDFSShell.testGet(TestDFSShell.java:1231)
      

      Attachments

        1. HDFS-3833.patch
          1 kB
          Brandon Li
        2. HDFS-3833.branch-1-win.patch
          0.9 kB
          Brandon Li

        Issue Links

          Activity

            People

              brandonli Brandon Li
              brandonli Brandon Li
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: