Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3833

TestDFSShell fails on Windows due to file concurrent read write

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 1-win
    • Fix Version/s: 1-win, 2.0.2-alpha
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      TestDFSShell sometimes fails due to the race between the write issued by the test and blockscanner. Example stack trace:

      Error Message
      
      c:\A\HM\build\test\data\dfs\data\data1\current\blk_-7735708801221347790 (The requested operation cannot be performed on a file with a user-mapped section open)
      
      Stacktrace
      
      java.io.FileNotFoundException: c:\A\HM\build\test\data\dfs\data\data1\current\blk_-7735708801221347790 (The requested operation cannot be performed on a file with a user-mapped section open)
      	at java.io.FileOutputStream.open(Native Method)
      	at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
      	at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
      	at java.io.PrintWriter.<init>(PrintWriter.java:218)
      	at org.apache.hadoop.hdfs.TestDFSShell.corrupt(TestDFSShell.java:1133)
      	at org.apache.hadoop.hdfs.TestDFSShell.testGet(TestDFSShell.java:1231)
      
      1. HDFS-3833.branch-1-win.patch
        0.9 kB
        Brandon Li
      2. HDFS-3833.patch
        1 kB
        Brandon Li

        Issue Links

          Activity

          Brandon Li created issue -
          Brandon Li made changes -
          Field Original Value New Value
          Summary TestDFSShell fails on Windows due to file read write race TestDFSShell fails on Windows due to file concurrent read write
          Brandon Li made changes -
          Link This issue relates to HADOOP-8645 [ HADOOP-8645 ]
          Brandon Li made changes -
          Attachment HDFS-3833.branch-1-win.patch [ 12542328 ]
          Brandon Li made changes -
          Attachment HDFS-3833.patch [ 12543138 ]
          Brandon Li made changes -
          Affects Version/s 3.0.0 [ 12320356 ]
          Brandon Li made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suresh Srinivas made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Suresh Srinivas made changes -
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 1-win [ 12320362 ]
          Fix Version/s 2.2.0-alpha [ 12322472 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Allen Wittenauer made changes -
          Fix Version/s 3.0.0 [ 12320356 ]

            People

            • Assignee:
              Brandon Li
              Reporter:
              Brandon Li
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development