Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Won't Fix
-
0.21.0
-
None
-
None
Description
Every so often I get stack traces telling me that DFSClient is closed, usually in {{org.apache.hadoop.hdfs.DFSClient.checkOpen() }} . The root cause of this is usually that one thread has closed a shared fsclient while another thread still has a reference to it. If the other thread then asks for a new client it will get one and the cache repopulated but if has one already, then I get to see a stack trace.
It's effectively a race condition between clients in different threads.
Attachments
Attachments
Issue Links
- is related to
-
MAPREDUCE-437 JobTracker must ask for a new FS instance and close it when terminated.
- Resolved