Issue Details (XML | Word | Printable)

Key: HADOOP-2346
Type: Bug Bug
Status: Closed Closed
Resolution: Fixed
Priority: Major Major
Assignee: Raghu Angadi
Reporter: Raghu Angadi
Votes: 0
Watchers: 4
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

DataNode should have timeout on socket writes.

Created: 04/Dec/07 06:57 PM   Updated: 08/Jul/09 04:42 PM
Return to search
Component/s: None
Affects Version/s: 0.15.1
Fix Version/s: 0.17.0

Time Tracking:
Not Specified

File Attachments:
  Size
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-03-06 02:11 AM Raghu Angadi 48 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-03-04 07:53 PM Raghu Angadi 48 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-03-03 11:35 PM Raghu Angadi 48 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-03-03 09:10 PM Raghu Angadi 48 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-03-01 12:41 AM Raghu Angadi 47 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-02-28 08:23 PM Raghu Angadi 46 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-02-26 10:31 PM Raghu Angadi 46 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-02-26 10:25 PM Raghu Angadi 45 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-02-25 09:42 PM Raghu Angadi 45 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-02-18 09:45 PM Raghu Angadi 45 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-02-16 01:48 AM Raghu Angadi 45 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-02-06 09:32 PM Raghu Angadi 36 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-02-06 12:22 AM Raghu Angadi 36 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-02-05 08:50 PM Raghu Angadi 36 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-01-14 07:48 PM Raghu Angadi 11 kB
Text File Licensed for inclusion in ASF works HADOOP-2346.patch 2008-01-12 03:10 AM Raghu Angadi 11 kB
Issue Links:
Reference
 

Resolution Date: 06/Mar/08 04:41 AM


 Description  « Hide
If a client opens a file and stops reading in the middle, DataNode thread writing the data could be stuck forever. For DataNode sockets we set read timeout but not write timeout. I think we should add a write(data, timeout) method in IOUtils that assumes it the underlying FileChannel is non-blocking.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Raghu Angadi made changes - 04/Dec/07 06:59 PM
Field Original Value New Value
Component/s dfs [ 12310710 ]
Fix Version/s 0.16.0 [ 12312740 ]
Affects Version/s 0.15.1 [ 12312850 ]
Description
If a client opens a file and stops reading in the middle, DataNode thread writing the data could be stuck forever. For DataNode sockets we set read timeout but not write timeout. I think we should add a write(data, timeout) method in IOUtils that assumes it the underlying FileChannel is non-blocking.
If a client opens a file and stops reading in the middle, DataNode thread writing the data could be stuck forever. For DataNode sockets we set read timeout but not write timeout. I think we should add a write(data, timeout) method in IOUtils that assumes it the underlying FileChannel is non-blocking.
Raghu Angadi made changes - 10/Jan/08 11:58 PM
Assignee Raghu Angadi [ rangadi ]
Raghu Angadi made changes - 11/Jan/08 12:01 AM
Link This issue relates to HADOOP-2341 [ HADOOP-2341 ]
Raghu Angadi made changes - 12/Jan/08 03:10 AM
Attachment HADOOP-2346.patch [ 12373024 ]
Raghu Angadi made changes - 14/Jan/08 07:48 PM
Attachment HADOOP-2346.patch [ 12373118 ]
Marco Nicosia made changes - 31/Jan/08 09:05 PM
Fix Version/s 0.16.1 [ 12312927 ]
Raghu Angadi made changes - 05/Feb/08 08:50 PM
Attachment HADOOP-2346.patch [ 12374817 ]
Raghu Angadi made changes - 06/Feb/08 12:22 AM
Attachment HADOOP-2346.patch [ 12374835 ]
Raghu Angadi made changes - 06/Feb/08 09:32 PM
Attachment HADOOP-2346.patch [ 12374914 ]
Raghu Angadi made changes - 15/Feb/08 03:49 AM
Fix Version/s 0.17.0 [ 12312913 ]
Fix Version/s 0.16.1 [ 12312927 ]
Raghu Angadi made changes - 16/Feb/08 01:48 AM
Attachment HADOOP-2346.patch [ 12375740 ]
Raghu Angadi made changes - 18/Feb/08 09:45 PM
Attachment HADOOP-2346.patch [ 12375863 ]
Raghu Angadi made changes - 25/Feb/08 09:42 PM
Attachment HADOOP-2346.patch [ 12376449 ]
Raghu Angadi made changes - 26/Feb/08 10:25 PM
Attachment HADOOP-2346.patch [ 12376558 ]
Raghu Angadi made changes - 26/Feb/08 10:31 PM
Attachment HADOOP-2346.patch [ 12376562 ]
Raghu Angadi made changes - 28/Feb/08 08:23 PM
Attachment HADOOP-2346.patch [ 12376761 ]
Raghu Angadi made changes - 01/Mar/08 12:41 AM
Attachment HADOOP-2346.patch [ 12376883 ]
Raghu Angadi made changes - 03/Mar/08 09:10 PM
Attachment HADOOP-2346.patch [ 12377010 ]
Raghu Angadi made changes - 03/Mar/08 11:35 PM
Attachment HADOOP-2346.patch [ 12377022 ]
Raghu Angadi made changes - 04/Mar/08 01:55 AM
Status Open [ 1 ] Patch Available [ 10002 ]
Raghu Angadi made changes - 04/Mar/08 07:53 PM
Attachment HADOOP-2346.patch [ 12377113 ]
Raghu Angadi made changes - 04/Mar/08 07:57 PM
Status Patch Available [ 10002 ] Open [ 1 ]
Raghu Angadi made changes - 04/Mar/08 07:57 PM
Status Open [ 1 ] Patch Available [ 10002 ]
Raghu Angadi made changes - 06/Mar/08 02:10 AM
Status Patch Available [ 10002 ] Open [ 1 ]
Raghu Angadi made changes - 06/Mar/08 02:11 AM
Attachment HADOOP-2346.patch [ 12377217 ]
Raghu Angadi made changes - 06/Mar/08 02:11 AM
Status Open [ 1 ] Patch Available [ 10002 ]
Raghu Angadi made changes - 06/Mar/08 04:41 AM
Status Patch Available [ 10002 ] Resolved [ 5 ]
Resolution Fixed [ 1 ]
Nigel Daley made changes - 21/May/08 08:05 PM
Status Resolved [ 5 ] Closed [ 6 ]
Owen O'Malley made changes - 08/Jul/09 04:42 PM
Component/s dfs [ 12310710 ]