Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-278

Should DFS outputstream's close wait forever?

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently DFSOutputStream.close() waits for ever if Namenode keeps throwing NotYetReplicated exception, for whatever reason. Its pretty annoying for a user. Shoud the loop inside close have a timeout? If so how much? It could probably something like 10 minutes.

      1. softMount1.patch
        9 kB
        dhruba borthakur
      2. softMount1.patch
        8 kB
        dhruba borthakur
      3. softMount2.patch
        9 kB
        dhruba borthakur
      4. softMount3.patch
        8 kB
        dhruba borthakur
      5. softMount4.txt
        7 kB
        dhruba borthakur
      6. softMount5.txt
        7 kB
        dhruba borthakur
      7. softMount6.txt
        4 kB
        dhruba borthakur
      8. softMount7.txt
        4 kB
        dhruba borthakur
      9. softMount8.txt
        7 kB
        dhruba borthakur
      10. softMount9.txt
        7 kB
        dhruba borthakur

        Issue Links

          Activity

          Raghu Angadi created issue -
          Raghu Angadi made changes -
          Field Original Value New Value
          Component/s dfs [ 12310710 ]
          Description
          Currently {{DFSOutputStream.close()}} waits for ever if Namenode keeps throwing {{NotYetReplicated}} exception, for whatever reason. Its pretty annoying for a user. Shoud the loop inside close have a timeout? If so how much? It could probably something like 10 minutes.
          Currently {{DFSOutputStream.close()}} waits for ever if Namenode keeps throwing {{NotYetReplicated}} exception, for whatever reason. Its pretty annoying for a user. Shoud the loop inside close have a timeout? If so how much? It could probably something like 10 minutes.
          dhruba borthakur made changes -
          Assignee dhruba borthakur [ dhruba ]
          dhruba borthakur made changes -
          Attachment softMount1.patch [ 12405605 ]
          dhruba borthakur made changes -
          Attachment softMount1.patch [ 12405626 ]
          dhruba borthakur made changes -
          Attachment softMount2.patch [ 12406462 ]
          dhruba borthakur made changes -
          Attachment softMount3.patch [ 12408429 ]
          dhruba borthakur made changes -
          Attachment softMount4.txt [ 12409919 ]
          dhruba borthakur made changes -
          Attachment softMount5.txt [ 12410056 ]
          Owen O'Malley made changes -
          Project Hadoop Common [ 12310240 ] HDFS [ 12310942 ]
          Key HADOOP-2757 HDFS-278
          Component/s dfs [ 12310710 ]
          dhruba borthakur made changes -
          Link This issue is blocked by HADOOP-6099 [ HADOOP-6099 ]
          dhruba borthakur made changes -
          Attachment softMount6.txt [ 12411512 ]
          dhruba borthakur made changes -
          Attachment softMount7.txt [ 12412052 ]
          dhruba borthakur made changes -
          Attachment softMount8.txt [ 12412843 ]
          dhruba borthakur made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          dhruba borthakur made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          dhruba borthakur made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.21.0 [ 12314046 ]
          dhruba borthakur made changes -
          Attachment softMount9.txt [ 12413239 ]
          dhruba borthakur made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          dhruba borthakur made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          dhruba borthakur made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          dhruba borthakur made changes -
          Link This issue relates to HDFS-951 [ HDFS-951 ]
          Guoqin Zheng made changes -
          Link This issue relates to HADOOP-9564 [ HADOOP-9564 ]

            People

            • Assignee:
              dhruba borthakur
              Reporter:
              Raghu Angadi
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development