Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6185 HDFS operational and debuggability improvements
  3. HDFS-8658

Improve retry attempt log in DFSOutputStream#completeFile with current attempt number

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      In a scenario when block update was delayed from DN to NN, following client log is observed which is confusing that file close failed after two attempts but it tried 5 times actually. So, it's better to log the current and remaining attempt counts.

      15/06/23 17:05:10 INFO hdfs.DFSClient: Could not complete /write2/tst5484._COPYING_ retrying...
      15/06/23 17:05:16 INFO hdfs.DFSClient: Could not complete /write2/tst5484._COPYING_ retrying...
      copyFromLocal: Unable to close file because the last block does not have enough number of replicas.
      

      Attachments

        1. HDFS-8658-00.patch
          2 kB
          Kanaka Kumar Avvaru
        2. HDFS-8658-01.patch
          2 kB
          Kanaka Kumar Avvaru

        Activity

          People

            kanaka Kanaka Kumar Avvaru
            kanaka Kanaka Kumar Avvaru
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: