Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13656

Logging more info when client completes file error

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 3.0.2
    • None
    • None
    • None

    Description

      We found the error when dfs client completes file.

      Now the error log is too simple and cannot provide enough info for debugging. And this error will failed the write operation and finally lead our critical tasks failed. It will be good to print retry time and file path info inĀ DFSOutputStream#completeFile. In addition, the log level can be updated from INFO to WARN, it won't be ignored easily by users.

      Attachments

        1. error-hdfs.png
          88 kB
          Yiqun Lin
        2. HDFS-13656.001.patch
          2 kB
          Yiqun Lin

        Activity

          People

            linyiqun Yiqun Lin
            linyiqun Yiqun Lin
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: