Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13538

HDFS DiskChecker should handle disk full situation

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Fix disk checker issues reported by kihwal in HADOOP-13738:

      When space is low, the os returns ENOSPC. Instead simply stop writing, the drive is marked bad and replication happens. This make cluster-wide space problem worse. If the number of "failed" drives exceeds the DFIP limit, the datanode shuts down.

      Attachments

        1. HDFS-13538.01.patch
          3 kB
          Arpit Agarwal

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-15450 Avoid fsync storm triggered by DiskChecker and handle disk full situation

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-15493 DiskChecker should handle disk full situation

          • Critical - Crashes, loss of data, severe memory leak.
          • Patch Available

          Activity

            People

              arp Arpit Agarwal
              kihwal Kihwal Lee
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: