Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7757

Misleading error messages in FSImage.java

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.6.0
    • 2.7.0
    • namenode
    • None
    • Reviewed

    Description

      If a quota violation is detected while loading an image, the NameNode logs scary error messages indicating a bug. However the quota violation state is very easy to get into e.g.

      1. Copy a 2MB file to a directory.
      2. Set a disk space quota of 1MB on the directory. We are in quota violation state now.

      We should reword the error messages, ideally making them warnings and suggesting the administrator needs to fix the quotas:

      Relevant code:

              LOG.error("BUG: Diskspace quota violation in image for "
                  + dir.getFullPathName()
                  + " quota = " + dsQuota + " < consumed = " + diskspace);
      ...
                LOG.error("BUG Disk quota by storage type violation in image for "
                    + dir.getFullPathName()
                    + " type = " + t.toString() + " quota = "
                    + typeQuota + " < consumed " + typeSpace);
      

      Attachments

        1. HDFS-7757.patch
          1 kB
          Brahma Reddy Battula
        2. HDFS-7757-002.patch
          2 kB
          Brahma Reddy Battula

        Activity

          People

            brahmareddy Brahma Reddy Battula
            arp Arpit Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: