Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-532

Allow applications to know that a read request failed because block is missing

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • hdfs-client
    • None
    • Reviewed

    Description

      I have an application that has intelligence to retrieve data from alternate locations if HDFS cannot provide this data. This can happen when data in HDFS is corrupted or the block is missing. HDFS already throws ChecksumException if the block is corrupted and throws a generic IOException if the block is missing. I would like HDFS to throw BlockMissingException when a read request encounters a block that has no locations associated with it.

      Attachments

        1. BlockMissingException2.txt
          9 kB
          Dhruba Borthakur
        2. BlockMissingException.patch
          9 kB
          Dhruba Borthakur

        Activity

          People

            dhruba Dhruba Borthakur
            dhruba Dhruba Borthakur
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: