Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8394

Utilize isFileClosed() so that the wait for lease recovery can be optimized

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      In HDFS-4525, the following API was added:

        /**
         * Get the close status of a file
         * @param src The path to the file
         *
         * @return return true if file is closed
         * @throws FileNotFoundException if the file does not exist.
         * @throws IOException If an I/O error occurred     
         */
        public boolean isFileClosed(Path src) throws IOException {
      

      It is not available in hadoop 1.1 at the moment.

      In HBASE-8389, there was discussion for utilizing isFileClosed() to optimize the wait time for lease recovery.

      Subsequent lease recovery request for the same Path would preempt outstanding recovery. But if we wait for one particular recovery request to complete without limit on duration, we may incur penalty due to various failure scenarios such as the primary Data Node chosen by Namenode being stale, etc.

      This JIRA continues the work for 0.95 / trunk.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                yuzhihong@gmail.com Ted Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: