Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20734

Colocate recovered edits directory with hbase.wal.dir

    XMLWordPrintableJSON

Details

    • Reviewed
    • Hide
      Previously the recovered.edits directory was under the root directory. This JIRA moves the recovered.edits directory to be under the hbase.wal.dir if set. It also adds a check for any recovered.edits found under the root directory for backwards compatibility. This gives improvements when a faster media(like SSD) or more local FileSystem is used for the hbase.wal.dir than the root dir.
      Show
      Previously the recovered.edits directory was under the root directory. This JIRA moves the recovered.edits directory to be under the hbase.wal.dir if set. It also adds a check for any recovered.edits found under the root directory for backwards compatibility. This gives improvements when a faster media(like SSD) or more local FileSystem is used for the hbase.wal.dir than the root dir.

    Description

      During investigation of HBASE-20723, I realized that we wouldn't get the best performance when hbase.wal.dir is configured to be on different (fast) media than hbase rootdir w.r.t. recovered edits since recovered edits directory is currently under rootdir.

      Such setup may not result in fast recovery when there is region server failover.

      This issue is to find proper (hopefully backward compatible) way in colocating recovered edits directory with hbase.wal.dir .

      Attachments

        1. HBASE-20734.branch-1.001.patch
          42 kB
          Zach York
        2. HBASE-20734.branch-1.002.patch
          46 kB
          Zach York
        3. HBASE-20734.branch-1.003.patch
          47 kB
          Zach York
        4. HBASE-20734.branch-1.004.patch
          48 kB
          Zach York
        5. HBASE-20734.branch-1.005.patch
          50 kB
          Zach York
        6. HBASE-20734.master.001.patch
          63 kB
          Zach York
        7. HBASE-20734.master.002.patch
          63 kB
          Zach York
        8. HBASE-20734.master.003.patch
          63 kB
          Zach York
        9. HBASE-20734.master.004.patch
          64 kB
          Zach York
        10. HBASE-20734.master.005.patch
          63 kB
          Zach York
        11. HBASE-20734.master.006.patch
          63 kB
          Zach York
        12. HBASE-20734.master.007.patch
          63 kB
          Zach York
        13. HBASE-20734.master.008.patch
          64 kB
          Zach York
        14. HBASE-20734.master.009.patch
          65 kB
          Zach York
        15. HBASE-20734.master.010.patch
          65 kB
          Zach York
        16. HBASE-20734.master.011.patch
          65 kB
          Zach York
        17. HBASE-20734.master.012.patch
          66 kB
          Zach York

        Issue Links

          Activity

            People

              zyork Zach York
              yuzhihong@gmail.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: