Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6773

Make the dfs replication factor configurable per table

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Invalid
    • 0.95.2
    • None
    • regionserver
    • None

    Description

      Today, it's an application level configuration. So all the HFiles are replicated 3 times per default.

      There are some reasons to make it per table:

      • some tables are critical while some others are not. For example, meta would benefit from an higher level of replication, to ensure we continue working even when we lose 20% of the cluster.
      • some tables are backuped somewhere else, used by non essential process, so the user may accept a lower level of replication for these ones.
      • it should be a dynamic parameter. For example, during a bulk load we set a replication of 1 or 2, then we increase it. It's in the same space as disabling the WAL for some writes.

      The case that seems important to me is meta. We can also handle this one by a specific parameter in the usual hbase-site.xml if we don't want a generic solution.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              nkeywal Nicolas Liochon
              Votes:
              3 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: