Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-17290

Potential loss of data for replication of bulk loaded hfiles

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.3.0
    • 1.4.0, 2.0.0
    • None
    • Reviewed

    Description

      Currently the support for replication of bulk loaded hfiles relies on bulk load marker written in the WAL.

      The move of bulk loaded hfile(s) (into region directory) may succeed but the write of bulk load marker may fail.
      This means that although bulk loaded hfile is being served in source cluster, the replication wouldn't happen.

      Normally operator is supposed to retry the bulk load. But relying on human retry is not robust solution.

      Attachments

        1. HBASE-17290.branch-1.patch
          25 kB
          Ashish Singhi
        2. HBASE-17290.v1.patch
          27 kB
          Ashish Singhi
        3. HBASE-17290.patch
          24 kB
          Ashish Singhi

        Issue Links

          Activity

            People

              ashish singhi Ashish Singhi
              yuzhihong@gmail.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: