HBase
  1. HBase
  2. HBASE-5745

SequenceFileLogReader#getPos may get wrong length on DFS restart

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Critical Critical
    • Resolution: Unresolved
    • Affects Version/s: 0.95.2
    • Fix Version/s: None
    • Component/s: wal
    • Labels:
      None

      Description

      This is actually a kind of integration bug from Hbase perspective.

      Currently HDFS will count the partial block length as 0, if there are no locations found for the partial block. This can happend opn DFS restart, before DNs completely reports to NN.

      Explained the scenario in HDFS-3222. Actually this is a bug in HDFS. we may solve this in latest versions.

      So, whatever the versions Hbase using may have this bug. HMaster may not be able to replay the complete edits if there is an Hmaster switch also at the same time.

        Issue Links

          Activity

          Hide
          Uma Maheswara Rao G added a comment -

          Linking to HDFS issue.

          Show
          Uma Maheswara Rao G added a comment - Linking to HDFS issue.
          Hide
          Uma Maheswara Rao G added a comment -

          I have just committed the HDFS issue in trunk and branch-2.
          For supporting older released versions, we may have to implement the similar logic in Hbase SFLR, to ensure the correct length.Otherwise this is a dataloss case from Hbase perspective.

          Show
          Uma Maheswara Rao G added a comment - I have just committed the HDFS issue in trunk and branch-2. For supporting older released versions, we may have to implement the similar logic in Hbase SFLR, to ensure the correct length.Otherwise this is a dataloss case from Hbase perspective.

            People

            • Assignee:
              Uma Maheswara Rao G
              Reporter:
              Uma Maheswara Rao G
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Development