Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-18042

Client Compatibility breaks between versions 1.2 and 1.3

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 1.4.0, 1.3.1, 2.0.0
    • 1.4.0, 1.3.2, 2.0.0
    • regionserver, Scanners
    • None

    Description

      OpenTSDB uses AsyncHBase as its client, rather than using the traditional HBase Client. From version 1.2 to 1.3, the ClientProtos have been changed. Newer fields are added to ScanResponse proto.

      For a typical Scan request in 1.2, would require caller to make an OpenScanner Request, GetNextRows Request and a CloseScanner Request, based on more_rows boolean field in the ScanResponse proto.

      However, from 1.3, new parameter more_results_in_region was added, which limits the results per region. Therefore the client has to now manage sending all the requests for each region. Further more, if the results are exhausted from a particular region, the ScanResponse will set more_results_in_region to false, but more_results can still be true. Whenever the former is set to false, the RegionScanner will also be closed.

      OpenTSDB makes an OpenScanner Request and receives all its results in the first ScanResponse itself, thus creating a condition as described in above paragraph. Since more_rows is true, it will proceed to send next request at which point the RSRpcServices will throw UnknownScannerException. The protobuf client compatibility is maintained but expected behavior is modified.

      Attachments

        1. HBASE-18042-v2.patch
          15 kB
          Duo Zhang
        2. HBASE-18042-v1.patch
          14 kB
          Duo Zhang
        3. HBASE-18042-branch-1-v1.patch
          15 kB
          Duo Zhang
        4. HBASE-18042-branch-1-v1.patch
          15 kB
          Duo Zhang
        5. HBASE-18042-branch-1.patch
          4 kB
          Duo Zhang
        6. HBASE-18042-branch-1.patch
          4 kB
          Duo Zhang
        7. HBASE-18042-branch-1.3-v1.patch
          14 kB
          Duo Zhang
        8. HBASE-18042-branch-1.3.patch
          14 kB
          Duo Zhang
        9. HBASE-18042.patch
          6 kB
          Duo Zhang

        Issue Links

          Activity

            People

              zhangduo Duo Zhang
              karanmehta93 Karan Mehta
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: