Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-2308 Improve secondary index resiliency
  3. PHOENIX-2292

Improve performance of direct HBase API index build

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.6.0
    • Component/s: None
    • Labels:
      None

      Description

      The direct HBase API index build should be almost as fast as the native Phoenix index build, but we're seeing a big difference:

        100M narrow table (min) 1B narrow table (min) 1B wide table (min)
      Non MR 10 76 511
      HFile MR 17 161 1,375
      Direct HBase APIs 24 84 1,450

      These results are for a 8 node cluster.

        Attachments

        1. PHOENIX-2292.patch
          9 kB
          Ravi Kishore Valeti

          Issue Links

            Activity

              People

              • Assignee:
                rvaleti Ravi Kishore Valeti
                Reporter:
                jamestaylor James R. Taylor
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: