Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-2308 Improve secondary index resiliency
  3. PHOENIX-2292

Improve performance of direct HBase API index build

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.6.0
    • None
    • None

    Description

      The direct HBase API index build should be almost as fast as the native Phoenix index build, but we're seeing a big difference:

        100M narrow table (min) 1B narrow table (min) 1B wide table (min)
      Non MR 10 76 511
      HFile MR 17 161 1,375
      Direct HBase APIs 24 84 1,450

      These results are for a 8 node cluster.

      Attachments

        1. PHOENIX-2292.patch
          9 kB
          Ravi Kishore Valeti

        Issue Links

          contains

          Sub-task - The sub-task of the issue PHOENIX-2261 Front door MR-based index build times out for fully covered index

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              rvaleti Ravi Kishore Valeti
              jamestaylor James R. Taylor
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: