Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-2308 Improve secondary index resiliency
  3. PHOENIX-2292

Improve performance of direct HBase API index build

Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.6.0
    • Component/s: None
    • Labels:
      None

      Description

      The direct HBase API index build should be almost as fast as the native Phoenix index build, but we're seeing a big difference:

        100M narrow table (min) 1B narrow table (min) 1B wide table (min)
      Non MR 10 76 511
      HFile MR 17 161 1,375
      Direct HBase APIs 24 84 1,450

      These results are for a 8 node cluster.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              rvaleti Ravi Kishore Valeti
              Reporter:
              jamestaylor James R. Taylor

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment