Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-4732

Improve config defaults for async secondary index MR jobs

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.14.0, 5.0.0
    • Component/s: None
    • Labels:
      None

      Description

      Our defaults for the MR job that builds secondary indexes should be changed to better support larger tables.

      • Increased the number of hbase client retries to 10
      • Increased the hbase scanner time out, map reduce task timeout, hbase rpc timeout to 10 minutes instead of 1 min
      • Added ability to control MR job concurrently running mapper tasks to 20 by default and a phoenix property phoenix.mr.concurrent.map.limit using which one can configure the same.

        Attachments

          Activity

            People

            • Assignee:
              jamestaylor James R. Taylor
              Reporter:
              jamestaylor James R. Taylor

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment