Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-4732

Improve config defaults for async secondary index MR jobs

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.14.0, 5.0.0
    • Labels:
      None

      Description

      Our defaults for the MR job that builds secondary indexes should be changed to better support larger tables.

      • Increased the number of hbase client retries to 10
      • Increased the hbase scanner time out, map reduce task timeout, hbase rpc timeout to 10 minutes instead of 1 min
      • Added ability to control MR job concurrently running mapper tasks to 20 by default and a phoenix property phoenix.mr.concurrent.map.limit using which one can configure the same.

        Attachments

        1. PHOENIX-4732_v1.patch
          8 kB
          James R. Taylor

          Activity

            People

            • Assignee:
              jamestaylor James R. Taylor
              Reporter:
              jamestaylor James R. Taylor
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: