Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-4732

Improve config defaults for async secondary index MR jobs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 4.14.0, 5.0.0
    • None
    • None

    Description

      Our defaults for the MR job that builds secondary indexes should be changed to better support larger tables.

      • Increased the number of hbase client retries to 10
      • Increased the hbase scanner time out, map reduce task timeout, hbase rpc timeout to 10 minutes instead of 1 min
      • Added ability to control MR job concurrently running mapper tasks to 20 by default and a phoenix property phoenix.mr.concurrent.map.limit using which one can configure the same.

      Attachments

        1. PHOENIX-4732_v1.patch
          8 kB
          James R. Taylor

        Activity

          People

            jamestaylor James R. Taylor
            jamestaylor James R. Taylor
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: