Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Performance
    • Labels:
      None

      Description

      Internal testing has create of a table with 33k regions taking 18 minutes. Let me provide more info below. We have an executor with default ten threads handling the creation of the regions in HDFS which helps distribute out the load but its not enough. This cluster had >600 servers. Let me add detail.

      Need to spend some time on speeding up create/assigns. Made this an umbrella issue so can pick off pieces of the problem as subtasks.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              stack stack
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated: