Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1967 Umbrella JIRA for node density improvements
  3. KUDU-1807

GetTableSchema() is O(n) in the number of tablets

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.6.0
    • Component/s: master, perf

      Description

      GetTableSchema calls TableInfo::IsCreateTableDone. This method checks each tablet for whether it is in the correct state, which requires acquiring the RWC lock for every tablet. This is somewhat slow for large tables with thousands of tablets, and this is actually a relatively hot path because every task in an Impala query ends up calling GetTableSchema() when it opens its scanner.

        Attachments

          Activity

            People

            • Assignee:
              adar Adar Dembo
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: