Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3128

Parallelize file/block metadata loading for tables with large number of partitions

    XMLWordPrintableJSON

Details

    Description

      Currently, loading file/block metadata of a table is performed by a single thread. For large tables, loading metadata may take a long time, thereby increasing the latency during planning and/or other DDL/DML operations. We should consider parallelizing this process.

      Attachments

        Activity

          People

            bharathv Bharath Vissapragada
            dtsirogiannis Dimitris Tsirogiannis
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: