Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4849

Refresh table metadata performance: read only new/updated parquet files

    Details

      Description

      Currently REFRESH TABLE METADATA takes serious amount of time for many small parquet files. We can actually only read these parquets, which are new or changed. This will require to add modificationTime into file metadata.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              myroch Miroslav Holubec
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: