Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
1. Implement retrieval steps (include auto-refresh policy, retry attempts, fallback to file metadata).
2. Change the current group scan to leverage Schema from Metastore;
3. Verify that metadata is used correctly for metastore classes
Add options:
metastore.enabled
metastore.retrival.retry_attempts
metastore.metadata.store.depth_level
metastore.metadata.use_schema
metastore.metadata.use_statistics
metastore.metadata.ctas.auto-collect
metastore.metadata.fallback_to_file_metadata