Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9817

Document flags of Fetch-on-demand metadata coordinators

    XMLWordPrintableJSON

    Details

    • Type: Documentation
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Impala 4.0
    • Component/s: Docs
    • Labels:
      None
    • Epic Color:
      ghx-label-14

      Description

      We need to document about these flags: 

      DEFINE_bool_hidden(use_local_catalog, false,
          "Use experimental implementation of a local catalog. If this is set, "
          "the catalog service is not used and does not need to be started.");
      DEFINE_int32_hidden(local_catalog_cache_mb, -1,
          "If --use_local_catalog is enabled, configures the size of the catalog "
          "cache within each impalad. If this is set to -1, the cache is auto-"
          "configured to 60% of the configured Java heap size. Note that the Java "
          "heap size is distinct from and typically smaller than the overall "
          "Impala memory limit.");
      DEFINE_int32_hidden(local_catalog_cache_expiration_s, 60 * 60,
          "If --use_local_catalog is enabled, configures the expiration time "
          "of the catalog cache within each impalad. Even if the configured "
          "cache capacity has not been reached, items are removed from the cache "
          "if they have not been accessed in this amount of time.");
      DEFINE_int32_hidden(local_catalog_max_fetch_retries, 40,
          "If --use_local_catalog is enabled, configures the maximum number of times "
          "the frontend retries when fetching a metadata object from the impalad "
          "coordinator's local catalog cache."); 

      https://github.com/apache/impala/blob/052129c16a29891a72427b351bcc4e087d772fbe/be/src/runtime/exec-env.cc#L103-L120

        Attachments

        1. image-2020-06-03-12-17-06-108.png
          244 kB
          shajini thayasingh
        2. image-2020-06-03-16-06-24-451.png
          188 kB
          shajini thayasingh

          Issue Links

            Activity

              People

              • Assignee:
                shajini shajini thayasingh
                Reporter:
                stigahuang Quanlong Huang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: