Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9848

Coordinator unnecessarily invalidating locally cached table metadata

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Catalog, Frontend
    • Labels:
      None
    • Epic Color:
      ghx-label-5

      Description

      The following fails when run locally on master:

      ./bin/start-impala-cluster.py --catalogd_args='--catalog_topic_mode=minimal' --impalad_args='--use_local_catalog'
      ./bin/impala-shell.sh
      [localhost:21000] default> select count(l_comment) from tpch.lineitem; <--- THIS WORKS
      # kill the catalogd process
      [localhost:21000] default> select count(l_comment) from tpch.lineitem; <--- THIS FAILS
      ERROR: AnalysisException: Failed to load metadata for table: 'tpch.lineitem'
      CAUSED BY: TableLoadingException: Could not load table tpch.lineitem from catalog
      CAUSED BY: TException: org.apache.impala.common.InternalException: Couldn't open transport for localhost:26000 (connect() failed: Connection refused)CAUSED BY: InternalException: Couldn't open transport for localhost:26000 (connect() failed: Connection refused 

      The above experiment works with catalog v1 - e.g. if you remove the startup flags in the ./bin/start-impala-cluster.py everything works.

        Attachments

        1. IMPALA-9848-catalogd.INFO
          308 kB
          Sahil Takiar
        2. IMPALA-9848-impalad.INFO
          105 kB
          Sahil Takiar

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              stakiar Sahil Takiar
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: