Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-1091

Improve TScanRangeLocation struct and associated code

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 1.3.1
    • Fix Version/s: Impala 2.0
    • Component/s: None
    • Labels:
      None

      Description

      This is the catalog object that scales most quickly (one per replica) and we've made it pretty heavyweight by storing the TNetworkAddress of the host it is on.

      This should instead use the same technique that we used to reduce the catalog size (i.e. index into list of hosts) or, better, removing this all together since it contains a subset and more expensive version of what is stored in THdfsFileBlock.

      This will likely speedup our query start up noticeably.

        Attachments

          Activity

            People

            • Assignee:
              dhecht Dan Hecht
              Reporter:
              nong_impala_60e1 Nong Li
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: