Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6709

Simplify tests that copy local files to tables

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • Impala 3.1.0
    • Infrastructure
    • ghx-label-9

    Description

      tests/query_test/ contains several tests that use "hdfs dfs -copyFromLocal" to fill tables with files that cannot be created with Impala. The current way of doing this looks like "copy paste" and adds unnecessary complexity to the test code. The common pattern of "create a table, copy 1-2 files to it" could be covered by a single function, or could be moved to the .test files, which support SHELL sections.

      for an example of SHELL section, see
      https://github.com/apache/impala/blob/8dde41e802e3566d07e2db7b2bf5cd76030ab3d3/testdata/workloads/functional-query/queries/QueryTest/parquet-resolution-by-name.test#L75

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            boroknagyz Zoltán Borók-Nagy
            csringhofer Csaba Ringhofer
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment