Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4229

Cannot run load data script locally because I have aux test repo and not impala-data/

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • Impala 2.7.0
    • None
    • Infrastructure
    • None

    Description

      I followed steps here: https://cwiki.apache.org/confluence/display/IMPALA/How+to+load+and+run+Impala+tests

      but it failed in testdata/bin/create-load-data.sh with

      Loading auxiliary workloads. Logging to /home/huaisi/Impala/logs/data_loading/data-load-auxiliary-workloads-core.log.
      Error loading aux workloads. The end of the log file is:
              at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
              at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
              at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
              at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:23 Invalid path ''/home/huaisi/Impala/testdata/impala-data/XXX/YYY'': No files matching path file:/home/huaisi/Impala/testdata/impala-data/XXX/YYY
              at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:139)
              at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:218)
              at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:223)
              at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:446)
              at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:312)
              at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1201)
              at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1188)
              at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:143)
              ... 26 more
      
      Closing: 0: jdbc:hive2://localhost:11050/default;auth=none
      Error executing file from Hive: load-XXX-core-hive-generated.sql
      Error in testdata/bin/create-load-data.sh at line 45: while [ -n "$*" ]
      

      I tried using: ./buildall.sh -format -snapshot_file ....tar.gz -metastore_snapshot_file ....txt -noclean -notests as well but get

      Loading Kudu TPCH (logging to load-kudu-tpch.log)... FAILED
      'load-data tpch core kudu/none/none force' failed. Tail of log:
      Timed out: Failed to write batch of 165 ops to tablet 6d223b3a2a944e7099179319d1ab9b94 after 343 attempt(s): Failed to write to server: (no server available): Write(tablet: 6d223b3a2a944e7099179319d1ab9b94, num_ops: 165, num_attempts: 343) passed its deadline: Network error: recv er
      ror: Connection reset by peer (error 104)
      Timed out: Failed to write batch of 165 ops to tablet 6d223b3a2a944e7099179319d1ab9b94 after 343 attempt(s): Failed to write to server: (no server available): Write(tablet: 6d223b3a2a944e7099179319d1ab9b94, num_ops: 165, num_attempts: 343) passed its deadline: Network error: recv er
      ror: Connection reset by peer (error 104)
      Timed out: Failed to write batch of 165 ops to tablet 6d223b3a2a944e7099179319d1ab9b94 after 343 attempt(s): Failed to write to server: (no server available): Write(tablet: 6d223b3a2a944e7099179319d1ab9b94, num_ops: 165, num_attempts: 343) passed its deadline: Network error: recv er
      ror: Connection reset by peer (error 104)
      ...
      ...
      ...
      

      Not sure how to proceed.

      Attachments

        Activity

          People

            Unassigned Unassigned
            HuaisiXu Huaisi Xu
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: