[ARROW-16441] [Release][Integration] Integration test primitive_no_batches Java producing, Go consuming fails on verify-release-candidate.sh

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 8.0.0
• Fix Version/s: 9.0.0
• Component/s: Go, Java
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/20227
• Assignee: Matthew Topol
• Reporter: Raúl Cumplido
• Created: 03/May/22 09:15
• Updated: 11/Jan/23 11:44
• Resolved: 04/May/22 14:00

Description

When running the verify-release-candidate.sh for 8.0.0 RC1 and RC2 I can reproduce the following integration test failure:

################# FAILURES #################
FAILED TEST: primitive_no_batches Java producing,  Go consuming
Traceback (most recent call last):
  File "/tmp/arrow-8.0.0.PRAAV/apache-arrow-8.0.0/dev/archery/archery/integration/util.py", line 139, in run_cmd
    output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
  File "/usr/lib/python3.10/subprocess.py", line 420, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/lib/python3.10/subprocess.py", line 524, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/tmp/arrow-8.0.0.PRAAV/go/gopath/bin/arrow-flight-integration-client', '-host', 'localhost', '-port=46493', '-path', '/tmp/arrow-integration-eq4s7mp3/generated_primitive_no_batches.json']' returned non-zero exit status 2.During handling of the above exception, another exception occurred:Traceback (most recent call last):
  File "/tmp/arrow-8.0.0.PRAAV/apache-arrow-8.0.0/dev/archery/archery/integration/runner.py", line 379, in _run_flight_test_case
    consumer.flight_request(port, **client_args)
  File "/tmp/arrow-8.0.0.PRAAV/apache-arrow-8.0.0/dev/archery/archery/integration/tester_go.py", line 121, in flight_request
    run_cmd(cmd)
  File "/tmp/arrow-8.0.0.PRAAV/apache-arrow-8.0.0/dev/archery/archery/integration/util.py", line 148, in run_cmd
    raise RuntimeError(sio.getvalue())
RuntimeError: Command failed: /tmp/arrow-8.0.0.PRAAV/go/gopath/bin/arrow-flight-integration-client -host localhost -port=46493 -path /tmp/arrow-integration-eq4s7mp3/generated_primitive_no_batches.json
With output:
--------------
Opening JSON file ' /tmp/arrow-integration-eq4s7mp3/generated_primitive_no_batches.json '
Opening JSON file ' /tmp/arrow-integration-eq4s7mp3/generated_primitive_no_batches.json '
Opening JSON file ' /tmp/arrow-integration-eq4s7mp3/generated_primitive_no_batches.json '
panic: rpc error: code = NotFound desc = Unknown descriptor.goroutine 1 [running]:
main.main()
    /tmp/arrow-8.0.0.PRAAV/apache-arrow-8.0.0/go/arrow/internal/flight_integration/cmd/arrow-flight-integration-client/main.go:52 +0x31a

There is a nightly release integration job that is failing with the same issue:

• verify-rc-source-integration-linux-ubuntu-18.04-amd64:
   URL: https://github.com/ursacomputing/crossbow/runs/6258515466?check_suite_focus=true

Issue Links

• fixes: ARROW-16309 [CI] [Go] [Flight] Verify release jobs are failing due to: panic: rpc error: code = NotFound desc = Unknown descriptor
• links to: GitHub Pull Request #13058