[ARROW-14311] [C++] The arrow-gcsfs-test is too slow

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 7.0.0
• Component/s: C++
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/29884
• Assignee: Carlos O'Ryan
• Reporter: Carlos O'Ryan
• Created: 13/Oct/21 15:08
• Updated: 11/Jan/23 08:39
• Resolved: 26/Oct/21 23:34

Description

In some cases the test for arrow::fs::GcsFilesystem is very slow. There is no obvious reason for this problem, we should find it why and fix it.

https://github.com/apache/arrow/pull/11375#issuecomment-942397629

Hmm, gcfs_test is not hanging anymore but it's still taking a lot of time:

[ RUN      ] GcsFileSystem.FileSystemCompare
[       OK ] GcsFileSystem.FileSystemCompare (20025 ms)

Ugh, that looks painful. On my workstation that particular test completes in milliseconds:

[ RUN      ] GcsFileSystem.FileSystemCompare
[       OK ] GcsFileSystem.FileSystemCompare (5 ms)

And the full test with with archery docker run ubuntu-cpp takes about 3 seconds:

54/85 Test #49: arrow-gcsfs-test ..........................   Passed    3.05 sec

Issue Links

• links to: GitHub Pull Request #11406