[ARROW-14238] [Python] "could not run mc" error in test_fs.py

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 7.0.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/29817
• Assignee: Weston Pace
• Reporter: Antoine Pitrou
• Created: 06/Oct/21 13:44
• Updated: 11/Jan/23 08:38
• Resolved: 16/Nov/21 13:02

Description

This test fails on my machine:

______________________________________________________ ERROR at setup of test_s3fs_limited_permissions_create_bucket _______________________________________________________
Traceback (most recent call last):
  File "/home/antoine/arrow/dev/python/pyarrow/tests/test_fs.py", line 397, in limited_s3_user
    if not _configure_limited_user(tempdir, address, access_key, secret_key):
  File "/home/antoine/arrow/dev/python/pyarrow/tests/test_fs.py", line 374, in _configure_limited_user
    'myminio/', 'no-create-buckets', policy_path)
  File "/home/antoine/arrow/dev/python/pyarrow/tests/test_fs.py", line 336, in _run_mc_command
    raise ChildProcessError("Could not run mc")
ChildProcessError: Could not run mc
-------------------------------------------------------------------------- Captured stdout setup ---------------------------------------------------------------------------
Cmd: mc -C /tmp/tmpjbj5u87f/mc alias set myminio http://localhost:55309 arrow apachearrow
  Return: 0
  Stdout: mc: Configuration written to `/tmp/tmpjbj5u87f/mc/config.json`. Please update your access credentials.
mc: Successfully created `/tmp/tmpjbj5u87f/mc/share`.
mc: Initialized share uploads `/tmp/tmpjbj5u87f/mc/share/uploads.json` file.
mc: Initialized share downloads `/tmp/tmpjbj5u87f/mc/share/downloads.json` file.
NAME:
  mc - MinIO Client for cloud storage and filesystems.

USAGE:
  mc [FLAGS] COMMAND [COMMAND FLAGS | -h] [ARGUMENTS...]

COMMANDS:
  ls       list buckets and objects
  mb       make a bucket
  rb       remove a bucket
  cat      display object contents
  head     display first 'n' lines of an object
  pipe     stream STDIN to an object
  share    generate URL for temporary access to an object
  cp       copy objects
  mirror   synchronize object(s) to a remote site
  find     search for objects
  sql      run sql queries on objects
  stat     show object metadata
  diff     list differences in object name, size, and date between two buckets
  rm       remove objects
  event    configure object notifications
  watch    listen for object notification events
  policy   manage anonymous access to buckets and objects
  admin    manage MinIO servers
  session  resume interrupted operations
  config   configure MinIO client
  update   update mc to latest release
  version  show version info
  
GLOBAL FLAGS:
  --autocompletion              install auto-completion for your shell
  --config-dir value, -C value  path to configuration folder (default: "/home/antoine/.mc")
  --quiet, -q                   disable progress bar display
  --no-color                    disable color theme
  --json                        enable JSON formatted output
  --debug                       enable debug output
  --insecure                    disable SSL certificate verification
  --help, -h                    show help
  --version, -v                 print the version
  
TIP:
  Use 'mc --autocompletion' to enable shell autocompletion

VERSION:
  RELEASE.2019-07-11T19-31-28Z

  Stderr: 
Cmd: mc -C /tmp/tmpjbj5u87f/mc admin policy add myminio/ no-create-buckets /tmp/tmpjbj5u87f/limited-buckets-policy.json
  Return: 1
  Stdout: 
  Stderr: mc: <ERROR> Cannot get a configured admin connection. The specified alias: myminio/ not found.

Issue Links

• links to: GitHub Pull Request #11408