[ARROW-18227] [CI][Packaging] Nightly conda clean job is failing due to PackagesNotFoundError

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 11.0.0
• Component/s: Continuous Integration, Packaging
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/33413
• Assignee: Raúl Cumplido
• Reporter: Raúl Cumplido
• Created: 02/Nov/22 11:05
• Updated: 11/Jan/23 11:58
• Resolved: 02/Nov/22 13:52

Description

Our nightly conda-clean jobs are currently failing with the following error:

========================== Starting Command Output ===========================
/usr/bin/bash --noprofile --norc /home/vsts/work/_temp/97689a14-9da4-40a5-871e-8cae89e20d67.sh
Command ['conda', 'search', '--json', '-c', 'arrow-nightlies', '--override-channels', '--subdir', 'win-64'] returned non-zero exit status 1
Stdout was:
----------------------------------------------------------------------
{
  "caused_by": "None",
  "channel_urls": [
    "https://conda.anaconda.org/arrow-nightlies/win-64",
    "https://conda.anaconda.org/arrow-nightlies/noarch"
  ],
  "channels_formatted": "  - https://conda.anaconda.org/arrow-nightlies/win-64\n  - https://conda.anaconda.org/arrow-nightlies/noarch",
  "error": "PackagesNotFoundError: The following packages are not available from current channels:\n\n  - *\n\nCurrent channels:\n\n  - https://conda.anaconda.org/arrow-nightlies/win-64\n  - https://conda.anaconda.org/arrow-nightlies/noarch\n\nTo search for alternate channels that may provide the conda package you're\nlooking for, navigate to\n\n    https://anaconda.org\n\nand use the search bar at the top of the page.\n",
  "exception_name": "PackagesNotFoundError",
  "exception_type": "<class 'conda.exceptions.PackagesNotFoundError'>",
  "message": "The following packages are not available from current channels:\n\n  - *\n\nCurrent channels:\n\n  - https://conda.anaconda.org/arrow-nightlies/win-64\n  - https://conda.anaconda.org/arrow-nightlies/noarch\n\nTo search for alternate channels that may provide the conda package you're\nlooking for, navigate to\n\n    https://anaconda.org\n\nand use the search bar at the top of the page.\n",
  "packages": [
    "*"
  ],
  "packages_formatted": "  - *"
}
 

The issue seems to be that some of our packages have been failing for so long that when trying to clean them there are no left and we fail. See the current installers that appear (https://anaconda.org/arrow-nightlies/arrow-cpp):

Installers
    osx-arm64 v10.0.0.dev474
    linux-ppc64le v10.0.0.dev507
    linux-aarch64 v10.0.0.dev507
    osx-64 v10.0.0.dev372
    linux-64 v10.0.0.dev507
 

Issue Links

• links to: GitHub Pull Request #14569