Skip to content

Instantly share code, notes, and snippets.

@crypdick
Last active January 5, 2026 22:48
Show Gist options
  • Select an option

  • Save crypdick/931375411b72be8b4344144286851382 to your computer and use it in GitHub Desktop.

Select an option

Save crypdick/931375411b72be8b4344144286851382 to your computer and use it in GitHub Desktop.
Stack trace and repro for Ray setup-dev.sh failure
#!/bin/bash
# Repro for setup-dev.py crashing on macOS ARM64 + Python 3.13
# Follows: https://docs.ray.io/en/latest/ray-contribute/development.html#building-ray-python-only
set -e
cd "$(dirname "${BASH_SOURCE[0]}")"
rm -rf .venv /tmp/ray/_serve
python3 -m venv .venv
source .venv/bin/activate
pip install --upgrade pip wheel -q
PY_VER=$(python -c "import sys; print(f'{sys.version_info.major}{sys.version_info.minor}')")
pip install -U "https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-3.0.0.dev0-cp${PY_VER}-cp${PY_VER}-macosx_11_0_arm64.whl" -q
python python/ray/setup-dev.py -y
echo "Testing imports after setup-dev.py..."
python -c "import ray; import ray.tune; import ray.train"
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/llm to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/llm
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/llm to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/llm.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/serve/llm to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/serve/llm
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/serve/llm to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/serve/llm.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/data/llm.py to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/data/llm.py
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/data/llm.py to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/data/llm.py.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/rllib to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/rllib
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/rllib to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/rllib.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/air to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/air
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/air to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/air.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/tune to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/tune
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/tune to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/tune.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/train to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/train
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/train to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/train.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/autoscaler to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/autoscaler
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/autoscaler to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/autoscaler.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/cloudpickle to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/cloudpickle
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/cloudpickle to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/cloudpickle.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/data to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/data
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/data to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/data.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/scripts to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/scripts
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/scripts to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/scripts.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/internal to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/internal
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/internal to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/internal.bak
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/tests does not exist. Continuing to link.
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/tests to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/tests
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/experimental to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/experimental
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/experimental to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/experimental.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/util to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/util
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/util to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/util.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/workflow to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/workflow
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/workflow to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/workflow.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/serve to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/serve
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/serve to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/serve.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/dag to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/dag
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/dag to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/dag.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/widgets to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/widgets
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/widgets to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/widgets.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/cluster_utils.py to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/cluster_utils.py
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/cluster_utils.py to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/cluster_utils.py.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/_private to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/_private
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/_private to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/_private.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/_common to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/_common
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/_common to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/_common.bak
Creating symbolic link from
/Users/rdecal/src/ANYSCALE/ray/python/ray/dashboard to
/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/dashboard
Creating backup of /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/dashboard to /Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/dashboard.bak
Created links.
If you run into issues initializing Ray, please ensure that your local repo and the installed Ray are in sync (pip install -U the latest wheels at https://docs.ray.io/en/master/installation.html, and ensure you are up-to-date on the master branch on git).
Note that you may need to delete the package symlinks when pip installing new Ray versions to prevent pip from overwriting files in your git repo.
Testing imports after setup-dev.py...
Traceback (most recent call last):
File "<string>", line 1, in <module>
import ray; import ray.tune; import ray.train
^^^^^^^^^^
File "/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/__init__.py", line 85, in <module>
import ray._raylet # noqa: E402
^^^^^^^^^^^^^^^^^^
File "python/ray/_raylet.pyx", line 188, in init ray._raylet
include "includes/serialization.pxi"
File "/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/exceptions.py", line 20, in <module>
from ray.util.annotations import DeveloperAPI, PublicAPI
File "/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/util/__init__.py", line 6, in <module>
from ray._private.services import get_node_instance_id, get_node_ip_address
File "/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/_private/services.py", line 22, in <module>
from ray._common.network_utils import (
...<5 lines>...
)
File "/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/_common/network_utils.py", line 6, in <module>
from ray._raylet import (
...<4 lines>...
)
ImportError: cannot import name 'build_address' from partially initialized module 'ray._raylet' (most likely due to a circular import) (/Users/rdecal/src/ANYSCALE/ray/.venv/lib/python3.13/site-packages/ray/_raylet.so)
✘ rdecal@rdecal-JW5G6QM24Q  ~/src/ANYSCALE/ray   master ±✚ 
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment