uv是rust编写的速度更快的python环境管理工具(类似增强版pip+venv)
如果只是纯管理python扩展,用uv可能比conda更快更好)
先安装uv
curl -LsSf https://astral.sh/uv/install.sh | sh安装后激活uv
source $HOME/.local/bin/env下载python3.12
uv python install 3.12在合适的项目文件夹创建虚拟环境
uv venv --python 3.12激活环境
source .venv/bin/activate安装unsloth
uv pip install unsloth安装vllm(可选)
uv pip install vllm升级unsloth,先卸载再安装
uv pip uninstall unsloth unsloth-zoo vllm xformers torch torchvision
uv pip install --no-cache-dir "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
uv pip install vllm