User Manual - flagos-ai/FlagTree GitHub Wiki

Installation manual

💫 NVIDIA nvidia

💫 NVIDIA tileir

💫 AMD amd

💫 ARM China(安谋科技)aipu

💫 Enflame(燧原)enflame

💫 Huawei Ascend(华为昇腾)ascend

💫 Huixi(辉羲智能)rpu

💫 HYGON(海光信息)hcu

💫 ILUVATAR(天数智芯)iluvatar

💫 MetaX(沐曦股份)metax

💫 Moore Threads(摩尔线程)mthreads

💫 SpacemiT(进迭时空)spacemit

💫 Sunrise(曦望芯科)sunrise

💫 T-Head(平头哥)ppu

💫 Tsingmicro(清微智能)tsingmicro

💫 KLX xpu

💫 ARM64 cpu


Source-free Installation

The best practice to avoid environment compatibility issues is to use the image mentioned in the backend documents above.

# Note: First install PyTorch, then execute the following commands
python3 -m pip uninstall -y triton  # Repeat the cmd until fully uninstalled
RES="--index-url=https://resource.flagos.net/repository/flagos-pypi-hosted/simple"
Backend Install command(The version corresponds to the git tag) Tritonver. libc.so &libstdc++.so
nvidia python3.12 -m pip install flagtree===0.7.0 $RES 3.6 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
tileir python3.12 -m pip install flagtree===0.7.0+tileir3.6 $RES 3.6 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
amd python3.12 -m pip install flagtree===0.7.0+amd3.6 $RES 3.6 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
aipu python3.10 -m pip install flagtree===0.5.0+aipu3.3 $RES 3.3 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
ascend python3.11 -m pip install flagtree===0.7.0+ascend3.5 $RES 3.5 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
ascend python3.11 -m pip install flagtree===0.6.0+ascend3.2 $RES 3.2 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
enflame python3.12 -m pip install flagtree===0.7.0+enflame3.6 $RES 3.6 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
enflame python3.12 -m pip install flagtree===0.5.0+enflame3.5 $RES 3.5 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
enflame python3.10 -m pip install flagtree===0.4.0+enflame3.3 $RES 3.3 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
hcu python3.10 -m pip install flagtree===0.7.0+hcu3.6 $RES 3.6 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
hcu python3.10 -m pip install flagtree===0.5.1+hcu3.1 $RES 3.1 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
iluvatar python3.12 -m pip install flagtree===0.7.1a1+iluvatar3.6 $RES 3.6 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
iluvatar python3.12 -m pip install flagtree===0.5.1+iluvatar3.1 $RES 3.1 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
iluvatar python3.10 -m pip install flagtree===0.5.1+iluvatar3.1 $RES 3.1 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
metax python3.12 -m pip install flagtree===0.7.0+metax3.6 $RES 3.6 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
metax python3.12 -m pip install flagtree===0.5.1+metax3.0 $RES 3.0 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
mthreads python3.10 -m pip install flagtree===0.7.0+mthreads3.6 $RES 3.6 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
mthreads python3.10 -m pip install flagtree===0.5.1+mthreads3.2 $RES 3.2 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
mthreads python3.10 -m pip install flagtree===0.5.1+mthreads3.1 $RES 3.1 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
ppu python3.12 -m pip install flagtree===0.7.0+ppu3.6 $RES 3.6 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
sunrise python3.10 -m pip install flagtree===0.7.0+sunrise3.6 $RES 3.6 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
sunrise python3.10 -m pip install flagtree===0.4.0+sunrise3.4 $RES 3.4 GLIBC_2.39GLIBCXX_3.4.33CXXABI_1.3.15
tsingmicro python3.10 -m pip install flagtree===0.7.0+tsingmicro3.6 $RES 3.6 GLIBC_2.30GLIBCXX_3.4.28CXXABI_1.3.12
tsingmicro python3.10 -m pip install flagtree===0.7.0+tsingmicro3.3 $RES 3.3 GLIBC_2.30GLIBCXX_3.4.28CXXABI_1.3.12
xpu python3.10 -m pip install flagtree===0.7.1a1+xpu3.6 $RES 3.6 GLIBC_2.35GLIBCXX_3.4.30CXXABI_1.3.13
xpu python3.10 -m pip install flagtree===0.5.1+xpu3.0 $RES 3.0 GLIBC_2.31GLIBCXX_3.4.28CXXABI_1.3.12

Historical versions of flagtree can be found at https://resource.flagos.net/#browse/search/pypi/=repository_name%3Dflagos-pypi-hosted%20AND%20name.raw%3Dflagtree