Follow the instructions here to install the latest jetpack release (5.1.1)

sudo apt-get update
sudo apt-get upgrade
sudo apt-get auto-remove

sudo apt install -y python3-pip
pip3 install --upgrade pip

I recommend installing nano for some simple text editing

sudo apt install nano

Then visit the nvidia website and select the newest version number. As of writing this, that's this one. Please ensure that this matches your torchvision version!

wget https://developer.download.nvidia.com/compute/redist/jp/v511/pytorch/torch-2.0.0+nv23.05-cp38-cp38-linux_aarch64.whl
pip3 install ./torch-2.0.0+nv23.05-cp38-cp38-linux_aarch64.whl

Visit the torchvision github and check the tags. Select the latest one, or the one compatible with your pytorch version (v0.15.1 as of writing this) Make sure to specify that branch, then build from source.

sudo apt install libjpeg libpng
git clone --branch v0.15.1 https://github.com/pytorch/vision torchvision
cd torchvision
python3 setup.py install --user

cd ../api
pip3 install -r requirements.txt

To install the client you need to install npm and node js then install and run the build.

cd ../client
sudo apt-get install npm
sudo npm install
sudo npm run build

You may need to update numpy with:

pip3 install numpy --upgrade

If you use vscode for development, it won't launch. As a workaround, launch it from the terminal after installing it with:

code . --no-sandbox