Compile firmware - portapack-mayhem/mayhem-firmware GitHub Wiki
There are severals ways to compile the firmware. As the traditional way, check the original Building from Source document, however, Docker is recommended because it provides a very clean way to go from source to a .bin
file.
Using Buddyworks and other CI platforms
Notes for Buddy.Works (and other CI platforms)
All in one script for ARM on Debian host
- Install Docker
- Get Kitematic
- Install GitHub Desktop
If you are using Windows, line endings may produce some errors. For example: 'python/r' not found
messages are product of a problem with the line endings. This must be done prior to cloning the repository for compilation to succeed. To prevent this, configure git to not manipulate these line endings, open a terminal and execute:
y
git config --global core.autocrlf false
You can also check the current configuration by omitting the false
at the end of the command.
Important: If you want to collaborate to the project, Fork the repository to your own account and continue this instructions from your own fork.
Open Github Desktop, and click "Open with Github Desktop" from the main page of the repository (or your fork), under the button "Code".
Finally, create a build
folder inside of the repository. From Github Desktop, just click "Repository / Show in Explorer" and create an empty folder named build
. This folder will be used for the compilation output.
Note: You need to make sure you have also cloned the hackrf folder. to do that run: git submodule update --init --recursive
Open up a terminal in the root of the cloned git repo and run: docker build -t portapack-dev -f dockerfile-nogit .
(the image only works on x86 systems, if you are running docker on an arm system, as a workaround, you can get it build and run an amd64 image but it will run in x86 emulation and will be slow. To make the amd64 image use: docker build --platform linux/amd64 -t portapack-dev -f dockerfile-nogit .
)
After its built the docker image, go back to docker and you should see this screen under images
Click on the blue run button and then click the dropdown to expand Optional Settings.
Make sure they look like this:
Host path
is the root of your repo.
After that click run!
Note: Come across a /usr/bin/env: ‘python\r’: No such file or directory
error? RTFM and go back to step 2 https://github.com/portapack-mayhem/mayhem-firmware/wiki/Compile-firmware#step-2-clone-the-repository
Everytime you run the container you prepared in the previous step, it will compile the source and (if successful) leave the results in build/firmware/
If you have additional questions, please check this guide.
If you are inclined for using the command line, you can try the following:
- Clone the repository and submodules:
git clone https://github.com/portapack-mayhem/mayhem-firmware.git
cd portapack-mayhem
git submodule update --init --recursive
-
For building the docker image:
docker build -t portapackccache -f dockerfile-nogit .
-
For running the image to build firmware (in the root of the repo):
docker run -it --rm -v ${PWD}:/havoc portapackccache
This runs and then immediatelly deletes the container, so that they arent pile up in your docker instance.-
You can specify the number of jobs to run in parallel during compilation. To speed up the build specify the number of cores available:
docker run -it --rm -v ${PWD}:/havoc portapackccache -j4
-
Alternatively if you want to have a single persistent container, and just execute it when necessary
-
Create the persistent container (it will also build the firmware once):
docker run --name portapackbuild -it -v ${PWD}:/havoc portapackccache -j4
-
Run the existing container:
docker start portapackbuild
-
-
You no longer have to create a build
folder before running the image.
You can use the following _yml _as your template for your CI platform (pipeline export from buddy.works):
- pipeline: "Build firmware"`
`trigger_mode: "ON_EVERY_PUSH"`
`ref_name: "master"`
`ref_type: "BRANCH"`
`auto_clear_cache: true`
`trigger_condition: "ALWAYS"`
`actions:`
`- action: "Build Docker image"`
`type: "DOCKERFILE"`
`dockerfile_path: "dockerfile-nogit"`
`do_not_prune_images: true`
`trigger_condition: "ALWAYS"`
`- action: "Execute: mkdir build"`
`type: "BUILD"`
`working_directory: "/buddy/portapack-havoc"`
`docker_image_name: "library/ubuntu"`
`docker_image_tag: "18.04"`
`execute_commands:`
`- "mkdir -p build"`
`volume_mappings:`
`- "/:/buddy/portapack-havoc"`
`trigger_condition: "ALWAYS"`
`shell: "BASH"`
`- action: "Run Docker Image"`
`type: "RUN_DOCKER_CONTAINER"`
`use_image_from_action: true`
`volume_mappings:`
`- "/:/havoc"`
`trigger_condition: "ALWAYS"`
`shell: "SH"
If you decide to ignore this guide and use the command line instead, you will need to include submodules
git clone --recurse-submodules --remote-submodules <url>
-
Untested on other linux flavors
-
Thanks to @aj#3566 from discord for it
-
For convenience the compiler will be installed to /opt/build
-
Needed steps
- Update a Debian based OS
- Install the necessary ARM compiler to /opt/armbin (if not done before)
- Link ARM compiler to your bash environment
- Clone Mayhem repository from GitHub (if not done before)
- Giver user permission to the Mayhem repository
- Create makefile through cmake and compile
- Flash the firmware
-
Once done you only need to call 'make' in the /opt/portapack-mayhem/firmware/build directory
-
You can speed up the building process by calling 'make -j 8' instead, where 8 is the number of physical CPU cores (if you have some compiling errors to check it's better to call it without '-j 8')
-
Use the following commands while logged into your every day user profile. :)
sudo apt-get update
sudo apt-get install -y git tar wget dfu-util cmake python3 bzip2 lz4 curl hackrf python3-distutils python3-setuptools
curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py; python3 get-pip.py
pip install pyyaml
sudo mkdir /opt/build
cd /opt/build
sudo wget -O gcc-arm-none-eabi.tar.bz2 'https://developer.arm.com/-/media/Files/downloads/gnu-rm/9-2020q2/gcc-arm-none-eabi-9-2020-q2-update-x86_64-linux.tar.bz2?revision=05382cca-1721-44e1-ae19-1e7c3dc96118&la=en&hash=D7C9D18FCA2DD9F894FD9F3C3DC9228498FA281A'
sudo mkdir armbin
sudo tar --strip=1 -xjvf gcc-arm-none-eabi.tar.bz2 -C armbin
Download an up to date version here if you want to try: https://developer.arm.com/downloads/-/arm-gnu-toolchain-downloads
The nightly build/release system is using version 9.2.1, known as 9-2019-q4-major, found here: https://developer.arm.com/downloads/-/gnu-rm
Don't forget to change the paths or filenames accordingly
echo 'PATH=/opt/build/armbin/bin:/opt/build/armbin/lib:$PATH' >> ~/.bashrc
source ~/.bashrc
cd /opt
sudo git clone --recurse-submodules https://github.com/portapack-mayhem/mayhem-firmware.git
sudo chown -R my_user:my_usergroup /opt/portapack-mayhem
6. Create makefile through cmake and compile (it's important to call the PATH cmd in step 3 just before making the cmake)
cd /opt/portapack-mayhem
mkdir build
cd build
cmake ..
make
If you want, use -j argument to increase the compile speed, for example make -j
to auto decide the numbers of threads to compile, or manually set the thread numbers, for example make -j4
Developers wishing to test selected functions in the firmware code by running them on their linux PC can also use the command make build_tests
and then ctest --output-on-failure
to run the tests.
hackrf_spiflash -w /opt/portapack-mayhem/build/firmware/portapack-h1_h2-mayhem.bin
If you want to have all these commands in one go, go to https://github.com/GullCode/compile-flash-mayhem and download compile-flash-mayhem.sh and adjust it to fit your needs
- Linux Aarch64 gcc-arm-none-eabi-9-2020-q2-update-aarch64-linux.tar.bz2
- Toolsets archive
- Compilation error after changing toolsets
Tested at 21. Sept. 2024 on Kali 2024.3 kali-rolling
Should work for any Debian based Distribution, see comments.
sudo apt update
sudo apt install git tar bzip2 lz4 wget curl cmake python3 python3-setuptools python3-distutils-extra python3-yaml dfu-util hackrf
In many distributions the tool hackrf
is provided, but outdated because of the release policy. Kali is rolling release, so does not follow this restrictions.
If you have a R9 or newer HackRF and need a newer version, I recommended to download and compile it by yourself. Source: https://github.com/greatscottgadgets/hackrf
If you use another Version as 9.2.1, the mayham cmake warns you:
WARNING: Compiler version mismatch, please use the official compiler version 9.2.1 when sharing builds! Current compiler version: 13.2.1
It might compile. From other projects, as Proxmark3 or Chameleon Ultra, we know the gcc-arm-none-eabi in version 13 (provided by various distributions) creates a bigger firmware image, which won't fit into the memory. Even if it compiles without error, the firmware file is useless.
sudo mkdir /opt/build
sudo chmod $USER:$(id -gn $USER) /opt/build
cd /opt/build
wget https://developer.arm.com/-/media/Files/downloads/gnu-rm/9-2019q4/gcc-arm-none-eabi-9-2019-q4-major-x86_64-linux.tar.bz2
mkdir armbin
tar --strip=1 -xjvf gcc-arm-none-eabi-9-2019-q4-major-x86_64-linux.tar.bz2 -C armbin
I recommend to adjust the user rights at the first possible moment. Work as root as less as possible.
If more than one person works in the system, feel free to set the group to something more generic. For example src
or staff
.
Source for the newest toolcain: https://developer.arm.com/downloads/-/arm-gnu-toolchain-downloads
Source for deprecated toolchain: https://developer.arm.com/downloads/-/gnu-rm
echo 'PATH=/opt/build/armbin/bin:/opt/build/armbin/lib:$PATH' >> ~/.zshrc
source ~/.zshrc
Kali Linux uses ZSH as default shell. On Debian is Bash the default shell, so if you are using Debian or changed the default shell, you need to pipe the echo into ~/.bashrc (or the related rc file)
cd ~
mkdir git
cd git
git clone https://github.com/portapack-mayhem/mayhem-firmware/ --recurse-submodules
Personal Note:
You could work at any place, for example
/opt
. The FHS says/usr/src
wold be the right place for source codes. But this would be in/
and most systems I know got roundabout 20 to 50 GB for/
and several 100 GB for/home
, so I decide to work with git in /home.
cd ~/git/mayhem-firmware
mkdir build
cd build
cmake ..
make clean && make
For the first compile make clean &&
is not necessary. But if the compilation stops of any reason, you need to use clean. If nothing is there, it won't hurt.