Learn Makefiles With the tastiest examples - JohnHau/mis GitHub Wiki
I built this guide because I could never quite wrap my head around Makefiles. They seemed awash with hidden rules and esoteric symbols, and asking simple questions didn’t yield simple answers. To solve this, I sat down for several weekends and read everything I could about Makefiles. I've condensed the most critical knowledge into this guide. Each topic has a brief description and a self contained example that you can run yourself.
If you mostly understand Make, consider checking out the Makefile Cookbook, which has a template for medium sized projects with ample comments about what each part of the Makefile is doing.
Good luck, and I hope you are able to slay the confusing world of Makefiles!
Getting Started Why do Makefiles exist? Makefiles are used to help decide which parts of a large program need to be recompiled. In the vast majority of cases, C or C++ files are compiled. Other languages typically have their own tools that serve a similar purpose as Make. It can be used beyond programs too, when you need a series of instructions to run depending on what files have changed. This tutorial will focus on the C/C++ compilation use case.
Here's an example dependency graph that you might build with Make. If any file's dependencies changes, then the file will get recompiled:
What alternatives are there to Make? Popular C/C++ alternative build systems are SCons, CMake, Bazel, and Ninja. Some code editors like Microsoft Visual Studio have their own built in build tools. For Java, there's Ant, Maven, and Gradle. Other languages like Go and Rust have their own build tools.
Interpreted languages like Python, Ruby, and Javascript don't require an analogue to Makefiles. The goal of Makefiles is to compile whatever files need to be compiled, based on what files have changed. But when files in interpreted languages change, nothing needs to get recompiled. When the program runs, the most recent version of the file is used.
The versions and types of Make There are a variety of implementations of Make, but most of this guide will work on whatever version you're using. However, it's specifically written for GNU Make, which is the standard implementation on Linux and MacOS. All the examples work for Make versions 3 and 4, which are nearly equivalent other than some esoteric differences.
Running the Examples To run these examples, you'll need a terminal and "make" installed. For each example, put the contents in a file called Makefile, and in that directory run the command make. Let's start with the simplest of Makefiles:
hello: echo "hello world" Here is the output of running the above example:
$ make echo "hello world" hello world That's it! If you're a bit confused, here's a video that goes through these steps, along with describing the basic structure of Makefiles.
Makefile Syntax A Makefile consists of a set of rules. A rule generally looks like this:
targets: prerequisites command command command The targets are file names, separated by spaces. Typically, there is only one per rule. The commands are a series of steps typically used to make the target(s). These need to start with a tab character, not spaces. The prerequisites are also file names, separated by spaces. These files need to exist before the commands for the target are run. These are also called dependencies Beginner Examples The following Makefile has three separate rules. When you run make blah in the terminal, it will build a program called blah in a series of steps:
Make is given blah as the target, so it first searches for this target blah requires blah.o, so make searches for the blah.o target blah.o requires blah.c, so make searches for the blah.c target blah.c has no dependencies, so the echo command is run The cc -c command is then run, because all of the blah.o dependencies are finished The top cc command is run, because all the blah dependencies are finished That's it: blah is a compiled c program blah: blah.o cc blah.o -o blah # Runs third
blah.o: blah.c cc -c blah.c -o blah.o # Runs second
blah.c: echo "int main() { return 0; }" > blah.c # Runs first This makefile has a single target, called some_file. The default target is the first target, so in this case some_file will run.
some_file: echo "This line will always print" This file will make some_file the first time, and the second time notice it's already made, resulting in make: 'some_file' is up to date.
some_file: echo "This line will only print once" touch some_file Here, the target some_file "depends" on other_file. When we run make, the default target (some_file, since it's first) will get called. It will first look at its list of dependencies, and if any of them are older, it will first run the targets for those dependencies, and then run itself. The second time this is run, neither target will run because both targets exist.
some_file: other_file echo "This will run second, because it depends on other_file" touch some_file
other_file: echo "This will run first" touch other_file This will always run both targets, because some_file depends on other_file, which is never created.
some_file: other_file touch some_file
other_file: echo "nothing" clean is often used as a target that removes the output of other targets, but it is not a special word in make.
some_file: touch some_file
clean: rm -f some_file Variables Variables can only be strings. You'll typically want to use :=, but = also works. See Variables Pt 2.
Here's an example of using variables:
files := file1 file2
some_file:
file1: touch file1 file2: touch file2
clean:
rm -f file1 file2 some_file
Reference variables using either
x := dude
all:
echo
# Bad practice, but works
echo $x
Targets The all target Making multiple targets and you want all of them to run? Make an all target.
all: one two three
one: touch one two: touch two three: touch three
clean: rm -f one two three Multiple targets When there are multiple targets for a rule, the commands will be run for each target $@ is an automatic variable that contains the target name.
all: f1.o f2.o
f1.o f2.o: echo $@
Automatic Variables and Wildcards
- Wildcard Both * and % are called wildcards in Make, but they mean entirely different things. * searches your filesystem for matching filenames. I suggest that you always wrap it in the wildcard function, because otherwise you may fall into a common pitfall described below.
print:
- may be used in the target, prerequisites, or in the wildcard function.
Danger: * may not be directly used in a variable definitions
Danger: When * matches no files, it is left as it is (unless run in the wildcard function)
thing_wrong := .o # Don't do this! '' will not get expanded thing_right := $(wildcard *.o)
all: one two three four
one: $(thing_wrong)
two: *.o
three: $(thing_right)
four: $(wildcard *.o) % Wildcard % is really useful, but is somewhat confusing because of the variety of situations it can be used in.
When used in "matching" mode, it matches one or more characters in a string. This match is called the stem. When used in "replacing" mode, it takes the stem that was matched and replaces that in a string. % is most often used in rule definitions and in some specific functions. See these sections on examples of it being used:
Static Pattern Rules Pattern Rules String Substitution The vpath Directive Automatic Variables There are many automatic variables, but often only a few show up:
hey: one two # Outputs "hey", since this is the first target echo $@
# Outputs all prerequisites newer than the target
echo $?
# Outputs all prerequisites
echo $^
touch hey
one: touch one
two: touch two
clean: rm -f hey one two Fancy Rules Implicit Rules Make loves c compilation. And every time it expresses its love, things get confusing. Perhaps the most confusing part of Make is the magic/automatic rules that are made. Make calls these "implicit" rules. I don't personally agree with this design decision, and I don't recommend using them, but they're often used and are thus useful to know. Here's a list of implicit rules:
Compiling a C program: n.o is made automatically from n.c with a command of the form
CC: Program for compiling C programs; default cc CXX: Program for compiling C++ programs; default g++ CFLAGS: Extra flags to give to the C compiler CXXFLAGS: Extra flags to give to the C++ compiler CPPFLAGS: Extra flags to give to the C preprocessor LDFLAGS: Extra flags to give to compilers when they are supposed to invoke the linker Let's see how we can now build a C program without ever explicitly telling Make how to do the compililation:
CC = gcc # Flag for implicit rules CFLAGS = -g # Flag for implicit rules. Turn on debug info
blah: blah.o
blah.c: echo "int main() { return 0; }" > blah.c
clean: rm -f blah* Static Pattern Rules Static pattern rules are another way to write less in a Makefile, but I'd say are more useful and a bit less "magic". Here's their syntax:
targets...: target-pattern: prereq-patterns ... commands The essence is that the given target is matched by the target-pattern (via a % wildcard). Whatever was matched is called the stem. The stem is then substituted into the prereq-pattern, to generate the target's prereqs.
A typical use case is to compile .c files into .o files. Here's the manual way:
objects = foo.o bar.o all.o all: $(objects)
foo.o: foo.c bar.o: bar.c all.o: all.c
all.c: echo "int main() { return 0; }" > all.c
%.c: touch $@
clean: rm -f *.c *.o all Here's the more efficient way, using a static pattern rule:
objects = foo.o bar.o all.o all: $(objects)
In the case of the first target, foo.o, the target-pattern matches foo.o and sets the "stem" to be "foo".
$(objects): %.o: %.c
all.c: echo "int main() { return 0; }" > all.c
%.c: touch $@
clean: rm -f *.c *.o all Static Pattern Rules and Filter While I introduce functions later on, I'll foreshadow what you can do with them. The filter function can be used in Static pattern rules to match the correct files. In this example, I made up the .raw and .result extensions.
obj_files = foo.result bar.o lose.o src_files = foo.raw bar.c lose.c
.PHONY: all all: $(obj_files)
%.c %.raw: touch $@
clean: rm -f $(src_files) Pattern Rules Pattern rules are often used but quite confusing. You can look at them as two ways:
A way to define your own implicit rules A simpler form of static pattern rules Let's start with an example first:
%.o : %.c
Here's another example:
%.c: touch $@ Double-Colon Rules Double-Colon Rules are rarely used, but allow multiple rules to be defined for the same target. If these were single colons, a warning would be printed and only the second set of commands would run.
all: blah
blah:: echo "hello"
blah:: echo "hello again" Commands and execution Command Echoing/Silencing Add an @ before a command to stop it from being printed You can also run make with -s to add an @ before each line
all: @echo "This make line will not be printed" echo "But this will" Command Execution Each command is run in a new shell (or at least the effect is as such)
all:
cd ..
# The cd above does not affect this line, because each command is effectively run in a new shell
echo pwd
# This cd command affects the next because they are on the same line
cd ..;echo `pwd`
# Same as above
cd ..; \
echo `pwd`
Default Shell The default shell is /bin/sh. You can change this by changing the variable SHELL:
SHELL=/bin/bash
cool: echo "Hello from bash" Error handling with -k, -i, and - Add -k when running make to continue running even in the face of errors. Helpful if you want to see all the errors of Make at once. Add a - before a command to suppress the error Add -i to make to have this happen for every command.
one: # This error will be printed but ignored, and make will continue to run -false touch one Interrupting or killing make Note only: If you ctrl+c make, it will delete the newer targets it just made.
Recursive use of make To recursively call a makefile, use the special $(MAKE) instead of make because it will pass the make flags for you and won't itself be affected by them.
new_contents = "hello:\n\ttouch inside_file"
all:
mkdir -p subdir
printf
clean: rm -rf subdir Use export for recursive make The export directive takes a variable and makes it accessible to sub-make commands. In this example, cooly is exported such that the makefile in subdir can use it.
Note: export has the same syntax as sh, but they aren't related (although similar in function)
new_contents = "hello:\n\techo $$(cooly)"
all:
mkdir -p subdir
echo
cooly = "The subdirectory can see me!" export cooly
clean: rm -rf subdir You need to export variables to have them run in the shell as well.
one=this will only work locally export two=we can run subcommands with this
all:
@echo
.EXPORT_ALL_VARIABLES: new_contents = "hello:\n\techo $$(cooly)"
cooly = "The subdirectory can see me!"
all:
mkdir -p subdir
echo
clean: rm -rf subdir Arguments to make There's a nice list of options that can be run from make. Check out --dry-run, --touch, --old-file.
You can have multiple targets to make, i.e. make clean run test runs the clean goal, then run, and then test.
Variables Pt. 2 Flavors and modification There are two flavors of variables:
recursive (use =) - only looks for the variables when the command is used, not when it's defined. simply expanded (use :=) - like normal imperative programming -- only those defined so far get expanded
one = one ${later_variable}
two := two ${later_variable}
later_variable = later
all:
echo
one = hello
one := ${one} there
all: echo $(one) ?= only sets variables if they have not yet been set
one = hello one ?= will not be set two ?= will be set
all:
echo
with_spaces = hello # with_spaces has many spaces after "hello" after = $(with_spaces)there
nullstring = space = $(nullstring) # Make a variable with a single space.
all: echo "$(after)" echo start"$(space)"end An undefined variable is actually an empty string!
all: # Undefined variables are just empty strings! echo $(nowhere) Use += to append
foo := start foo += more
all: echo $(foo) String Substitution is also a really common and useful way to modify variables. Also check out Text Functions and Filename Functions.
Command line arguments and override You can override variables that come from the command line by using override. Here we ran make with make option_one=hi
override option_one = did_override
option_two = not_override
all:
echo
one = export blah="I was set!"; echo $$blah
define two export blah=set echo $$blah endef
all: @echo "This prints 'I was set'" @$(one) @echo "This does not print 'I was set' because each command runs in a separate shell" @$(two) Target-specific variables Variables can be assigned for specific targets
all: one = cool
all: echo one is defined: $(one)
other: echo one is nothing: $(one) Pattern-specific variables You can assign variables for specific target patterns
%.c: one = cool
blah.c: echo one is defined: $(one)
other: echo one is nothing: $(one) Conditional part of Makefiles Conditional if/else foo = ok
all:
ifeq (
all:
ifeq (
bar = foo = $(bar)
all: ifdef foo echo "foo is defined" endif ifdef bar echo "but bar is not" endif $(makeflags) This example shows you how to test make flags with findstring and MAKEFLAGS. Run this example with make -i to see it print out the echo statement.
bar = foo = $(bar)
all:
Search for the "-i" flag. MAKEFLAGS is just a list of single characters, one per flag. So look for "i" in this case.
ifneq (,$(findstring i,
bar :=
comma := ,
empty:=
space :=
all: @echo $(bar) Do NOT include spaces in the arguments after the first. That will be seen as part of the string.
comma := ,
empty:=
space :=
all:
# Output is ", a , b , c". Notice the spaces introduced
@echo
"Finds whitespace-separated words in text that match pattern and replaces them with replacement. Here pattern may contain a ‘%’ which acts as a wildcard, matching any number of any characters within a word. If replacement also contains a ‘%’, the ‘%’ is replaced by the text that matched the ‘%’ in pattern. Only the first ‘%’ in the pattern and replacement is treated this way; any subsequent ‘%’ is unchanged." (GNU docs)
The substitution reference $(text:pattern=replacement) is a shorthand for this.
There's another shorthand that that replaces only suffixes: $(text:suffix=replacement). No % wildcard is used here.
Note: don't add extra spaces for this shorthand. It will be seen as a search or replacement term.
foo := a.o b.o l.a c.o
one :=
two := $(foo:%.o=%.c)
three := $(foo:.o=.c)
all:
echo
foo := who are you
bar :=
all: # Output is "who! are! you!" @echo $(bar) The if function if checks if the first argument is nonempty. If so runs the second argument, otherwise runs the third.
foo :=
all:
@echo
sweet_new_fn = Variable Name:
all: # Outputs "Variable Name: sweet_new_fn First: go Second: tigers Empty Variable:" @echo $(call sweet_new_fn, go, tigers) The shell function shell - This calls the shell, but it replaces newlines with spaces!
all: @echo $(shell ls -la) # Very ugly because the newlines are gone! Other Features Include Makefiles The include directive tells make to read one or more other makefiles. It's a line in the makefile makefile that looks like this:
include filenames... This is particularly useful when you use compiler flags like -M that create Makefiles based on the source. For example, if some c files includes a header, that header will be added to a Makefile that's written by gcc. I talk about this more in the Makefile Cookbook
The vpath Directive Use vpath to specify where some set of prerequisites exist. The format is vpath <directories, space/colon separated> can have a %, which matches any zero or more characters. You can also do this globallyish with the variable VPATH
vpath %.h ../headers ../other-directory
some_binary: ../headers blah.h touch some_binary
../headers: mkdir ../headers
blah.h: touch ../headers/blah.h
clean: rm -rf ../headers rm -f some_binary Multiline The backslash ("") character gives us the ability to use multiple lines when the commands are too long
some_file:
echo This line is too long, so
it is broken up into multiple lines
.phony
Adding .PHONY to a target will prevent make from confusing the phony target with a file name. In this example, if the file clean is created, make clean will still be run. .PHONY is great to use, but I'll skip it in the rest of the examples for simplicity.
some_file: touch some_file touch clean
.PHONY: clean clean: rm -f some_file rm -f clean .delete_on_error The make tool will stop running a rule (and will propogate back to prerequisites) if a command returns a nonzero exit status. DELETE_ON_ERROR will delete the target of a rule if the rule fails in this manner. This will happen for all targets, not just the one it is before like PHONY. It's a good idea to always use this, even though make does not for historical reasons.
.DELETE_ON_ERROR: all: one two
one: touch one false
two: touch two false Makefile Cookbook Let's go through a really juicy Make example that works well for medium sized projects.
The neat thing about this makefile is it automatically determines dependencies for you. All you have to do is put your C/C++ files in the src/ folder.
Thanks to Job Vranish (https://spin.atomicobject.com/2016/08/26/makefile-c-projects/)
TARGET_EXEC := final_program
BUILD_DIR := ./build SRC_DIRS := ./src
SRCS :=
OBJS :=
DEPS := $(OBJS:.o=.d)
INC_DIRS :=
INC_FLAGS :=
CPPFLAGS := $(INC_FLAGS) -MMD -MP
.PHONY: clean clean: rm -r $(BUILD_DIR)
-include $(DEPS)