I want to search for $ in the subject line, but I can't seem to get the syntax.

Try one of these:

if $h_subject: contains \$ then ...
if $h_subject: contains "\\$" then ...