Single quotes ' preserve the literal value of every character contained within the quotes, including the escape character:
echo 'PATH is $PATH' # PATH will not be expanded
Double quotes " preserve the literal value of most characters contained within the quotes, exception includes $ (variables), ' (single quotes) and \ (escaping characters)
echo "PATH is $PATH" # $PATH will be expanded