Hi,
I have tested using this setup on a boolean field and it works as expected. Maybe I misunderstood how you had set it up, but check if you have configured it using the “If no” and using the “Prevent email from being sent” action as shown in the attached screenshot.
Alexander
