Can't disable motion notifications in Rapid Ring app

I live on a fairly busy street so I'd like my doorbell to record people passing my door, but not to give a notification unless the button is pressed. It seems that this should be possible by switching off motion notifications in the Rapid Ring app (I use the Android version). However, it doesn't work. Regardless of whether the toggle is on or off, I still receive notifications. The motion alert icon colour doesn't change either, it just stays in the "off" mode. If I press it, a brief "motion notifications enabled" message pops up, but it never shows "motion notifications disabled" however many times I press the button. Is this a known fault with the app, or should I report it? Thanks!