Keypad chirp on all alarms even when disarmed

Is it possible to toggle which sensors cause a chirp from the keypad? Even when the system is set to disarmed, any alarm will trigger they keypad chirp. I would like to play chirps from the keypad in home/away mode, but at this point I have to disable the feature entirely since it will chirp in disarmed mode.