Away mode changes to Home mode automatically based on schedule

I have setup home mode at 11 PM everyday. Now if i go out in the evening, i set to Away manually and in case i come back in the midnight, Ring sets to Home mode at 11 per schedule but that should not happen. Shouldnt it stay Away because of higher security level i have set manually? It is so irritating and security issue in case i dont change the schedule everytime. Its like i have to anticipate i will be late and remove schedule for that one day. There must be better way. Any solition?