Yeah, the Alexa Routines language is lacking a lot of stuff that would make robust automation.
It's why I use SmartThings for the bulk of the logic handling, Alexa only does what I tell her with my voice.
I've had it now where when I come home after sunset, it will turn on the front porch light.