I think what’s key here is that you used to be able to do this. I used to use Google assistant regularly and I feel like I’ve discovered dropped features through frustrated exchanges like this. It’s easy to miss that it specifically asked for time when you’re in autopilot mode and expecting that if there’s an error, it just misheard you