I remember either Google or Amazon explaining that the delay between the “hey” and the “ready” is the entire OS booting up. Like, there’s a separate super-low-power chip that will only respond to “hey” whilst in standby. When it detects the keyword, the rest of the device comes to life.
I’m not sure if they were telling the truth, but it’s plausible. The truth is always in the network payload.