I'm not sure exactly when the time starts, I started it when both players teleport as it says in the rules.