Here’s one more way of looking at it. Literally.
This is Bobby Jones’s swing, with a tracer on the clubhead. The points of the swing rhythm are marked.
1 is the instant of takeaway. 2, 3, and 4 are the backswing, 4 being the end of it. 5 is impact.
Again, it looks like you would have to rush to get back to the ball in one count over the same distance it took you three counts in the backswing.
But you don’t.
Try it.