This reminds me of the story where a Houston airport kept getting complaints from airline passengers that it took too long for their luggage to arrive. So they moved baggage claim farther away. This made travelers walk farther to get to their bags, but have a shorter “wait” time. Complaints dropped to zero.
Optimize for perceived wait time, and throughput, not just latency.