do you ever take 3 days off from the gym grind?

I was talking to a friend of mine who is a big-time athlete and he said to never take more than two days off from the gym because if you do you will rapidly lose your conditioning and could lose a lot of strength in a short amount of time
do you agree with this and do you usually take three days off from the gym or do you like to go at most 2 days off