I have heard the same thing, but never experienced it to be true.
The babies that got put in the cooler in the fall to hair up did not lose their hair any earlier the next spring than the calves that were not put in the cooler.
Maybe it is a regional thing, or depends on the year or just the calf. I don't know.