It's natural for testosterone to fluctuate, but sleep, diet and other factors can affect a man's levels on a daily basis.