Oh man. Sorry to break this to ya bud, but you do. I'm 44 and was gutted when I was measured for a medical last year and I'd gone from a lifelong 181.5cm to 180cm but it's apparently normal. Generally starts sometime in your late 30s I think. I'm told your pubes will go grey too, but this hasn't happened to me yet, thank fuck.