Why do people say that being a cavalry scout is miserable?

I had asked another question about cavalry scouts and somebody added that being one is miserable and hellish. Why would people say this?