If you have the option to pay off your loan sooner, should you?

[nicksavings]

A lot of people say that paying off your car loan too soon can end up hurting your credit but if you have the money to pay it all off, why wouldn't you just go for it so you don't have the debt hanging over your head? I don't own a car, I lease, so I am not sure how this works.