Looking at your pic yes, remove them, it really isnt necessary, but if it makes you feel better it wont hurt, lower leaves on a plant like yours get wet and hit with nutes and can do that. It shows it is getting good light so remove them if you want. They arent going to recover.