Why not? I wouldn't think twice. Certainly cheap and easy enough.
I can't quite make out the resistance value stamped in the metal, but you probably can.
A couple of new, enclosed types of identical (or very close) value might do the trick. Start with them set about halfway, before doing your fine speed setting adjustments.
I did see one user saying how replacement capacitors cured his problem. They're not too expensive either, so could be worthwhile replacing all the electrolytics while you're doing the pots - making sure the new ones are the same capacitance and same (or higher) voltage of course and fitted with correct polarity!
With a bit of luck your records will be playing at constant speeds soon.
P.S. I think ABBA were great (even if you're not Benny Andersson)