Have you checked the alignment of the cartridge?
Is the TT level (small boat level or spirit level required + surface that can be levelled).
Is the azimuth ok? (Small mirror needed.) If not, get unit replaced as this can't be adjusted.
Is it the Ortofon OM5E cart or the new Rega Carbon? (The Carbon has a conical stylus and is not upgradable whereas the OM has an elliptical stylus that - I think - can be upgraded with an OM10's stylus.
Did you set up the vettical tracking force yourself (balance the arm then 'dial in' the force) or was it pre-set? An inexpensive stylus balance like the
Ortofon balance will help you set this pretty accurrately.
Do you regularly brush the stylus? Is there a dusty 'blob' on it? (Take care and use a stylus brush brushing very gently from the rear of the cartridge towards you only without exerting any pressure on the cantilever. Make sure the arm is not clamped so it is free to move upwards.)