For classical, I'd go for Quad electrostatics. All day, every day, no problem. You can buy ESL 57's or 63's for about £500.
For Jazz I'd go for horns or horn hybrids from Klipsch, JBL, Altec, EV, Urei, Vitavox. I'd expect to pay from £500 upwards - depending on model and cosmetic condition - for a pair of classic speakers from these manufacturers.
You can buy quite decent 2nd hand amps for under £100. Best new amp for classical for £350 might be one of those Chinese valve amps - especially if mated with valve friendly speakers.
For CD playing on a budget, I'd simply hook my PC / laptop / Mac up to a DAC or audio interface.