In principle, 4 ohm speakers are more difficult to drive that 6 or 8 ohm speakers, but the sensitivity of a speaker also comes into play (the higher the sensitivity, the easier a speaker is to drive). Added to this, speakers rated at 6 or 8 ohms can, in reality, drop to 4 ohms or below, so the stated impedance of a speaker does not necessarily tell the whole story.
I had a similar problem when deciding whether to buy some Dali speakers for a 5.1 set up. The general advice is that you should be looking at receivers upward of £1000, with sufficient power and a decent heat-sink, if you want to drive 4 ohm speakers. You should also ensure the receiver is well ventilated to avoid problems from overheating. Beyond that, there's the potential problem with clipping when partnering lower-spec receivers with low impedance speakers
In short, partnering a low-to-mid budget receiver with 4 ohm speakers means potentially damaging either the receiver or speakers...
You don't state which receiver you own, but it's worth contacting the manufacturer to see what they say about this. If they say your receiver is OK to drive 4 ohm speakers and it has a lower impedance setting, then go with their advice.
I owm a Yamaha RX-V1065 receiver (a mid-range model) and I agonised over buying 4 ohm Dali speakers. I didn't in the end, because it didn't seem worth the risk, so I appreciate your dilemma!
I'm sure some other, more learned, forum member can advise you further on this, but hope that helps a little...