That (darker) piece is the stylus guard, that swings down to protect the stylus.
It will come off together with the stylus housing.
I would lower that before pulling the stylus.
Before removing the original, buy a new stylus. It should include removal / refitting guide - so that you can be sure.