Many thanks for the replies.
Yeah, I will stop using the "direct input" and try to enhance the sound with tone controls for a while. If still not satisfied, upgrading to a DAC with more punchy output could be a good idea. I can pick one with additional input for the TV set and use the rpac in...