Truth is they haven't found a complete process from recording->duplication which doesn't distort the music to some degree. Choose the medium which has the compromises you're happiest to live with. At least with digital, the only unavoidable distortion occurs at the capturing-stage, and from that point on, the captured audio has the potential to be duplicated generation upon generation and distributed a billion times without any further corruption. Whereas with analogue, deterioration occurs in every step of the process and is absolutely unavoidable. For me, the compromises I'm happiest to live with are the digital ones. Almost universally, that means listening to CDs and recording digitally in my home studio. But other opinions are available.
An important footnote is that there is a lot of (modern) music out there which for the most part has never existed as an analogue sound to start with (obviously except vocals), having been created entirely 'in the box' using virtual sounds and effects found in Digital Audio Workstation apps like ProTools, Logic and Cubase. From a technical standpoint there is almost no benefit whatsoever to be gained from listening to such music on an LP, but of course that doesn't mean it will be less enjoyable if you do.