Better still listen with and without and decide what sounds best. In my system with a DCS player and non inverting amps 99% of CDs sound better inverted so I leave my CD player set that way. The vast majority of LPs however sound best non inverted but I always check and where needed can switch from the amp.
Tell tales for an inverted recording is often recessed bass and thin mid range and when you switch you can tell straight away which way is better. Many recordings however have a mix of polarities so there's no real difference. Net net try it both ways. You will find lots of discussion n this topic elsewhere on this site