usually music doesnt catches you when it's flat. it can have lots of details but be flat. it means most of the time that it doesnt have or lacks dynamics, and combined with other audio factors, it would end up lacking musicality, which is the emotion provider!!
very difficult to investigate your problem from a distance, but my best guess would be either with tuning your tonearm/cartridge, or if you know it is well done, i would then look straight into the amp. i would say that one is not fit. lacks quality and power for your inefficient speakers. you could decide to change to higher dB speakers, but really good and high dB speakers at reasonable prices are difficult to find and often have a strong character of their own which you may not find suitable.