I ran a desktop mini amp with a Tripath TA2024 chip (10W) through my 91db speakers (Closer Acoustics OGY). Yeah it works just fine. No complaints. I only upgraded to a typical 40W class A/B amp for more power.
One thing I would be concerned about is the noise floor of some of these cheaper class D amps. The Tripath amp is very mediocre by all standards and the noise floor is noticeable when you put your ear against the driver. I experience the same thing with my class A/B amp. It's hardly a bother.
If the Topping PA5 measures well then by all means get it. The convenience of having a book-sized amp which runs cool is a huge plus.