Yeah I think it does depend on the size of the effect. I think it pretty much all boils down to exactly that. So my point is that if the effect is small enough that you even feel the need to test it,... probably not worth wasting any more of your time on it.
Any work published in any scientific journal has to pass muster when it comes to statistical validity.
BUT
If home testing is fun & enjoyable, sure why not! : )
If I like the Puros, I’ll double-blind test it with my wife listening, since she is biased against me spending money and her hearing is not as rolled off as mine. If my tests support the product... it’s still anecdotal but I think you’re right it has less chance of being biased.