Both long term listening and A/B comparisons are an attempt to decide if there is a difference and if that change is worth implementing on a permanent basis. For those who don't trust themselves or NEED A/B testing (for whatever reason), I say go for it.
I always know what is being changed because I do my own testing, usually with a group of friends who vote on the results.
Many times the outcome is not what any of us expected, so the learning process remains intact and we all evolve our systems based on priority and what we can afford.
The topic of A/B is banned at Audio Asylum and I understand why. These discussions (particularly blind A/B discussions), typically follow the same evolution as this thread. Pointless arguments that do nothing to improve our systems.
I always know what is being changed because I do my own testing, usually with a group of friends who vote on the results.
Many times the outcome is not what any of us expected, so the learning process remains intact and we all evolve our systems based on priority and what we can afford.
The topic of A/B is banned at Audio Asylum and I understand why. These discussions (particularly blind A/B discussions), typically follow the same evolution as this thread. Pointless arguments that do nothing to improve our systems.