Good read: why comparing specifications is pointless

@westcoastaudiophile 

"Every Denon and Marantz review is done with prior consultation with the company"

LOL! -what is your price tag for “agreed" review? 

Well, you tell me.  Here is the conclusion of the Denon AVR-X3800H Review:

Conclusions
I had high hopes going into this review thinking the company had seen the advantage its superior objective measurements in the past and would try to capitalize on them. Sadly, the reverse seems to be true with the DAC section taking a large step backward. Considering that the 3800 costs $500 more than 3700H, this is very surprising to me. Yes, inflation has a lot to do with that but surely the eye needed to be focused on making sure they at least met the same level of performance as last generation.

The good news is that the amplifier seems to be same design as last generation and has only taken a small hit.

Denon had been my "goto" recommendation for AVRs and even AVPs. When anyone asked me about either, I would just say "get a Denon AVR." While subjectively the performance of this new generation may be similar, I can't accept the regression in objective measured performance.

It is with much sadness that I cannot recommend the Denon AVR-X3800H.

You think this is something they would pay for?  I would think not.

I have an informal agreement with D&M to run my measurements by them in advance of a review.  It is an exception to the rule of testing membership products.  I am not sure of their reaction to the latest review so maybe they break the relationship for the future, I don't know.  What I do know is that the few of you keep shooting from the hip trying to sow discord.  :(

@kota1 

I am not being critical of your ability to use a laptop and a mic. The fact that Denon’s own measurements matches yours is good The issue I am bringing to your attention is obvious, you have to review it under the conditions it is designed to be used. You can’t do that with just 2 speakers, OK?

No, it is not "OK."  I just got done explaining all of this to you. Go watch that video.  If you don't understand it, ask questions.  If you understand it but disagree, come back with comprehensive research that I showed there why you don't want to test multichannel EQ systems in multi-channel.

But maybe you think I should do what other "reviewers" do.  Play some movies through the AVR and write fiction about how said movie soundtrack sounded.  I don't do stuf like that.  Go and seek our those sources.

Finally, I have a separeate dedicated theater.  If there ever was a need, I can test in there but there never has been.  No company has asked for that either and that list includes some of the highest-end AV companies such as Trinnov, Storm, etc.

So don't keep bringing up these lay arguments.  Go and fix the sound of your system.  Measure what it is producing now and post that.  You are the best example of how science and engineering can help  you.  You screwed up following online stuff you heard.  Now is your chance to improve your system sound and instead are wasting time with all these complaining....

@amir_asr

How did the Denon "perform" when you set it up in your home theater as it was designed to be used? Good luck with that, this is why you keep getting comments about not listening to gear.

You said:

Go and fix the sound of your system.

I started a new thread here on setting up an Atmos system, you would like it, lots of technical detail, feel free to check it out and fix the sound of your system..

 Again you just validated what many here have been saying. You should not even be considered in the realm of professional reviewer's. 

You keep stepping in your own poop. 

@amir_asr ,

I perform 2-channel testing because a) a lot of people want to use their AV products for music also and b) I use 2-channel systems as the standard that the AV industry needs to strive to match.

I know they are better equipped in both staff and technology, and they are dedicated to one mission or job, Reviews. 

Quality not quantity. You just validated what many are saying here. 

Seeing how I review nearly 300 audio devices a year, that is a hell of a lot of listening tests!

@juanmanuelfangioii 

@amir_asr So how do the folks at other review based organizations do it? Sterophile, PTA, M&S, PF, ... I know they are better equipped in both staff and technology, and they are dedicated to one mission or job, Reviews. 

Quality not quantity. You just validated what many are saying here. 

You have this backward.  I bring the quality.  They bring fiction.  Anyone can write a word salad about how something "sounds."  You have no way of verifying anything they have said.  Their reviews are also universally positive.  Here are my stats from the ASR Review Index:

Total Devices Tested by Amir 1,177

Total Devices Recommended by Amir 495

Recommended Devices By Amir % 36%

As you see, I find issues with 2/3 of the products I test.  I have the freedom to say so because I either buy the product myself or a membrer sends it.  I am not beholding to a manufacture who sends me gear to give a positive review.

But let's say their motives are pure.  Their listening tests are not worth bits that are used to store them online.  Here is how they did when testing speakers -- something that should be easy for them -- in formal double blind study: 

http://seanolive.blogspot.com/2010/12/how-to-listen-course-on-how-to.html

You see how poorly the audio reviewers did?  They could not remotely provide consistent results of listening to the same set of speakers.  You would want to put your trust in that???

When I perform listening tests, it is not for writing novels.  It is to focus and quantify keep weaknesses in products.  And to see if measurements are correctly predicting performance.

What is great here is that audiophiles are appreciating the value of proper audio reviews as opposed to fiction.  Here is our traffic compared to stereophile.com for example:

We have 3X the reach despite being much younger site.  You want to continue to live in the past, you can.  But please don't ask me to feed you nonsense in my reviews.