There is really no point in worrying about the quality of the Yamaha. See here for a test of the earlier AS700, identical but for the lack of digital inputs: http://www.avhub.com.au/product-reviews/hi-fi/yamaha-a-s700-integrated-amplifier-review-and-test-pag...
The results are seriously better than for many audiophile amplifiers costing perhaps ten times more. Its only limitation is the power output at around 2x100 watt rms. If you are using inefficient speakers in a larger room you may want more power. If not, you will be perfectly fine. Since the digital output of the Chromecast Audio has been shown to be bitperfect, there is no issue there either. I have not found any test yet of the Yamaha's internal DAC, but I would not expect anything other than excellent results.
So the only way in which you may be able to improve the sound of your system, is by getting really good modern speakers like the Harbeth M30.1. The rest of your system would be an excellent match even for such expensive speakers. But speaker choice does depend on personal preference, room size and music selection.
The results are seriously better than for many audiophile amplifiers costing perhaps ten times more. Its only limitation is the power output at around 2x100 watt rms. If you are using inefficient speakers in a larger room you may want more power. If not, you will be perfectly fine. Since the digital output of the Chromecast Audio has been shown to be bitperfect, there is no issue there either. I have not found any test yet of the Yamaha's internal DAC, but I would not expect anything other than excellent results.
So the only way in which you may be able to improve the sound of your system, is by getting really good modern speakers like the Harbeth M30.1. The rest of your system would be an excellent match even for such expensive speakers. But speaker choice does depend on personal preference, room size and music selection.