I agree that flat wood would not be any better. But if you use (for say a 65" screen) either 4 standard 24x48x2 inch acoustic absorbation panels or similar size dispersion panels (like yours) just large enough to cover the opening of the "box" built around the TV, it should work. Weight shouldn't be much of an issue to overcome, as long as you can anchor the bracket to the studs. Some of those barn door hardware kits are designed to support actual full size doors. You could even put a motor on it and open/close it remotely. (lol)
A couple of examples of the barn door kits.... the second one with the accordian doors might be a better idea.