The least expensive and biggest benefit in comfiguring a system is an open mind. Remain flexible. It costs nothing. A closed mind can be ridiculously expensive.
From a value oriented perspective, isolation comes to mind. Some fancy wood footers (blocks of Mahogany, Teak, Zebra, etc) were supplied me by another member and WOW you couldn't help but notice the changes to the sound. Each type had a different effect upon the sound, and they can be had for next to nothing. Probably right near where you live.
Getting them in the right place is also a bit of a thing, for me. ONce done the significance of the improvement far overshadows much anything else I've done.
Sometimes an additional item needs be used with the blocks too... like compliant iso materials, stick 'em or post it pads, vibra pods, felt, or even silicone. Usually not though.
Other minorly expensive iso materials can prove vastly important to improving sonics. All sorts. I've used some iso materials from Herbiies Audio Labs with fine success. Tube rings, iso cups w/ebony balls. I've even used particle board and MDF as platforms. Sandwhiched setups which have the makeshift platform in between two different isolating devices with the component atop the upper iso pucks, pods, footers, etc.
High temp silicone O rings can be used in two's or three's as tube dampers.
Drain stoppers. Cutting boards, and Ceramic tiles. Anything is of probable use... if it ain't moving.
I've found sources and pre's more prone to this former construct than amps.
Getting pc's up off the floor is good. Supporting them by tying them off to the rack to relieve the strain is worth the doing.
Past that I'd say passive line conditioning. hearing less of what you aren't hearing now is pretty substantial, and you will welcome it with open arms... or ears. Adding dedicated ckts can be of great help... sometimes.
Room acoustics is now my focus... and as I've found with so many other approaches to accessories, I'd bet this is where I or anyone should start. Not end.
Everything makes a diff. Things you might not think may help, may not. then again, they may.
Keeping an open mind is really the ticket.
You truly short change yourself and your system if peripherals are not addressed. Great components really do improve with supportive accessories.