Both. I have, in the very beginning tried to minimize cost and maximize effort (gaining experience) and found I wasted more money by trying to save money… I would try going low cost and just ended up buying three intermediate components and the final one. I definitely never invest less than 2x or more on each upgraded component… I have learned that is a great way to be very disappointed.
However any purchase that was not hugely researched and considered in the context of my system has not been as effective either. So, you really need both to build better and better cost effective systems.
I suspect how much time you have / money you make strongly enters the picture here as well.