One more consideration. Do you live in an area where there is a lot of vinyl available? If you live in a large city, with plenty of record stores, you may be able to feed the vinyl habit easier and quite possibly cheaper. This will probably matter less if you are collecting primarily rock or pop, but jazz and more esoteric genres tend to be more prevalent in larger metro areas and/or more affluent areas, and those arty-hip ones.
To me part of the allure of LPs is hitting the record stores , preferably with a friend. At first I shopped thrift stores, but found them to be not worth my time and effort. ( I did hit one store at the right time once, and picked up some real gems,but only once).Of course there's always online purchases, but I personally find them a bit more risky, unless you purchase new. Even then one has to hope the delivery person doesn't leave them in in the sun if the weather is hot.