Looking for new places to buy vinyl

amazon, elusive disk, ebay, occational brick and morter and thift store or garage sale.

This is more about which labels to buy rather than where to buy. Plenty of good places have already been suggested.
I've found that new re-releases by Speakers Corner Records to be superb. They use pure analogue processing and the result can be very rewarding.
Stay away from Friday Music releases because the sound has been fiddled with and sonics removed. I've compared the same album by Speakers Corner and Friday Music and Speakers corner is far better.

Rockpig...while I agree with you that the Speakers Corner LPs are excellent, so are most of the Friday Music re-issues. I have 60-70 reissues from Friday Music and for the most part, find them to be very good.

Has anyone had experience purchasing from oldies.com?

I just got a newspaper type catalog from them and they have lots of vinyl to choose from. I'm tempted to try one of their vinyl grab bags.

Mofimadness... I had purchased many Friday Music LPs and also thought they were very good. However, I was able to do a direct comparison of Doobie Brothers "The Captain and Me" on Friday Music LP, Speakers Corner LP and Mofi SACD.
The Friday Music version sounds dead when compared to the Speakers Corner. The Mofi SACD rated better than the Friday Music LP but the overall winner is Speakers Corner.
The difference is huge and I just felt so robbed with the Friday Music version.