Looking for new places to buy vinyl

Dusty Groove America (Google it). Their VG-rated LPs have been VERY GOOD, despite what you usually see with this rating. Get on their list and receive weekly notice of their offerings, which include detailed descriptions of the music. No good for classical, but terrific for jazz.

Also look at

AudiophileUsa

RecordsByMail

This website has been a good source of local record fairs for me:

http://www.vinyltimes.com/record-shows.htm

Best of luck, the joy of browsing through the stacks awaits! I must say, I too have purchase online due to convenience, but the sheer joy of the find in a store is worth the trips to your local vinyl haunts.

amazon, elusive disk, ebay, occational brick and morter and thift store or garage sale.

This is more about which labels to buy rather than where to buy. Plenty of good places have already been suggested.
I've found that new re-releases by Speakers Corner Records to be superb. They use pure analogue processing and the result can be very rewarding.
Stay away from Friday Music releases because the sound has been fiddled with and sonics removed. I've compared the same album by Speakers Corner and Friday Music and Speakers corner is far better.