What decibel level do you listen at?

You should the type and class of meter you're using as well as specifically how you're using your SPL meter. There are multiple types of SPL meters as well as classes which offer different information and use different ways to measure which are weighted differently. Both the audio material you're attempting to measure and the method of measurement will play heavy roles in the result. Additionally, if you're using music to measure your SPL, this will return different values based on whether you're measuring based on peaks or averages. Peak SPL will typically have a 6dB crest above the average where your transient peaks are in music (kick drum/crash cymbal/etc.) as they demand more power/SPL to be heard as a percussive sound over the average level. Conversational speech has average levels at roughly 60dB SPL, so background music would be considered around this level on average, placing peaks at about 65dB. It seems you were likely measuring an A-weighted average SPL of music, which will discriminate/ignore much of the low frequency, and return a slightly deflated average level as it's only measuring from about 500Hz to 10kHz. If you read 65dB, I would estimate you're actually hitting somewhere in the low to mid 70's for peak SPL, and an average level in the upper 60's. If you want to get an accurate reading of what SPL is in terms of "loudness", I would recommend using audio material with no transients and no bandwidth discrimination as well as a weighted meter which has no bandwidth discrimination and can implement peak monitoring. The best way to do this is use pink noise (equal energy per octave), and an RTA meter with either C or Z weighting. White noise is also usable (equal energy per frequency), but you'd need to find an FFT-based meter, which are difficult to find.
On a side note, phone microphones will rarely get an accurate reading because they are bandwidth-limited and don't have smooth transfer functions for accurate readings. 

For me, the relevant question is really peak spl at the listening position.  In my case, for a dedicated listening session on my main system, that would usually be 90-95 db, with average spl being lower.  That gets the blood pumping, but there's no issue of "too" loud.

OTOH, in my car, dynamic range is compressed and it feels really loud if peaks ever approach 90 db (courtesy of my iPhone spl app).  I agree with those who've noted system dependency.

Resurrecting this old post, just upgraded speakers and since I have a tendency to crank up the volume I wanted to make sure that I don't damage my hearing.

I downloaded the NIOHS Sound Level Meter app and monitor the LAeq. I was surprised to find that the level I settled in at was about 78 dB. I am sure that I will hit moods where that elevates to 85 - 90 for short term. I would say 70 is about the bottom of where I would listen on that system, if it is just background music I will probably be elsewhere in the house listening on something else.

60-70 most of the time. Up to 80- 85 sometimes. 90 for short periods for certain moods and certain songs.

Never above that. Need to hold onto the hearing I have left.

It seems ironic and sad that someone who thinks of themselves as an audiophile would listen to music at levels proven to damage hearing. 

The last rock show I went to was 115. For two hours. I had ear plugs in. Actually sounds better.

60-80, but not above 80.