My experience has been the opposite, but the answer to your question is no. My Soundlab speakers are very in-efficient, but are the best sounding speakers I have owned.
The key is the right, properly matched, amp and speaker combo!
No way to say one speaker will sound better then another based on efficiency only.