So many variables to take into account before any change. For instance, How large is your room? How close do you sit to your speakers? Concerns of noise transmission to other living spaces? Type of music most often played? ETC.
Room and speakers and the interplay between the two are THE most important aspect in an audio system.
As has been mentioned, have you any acoustical treatments in your room?
Always a good place to start.