@chungjh In general, Verizon’s FIOS speeds, latency and packet loss are not affected by what your neighbors are doing on their internet unlike the network at Comcast.
But before you go crazy changing things, keep in mind the design of Ethernet and the internet is that it will tolerate a fair amount of packet loss with only a loss in speed. There’s a ton of error correction built in at the physical and logical layers of the internet protocols, and music, even lossless music, is not taxing your internet connection compared to say, Netflix or Amazon Prime streaming 4K video.