Do speakers take time to warm up?

I have this issue as I change speakers from time to time which are next to each other. I am told that the crossovers lose their charge and depending on each size or type of crossover it can take a few hours minimum to get back to working normal. This is when you physically disconnect the speaker cable from the amp or speaker. Is ok if you just switch the amp off as the connection remains
I am having a purpose built super quality switch box made to get over this issue

Imo, the crossover charging idea is nonsense. They are not being charged when the system is OFF! It's more ridiculous thinking from people who fancy their ears more consistent than the electronics. Same with the foolishness of cables "settling ".

I always enjoy reading responses to a question like this; very humorous (and mostly b.s.).  Gosh, what about temperature, humidity, and altitude changes?

I use pink noise track (#15) on Stereophile Test CD when I turn on the stereo after it has been shutdown for sometime. I shutdown the system whenever I am traveling. I unplug everything even if my wife is at home.

So when I turn the system back on, I find running the pink noise track helps to bring the system back to normal. I run this track very loud at 12 or 1 o’ clock position. This has nothing to do with breaking-in of components, but rather forcing all of the components in the chain to come alive.

My main issue is I have tube preamp, DAC, and phone stage. So no matter how hard I try, I still need to wait until tubes warm up and settle down. But pink noise certainly help to get the rust out of speakers drivers if any quickly after not using for sometime. However, I don’t feel the need to do this everyday or every time I sit down for a listening session.
Hope this helps.

+1 @pwerahera I do the same thing. I have a 70 minute disc of pink noise at all frequencies that I let run for half an hour or so at high volume. Great for the entire system.