I spent the last 35 or so years listening to SS only and last year I ended up in the same place you are now. I looked at a bunch of "starter" tube integrateds, probably same stuff you came across too: Cary (used), Quicksilver, Rogue, Raven, Decware, Jolida/Black Ice. Primaluna, Line Magnetic, etc. Also got curious about Belles Aria and Croft Phono Integrated along the way. Ended up with a used Conrad-Johnson CAV45. No pre- or phono, so not good for your situation.
I am responding to your question about whether it's worth it. In general, I feel more engaged in the music. Hard to put a finger on with my 50+ year-old ears, but undeniable. Could also just be that it's interestingly different from my previous SS amp (Classe, which I also really liked). Anyway, I'm really glad I took the leap to try tubes and didn't go to my grave wondering about it. I concluded I would be happy with tubes or SS, but that right now I prefer the tubes.
I also think it's worth mentioning some non-musical factors that influenced me: tubes are a fun, interactive niche in the world of 2 channel audio (itself a niche at this point); CJ is a local business for me (ease of service in a hobby where this is inevitable); the gold faceplate reminds me of my childhood wandering around Myer-Emco in awe; and the CAV-45 itself has a very minimalist design, which is my style. A bit of a digression, but one or more of these factors could tip the scales for you if you feel comfortable giving weight to psychoacoustics.