If your unit is truly 'off' your situation would be normal, I think, IME anyway. But I've never used this unit.
If it does not totally shut off, but goes into a standby mode, I don't know, you'd think that is what a standby mode is for. Personally, unless it generates a lot of heat, I'd just leave it on.