There is a saying in football that you should never go back, does that apply to Doctor Who as well?

I have a bad habit when I dip in and out of Doctor Who, I often watch part one of two parters and miss the second part...