I also used to think deviating from your outline would mean more time wasted or at least taking the longer route to finishing your novel. But again I know better now. Admittedly, I sometimes find myself stubbornly rewriting a scene several times just because I want to follow my outline, but then I realize in hindsight that's how I end up wasting precious time in the first place.
IF it doesn't work, it doesn't work, and as with any relationship that doesn't work out, you just have to make a quick, clean break and move on.