Should I move because I'm the one who wants the divorce?

It's not fair if you move. You're doing everything for it and paying all the bills. I'd say toss his stuff on the lawn and change the locks next time he's out. And if you file for divorce, explain to the kids it's him not you or just don't let the blame get pinned on you.