I change Victoria to Jubilee regularly. It's not a big problem.
There's a long walk, but there are certainly stations I avoid more.
London Bridge and Kings X, for starters.
My permutation at Green Park isn't that long. Alight from the last door of
car 1 to cross-passage with stairs to corridor passage direct to top of
lowest Jubilee line escalators.