electromagnetism - Temperature and resistance?

Why does resistivity increase with temperature?

The explanations I have heard so far are that increasing temperature increases vibrations in the lattice structure resulting in the number of collisions increasing.

But the vibrations from thermal energy are random, so around half of the vibrations would result in the atoms moving out of the electrons way and half would result in atoms moving into the way of the electrons.

And since half of the vibrations result in increasing the drift speed and half reduce it, shouldn't the average drift speed remain the same?