Each time a gas molecule is hits the balloon envelope it transfers some momentum.

I see! Thank you very much!

If we assume the balloon model and the sides expand then each collision of a molecule inside the balloon with the outer wall will leave it with less speed and therefore lower energy and therefore a lower temperature.

As a consequence, gas expanding in a vacuum does not cool off, because it has nothing to transfer the energy to!