Moses’ punishment was that he would not enter the Land of Israel, but rather, he would die and be buried in the wilderness. According to the Sages, it is inconceivable that the entire generation that Moses led out of Egypt would not enter the land, and only the leader, Moses, would enter.

A parable, to what can this matter be compared? It can be compared to a shepherd who went out to herd the flocks of the king, and the flocks were taken. [After this incident,] the shepherd sought to enter the king’s palace. The king said to him: They will say that it was you who took the flocks. Here too, the Holy One, Blessed be He, said to Moses: Is it considered praiseworthy for you to take out 600,000 men fit for battle and bury them in the wilderness, and [then] take another generation into the land? Now they will say that those who died in the wilderness have no portion in the World to Come as part of their punishment. You will be buried alongside them, and will accompany them into the World to Come. (Tanĥuma, Hukat)