everyone would’ve struggled to survive because food would not be produced.

I think that the problem with this social structure is that they did not want anyone to move from the position that they held. The wealthy were being chosen to stay in their position because they were thought to be chosen by God and therefore were respected to stay in that position. Peasants were kept on land basically as slaves and were not given any opportunity to move up. Also, life expectancy was very low for these peasants as disease plagued them and famine was widely spread amongst them. Military authority and chivalry were used to keep people in their social status. Another problem with this is that the military and noble people were given  too much power which could’ve ultimately turned into a dictatorship or an uproar from the military to overthrow the nobles and take the power from them. At the same time, since peasants were the ones that worked the land, if they had come together to stop working for the higher-ups, everyone would’ve struggled to survive because food would not be produced.