That's two recruiting classes. Baylor may only have 60 kids on scholarship next year at most. Getting halfway decent kids to walk on to use as some sort of depth at a private school is a near impossibility due to the fact the kids have to pay their own way. When you've got that few quality kids, it's hard to get in good practices in the spring and fall camps for fear of getting them hurt.
Once the season starts, the other coaches are going to line up and pound you, knowing that you're going to fade in the second half. When your players get tired, they get hurt and the options get fewer. By mid-season the tank is empty, most of the team is worn out, especially in a league where teams run 100 plays a game, and the rest are beat up, riding the pine.
Baylor has a tough row to hoe for the next couple of years until they get their numbers back up.