It mattering or not is opinion, clearly. Those who make these decisions disagree, which is fact. Rankings have often been adjusted due to injured players and/or strength of schedule. How many undefeated teams have not finished #1 overall?
What team has ever been left out because of an injured player, especially when they were an unbeaten P5 conference champ?
tOSU wasn't when they had to use Cardale Jones who was 3rd string.
There were 3 unbeaten P5 champs. Were they supposed to have 3 teams ranked #1?
The committee changed the way things were done and ESPN started their "Alabama should be in over FSU because FSU's QB is injured" campaign before FSU's game was over.