Totals are pace × efficiency
A game's expected score is roughly the number of expected possessions or drives multiplied by expected scoring efficiency per opportunity. Most public bettors fixate on efficiency and ignore pace.
Weather, injuries, and motivation
Wind in NFL/MLB, late scratches in NBA, and motivation in late-season CFB are the contextual variables most likely to drift totals significantly from baseline.