At 96.4 million, viewership on Sunday was down considerably from last year’s game, which was watched by about 101 million people.