The teams fought out a hot-tempered 1-1 draw befitting of the build-up surrounding Mourinho's first match against former protege Andre Villas-Boas.
Gylfi Sigurdsson gave Spurs a deserved lead in an opening 45 minutes they dominated, only for John Terry to head home a leveller before Torres was sent off for a second bookable offence.
Having escaped a straight red for scratching Vertonghen's face earlier in the game, referee Mike Dean gave the Spaniard a second yellow card for an elbow on the defender towards the end of the match.
Replays, though, showed there was no contact and Mourinho believes Torres' sending off robbed Chelsea of victory in north London.
Furthermore, he was adamant that Vertonghen should not have been playing anyway after a foul on Aston Villa's Nicklas Helenius in the Capital One Cup.
"Yes, [we would have won with 11 men], but football is football," Mourinho said.
"Sometimes things happen and you don't know why, but I think the way it was going not one person thought we were not at that time much, much better and much, much stronger. They were in trouble.
"I don't think the referee is guilty. He made the wrong decision, but the referee trusted the player.
"When you see a player with hands in his face and pretending that it was a violent action, I think the referee's normal tendency is to follow and make the decision.
Source: PA
Source: PA