The video assistant referee does not re-referee the whole match. Under the Laws of the Game, it can only intervene on four kinds of decisions: goals, penalties, direct red cards and cases of mistaken identity.
Even then, the on-field referee takes the final decision, often after watching the replay at the pitchside monitor.