More angles, better calls: how multiple clips and the appeal step cross-check the AI

A single clip is one view of a three-dimensional event, and that's the biggest source of error for any steward, human or AI. So two features exist mainly to check the system against itself: combining several camera angles, and an appeal step that argues against the penalty.

Every clip is read on its own first

When you attach more than one clip, each is analysed separately. Before it runs, you tell the system two things about each clip: the camera angle (cockpit, hood, chase, helicopter, TV broadcast and so on) and whose car it follows.

That matters because the same footage means different things from different views. A cockpit camera is good evidence for what that driver could see, and poor evidence for what a car beside or behind them did. A chase camera shows the car ahead well but hides what's alongside. The model is told to reason from the lens the clip was shot through, and to put anything that camera couldn't have seen into the "can't be determined" list instead of guessing.

It's also told not to speculate about what other cameras might have captured. Each clip is judged only on what it shows, which keeps the individual reports honest.

Then the clips are reconciled

Once every clip has its own fact report, a combining step merges them into one. It doesn't re-watch the videos. It works from the written reports, so it's purely a question of weighing evidence, with rules a good steward would recognise:

  • For spatial facts, such as overlap, who was alongside, and the braking point, the wider and more neutral angles win. A helicopter or broadcast view has the whole picture.
  • For what a driver could see, the on-board camera wins.
  • Gaps get filled. If one clip couldn't tell whether there was overlap and another clip shows it clearly, the combined report treats it as settled. If every clip is unsure, it stays unresolved.
  • A fact seen by only one clip isn't thrown out just because the others are silent.

Each section of the combined report ends with a line saying which clips support it, so you can see at a glance whether a key fact rests on three angles or one. That's a quick way to judge how much weight to give it.

This is why we keep telling people to upload every angle they have. More views directly shrink the depth and camera-angle problems we describe in can AI steward sim racing incidents?.

The appeal step argues the other side

Once a penalty has been recorded, an optional appeal step can be run. It's set up as the driver's advocate. It re-reads the same fact report and rule analysis the panel used and argues for the driver, with three possible outcomes:

  1. Overturn the decision because the evidence doesn't support it.
  2. Reduce the penalty when an overturn is too strong but the sanction looks heavy.
  3. Concede that the decision is right when the evidence is clear.

The third outcome is the important one. An advocate that always argues for the driver would be useless. Being able to say "this one stands" is what gives the other two weight, and when an appeal can't find a hole in a decision, that's a useful signal in itself.

It's strictly scoped to this one job. Free-text fields can contain anything, including attempts to redirect the model, so the step is built to refuse anything that isn't an appeal.

If you've read our post on running consistent decisions, this is the same principle applied to the AI: a decision is stronger once it has survived a serious challenge.

A human still makes the call

All of this produces better drafts, not final rulings. The report, the reasoning, the list of what's unresolved and the appeal argument are all there for a person to read. The steward watches the clip and records the decision. In a league, that recorded decision is what counts, and drivers can still protest it.

Practical tips

  • Label the camera and the driver for every clip. It changes how the footage is read.
  • Add a wide view when you can. One broadcast or helicopter angle improves spatial calls a lot.
  • Look at which clips support each point in the combined report before relying on it.
  • Run the appeal on penalties you're unsure about. If it concedes, you can be more comfortable. If it makes a strong case, take another look.

You can try Sim Racing Steward free and test it with a multi-angle incident.