Judges

Why "I could do that" is usually wrong

Anyone can react to a photo; sustaining a register on brief for a paying stranger, repeatedly, without leaking contempt or discomfort, is the job.

By 2 min readJudges

Guides on Judges: Boundaries belong to the judge, The case against the price list, What the skill in judging actually is

Anyone can react to a photo, but not anyone can be a judge: the job is holding a chosen register, on brief, for one paying stranger after another, without boredom or discomfort leaking into the performance. The reaction takes seconds, and it is almost none of what a judge is paid for.

The part that is easy

Forming a reaction is fast and near-universal - it is what happens automatically when anyone looks at anything. This is why "I could do that" feels obviously true to a lot of people watching a review clip: the reaction part, in isolation, really is something almost anyone has.

The part that is not

The job is sustaining a specific register, on brief, for a paying stranger, on command, and doing it again an hour later for someone completely different. A friend giving an honest opinion once, informally, is drawing on the same instinct a judge uses - but they are not holding a chosen tone for two full minutes while responding to particular details a stranger asked them to address, and they are not doing it again immediately after for someone else with a different request and a different register entirely.

The hardest part is the thing that does not show up on camera: keeping contempt, boredom or discomfort from leaking into a performance the buyer is paying to receive warmly, or honestly, or however it was briefed - regardless of how the judge actually feels about the fortieth photo of the day. Occupational psychologists call displaying a feeling you do not have "surface acting", and a meta-analysis of 95 studies by Hülsheger and Schewe (2011) linked it substantially with impaired well-being, while "deep acting", genuinely working up the intended feeling, showed only weak links. Judging as skilled work covers this at length; the short version is that consistency under repetition is the craft, not the initial reaction, which anyone has for free.

Why this matters for buyers

Knowing the difference is useful before you assume a friend's opinion is a substitute for a commission, or that a judge's calm, in-register response means the work was easy for them. The skill someone brings to their tenth commission of the day is not the same skill as having an opinion about one photo, and conflating the two undersells what a professional read actually costs to produce.

An algorithm sidesteps this problem entirely by not having contempt, boredom or a fortieth photo of the day to manage in the first place - consistency is just what it does by default, which is a different kind of reliability from a person sustaining one on purpose, commission after commission. If a stable, repeatable number is genuinely what you are after, that is the tool built for it, and if what you actually want to know is a measurement, that has nothing to do with anyone's opinion, amateur or professional. Rate Cock vets judges partly on this basis - not whether they have an opinion, which everyone does, but whether they can hold a register reliably across real, paid, repeated work.

Read next

Full archive