Judges

The limits of a person

A judge cannot give you a repeatable score, a measurement or an objective ranking against a population; asking for those is asking the wrong instrument.

By Updated 3 min readJudges

Guides on Judges: Boundaries belong to the judge, The case against the price list, What the skill in judging actually is

A human judge cannot give you a repeatable benchmark score, your actual size, or a rank against everyone who has ever sent a photo, and a professional one will reframe or decline all three. That is no knock on the judge: these are simply not products a person is set up to deliver.

A repeatable number

A score from a person is not reproducible in the way a benchmark needs to be. Ask the same judge the same day, in a different mood, after a different previous request, and the number moves - not because the judge is careless, but because a person's read is contextual by nature, and that is the whole point of hiring one. A tool built to hold still is the one built for that job. Penisrater exists specifically to produce a number that means the same thing on Tuesday as it did on Monday, and that consistency is engineering, not personality. A human judge trades that consistency away deliberately, for responsiveness to you, and you cannot buy both from the same instrument.

A measurement

A judge looking at a photograph is estimating from an image, and an estimate from an image is a guess with confidence attached, not data. Lighting, angle and camera distance all move the apparent number more than the thing itself does, and a judge who has done this for a while knows it and will tell you so rather than pretend otherwise. If a figure is actually what you are after, a proper measurement done with a ruler and a stated method removes the guessing entirely, and it is a five-minute task that no amount of judge experience substitutes for. Asking a person to eyeball a number and then treating that number as a fact is the single most common way a human review disappoints someone, and it is avoidable before you ever send the first message.

A ranking against everyone else

Where do I sit compared to everyone this judge has ever seen is a natural question and an unanswerable one from a person. A judge's frame of reference is whatever material has actually crossed their desk, which is a small, self-selected, unrepresentative sample, not a population. Self-selection skews even formal research: King's 2021 review in the Journal of Sex & Marital Therapy found often-cited self-report studies gave means of about 15.75 cm for heterosexual men, while 10 studies in which researchers took the measurements combined to 13.61 cm, and attributes the gap partly to volunteer and social desirability bias. Giving you a rank against that sample would be giving you a number built from bias with a decimal point attached to make it look precise. A model trained across a genuinely large dataset is a different kind of instrument entirely, built to place one input against many, and that population-level comparison is what an AI system is actually doing under the hood when it returns a percentile. A person cannot do that job at any price, because doing it requires having actually seen the population, and no judge has.

What a judge can actually promise

None of this is the judge falling short. It is three different instruments answering three different questions, and a person answers only one of them well: what does a specific human, responding to what you specifically asked, actually think and say. Presence, not measurement, is the thing being purchased, and once that is clear the other two requests stop making sense to bring to a judge at all. A good judge will say as much if you ask for a number as data - not to be difficult, but because a number inside a human review is a rhetorical move within a register, not a finding, and treating it as one misreads what arrived.

If what you actually want is one of the other two things, the honest move is to go get it from the instrument built for it and bring the result back if you want a person to respond to it - a stated figure in a brief is easier for a judge to work with than an unstated one they would otherwise have to guess at. If what you want is a specific person's specific reaction, you are already in the right place, and the rest of this site is about getting a good one. Rate Cock's own comparison of the two approaches is worth reading before you commission anything, since it lays out plainly which questions each side answers and which it does not.

Read next

Full archive