Your confidence makes a prediction you can check

Confidence is useful when it has a meaning beyond feeling comfortable. If you repeatedly give answers with 80% confidence, the prediction is that about eight answers in every ten comparable attempts will be correct over time. Calibration describes how closely that prediction matches your results, a distinction explained by Lichtenstein, Fischhoff and Phillips in their 1982 chapter Calibration of probabilities: The state of the art to 1980. A wrong answer alone cannot settle the matter. Even a reasonable prediction allows for mistakes, so the pattern across attempts carries more information than the discomfort of one miss.

Accuracy and calibration tell you different things about your practice. You could answer relatively few questions correctly while recognising your uncertainty, or answer many correctly while expecting near perfection. Neither pattern tells you everything about your understanding. Keep the kind of question in view, because confidence about familiar vocabulary may have little connection with confidence about a diagram you have never seen.

Record the judgement before the explanation arrives

Once you have read an explanation, the answer can seem easier to anticipate than it was. Koriat and Bjork's 2005 paper Illusions of competence in monitoring one's knowledge during study examined a related problem with word pairs: learners judged their memory while information was visible that would be absent during testing. That supported a warning about judging knowledge with the answer in view, although their experiment was not a test of this app or of every confidence exercise.

Choose your confidence after considering your answer and before revealing feedback. You need an honest record of that moment. If you used a hint, keep that circumstance in mind when comparing attempts, because solving with a worked step available asks something different from solving unaided. Writing a brief reason, such as having checked the units, also gives a confident mistake something concrete to investigate later.

Read the chart as a pattern of decisions

The illustration below gives a fictional learner the same accuracy across groups rated at different confidence levels. Each group contains twenty hypothetical questions, with twelve correct answers giving 60% accuracy. At 40% confidence the learner is underrating those answers, while at 80% confidence they are overrating them. The middle group matches its prediction. These invented counts explain the chart, and they provide no benchmark for another person's learning.

Confidence and accuracy can disagree in either direction Schematic, not data. Confidence levels are forty, sixty and eighty per cent. Observed accuracy is sixty per cent at each level, representing twelve correct answers out of twenty hypothetical questions per group. The matching-confidence line has accuracy of forty, sixty and eighty per cent respectively. 40% 60% 80% 40% 60% 80% Accuracy: correct answers / questions Confidence before feedback Hypothetical accuracy Matching confidence and accuracy
Schematic, not data: each confidence group has twelve correct answers among twenty hypothetical questions, and the diagonal shows accuracy matching confidence.
The values in the schematic confidence chart are illustrative.
Stated confidenceHypothetical questionsCorrect answersObserved accuracyAccuracy matching confidence
40%20 questions12 answers60%40%
60%20 questions12 answers60%60%
80%20 questions12 answers60%80%

A small group can give a noisy picture, especially when questions repeat or share the same underlying rule. Watch for a tendency that survives further attempts before changing your whole approach. If the question types become harder, compare similar tasks where possible, because a change in the mix can shift accuracy without showing that your confidence habits have changed.

Give confident mistakes a specific follow-up

A confident mistake deserves attention because the answer felt settled enough to escape checking. Suppose you choose a conclusion from a reading passage and discover that it depended on a condition you skipped. Slowing down will help only if you give the pause a job: reread the condition, state what it permits and test whether your conclusion still follows. Merely spending longer looking at the same words leaves the missing step untouched.

After feedback, write the mistaken rule beside the corrected one in your own words. Then attempt another question that requires the distinction, preferably after a gap so the explanation is no longer sitting in immediate memory. A familiar wrong answer can feel persuasive again. If the same error recurs, examine whether you are overlooking evidence, applying a rule outside its scope or answering a slightly different question from the one asked.

Let repeated doubtful successes support more trust

Doubtful correct answers can suggest that your knowledge is stronger than your confidence allows. They can also include lucky guesses, which is why a streak needs examination. For a reasoning question, explain how the evidence supports your choice before checking the solution; for a factual question, try recalling the answer again later without the choices. Those checks give you something firmer than remembering that you received a tick.

If your reasoning continues to hold on fresh questions, try raising your confidence when the same evidence is available. You are learning to recognise a dependable approach. Keep uncertainty where you cannot justify the steps, since sounding decisive offers no help with a missing premise. In an exam, this habit can inform which answers deserve another look when time is limited.

A 90% range makes uncertainty visible

A single numerical guess gives no indication of how much doubt surrounds it. A 90% range asks you to choose lower and upper bounds that you believe contain the true value, with a long-run target of covering it on about nine out of ten comparable estimates. That does not promise nine successes in every batch of ten. The target describes repeated predictions, and chance can produce uneven short runs even when the judgements are reasonable.

For a simple exercise, estimate the mass of a closed parcel before weighing it. A hypothetical answer of 300 to 600 grams communicates something a guess of 450 grams leaves unstated: which other masses you still consider plausible. Decide what would make the parcel lighter or heavier, such as dense contents or bulky packaging, before choosing the bounds. Then record the measured mass alongside your estimate.

Soll and Klayman's 2004 paper Overconfidence in interval estimates found that people's stated ranges could be too narrow for the accuracy of their knowledge, with the pattern varying by how estimates were requested and by subject area. This finding supports examining range width, without supplying a universal widening rule. If your estimates keep missing above the upper bound, examine the assumption pulling them down; if misses occur on both sides, consider whether you have allowed enough uncertainty overall.

Making every range enormous would increase coverage while telling you very little. The useful challenge is to keep ranges informative while allowing the uncertainty you have, then narrow them as knowledge supports doing so. Practise with quantities you can check and record misses as carefully as hits. Leave unresolved estimates out of the coverage calculation until you can establish their answers.

Use the feedback to choose your next practice

Funga Wega's Insights screen compares confidence with results and checks whether your 90% estimation ranges contain the truth about nine times in ten. Use that feedback to choose an action. A cluster of confident reasoning errors suggests checking a recurring assumption, while repeated low-confidence successes invite a closer look at the evidence you already use reliably.

You can keep a paper version by recording your answer, confidence and result before adding a short note about the approach. Choose one recurring pattern to investigate during the next practice session, then look for it on a fresh question. Keep the note beside that question so you can check whether you remembered the step while working.

Frequently asked questions about confidence ratings

Should I lower my confidence whenever I make a mistake?

One mistake can occur even with well-calibrated confidence. Review the reason for the error and look for a recurring mismatch across comparable questions before making a broad change.

Does high confidence mean I understand the answer?

High confidence records your expectation of being correct. Test understanding by explaining the reasoning and applying it to a fresh example, since familiarity can produce confidence without supplying the missing steps.

Should my 90% ranges always be wider?

Widen ranges when repeated misses show insufficient coverage, while also examining whether your estimates lean consistently in one direction. Greater knowledge can support narrower ranges that still cover the truth often enough.

Sources