Free tool · PDF

PILOT Framework Review Canvas. Five questions before you change the training.

A one-page structured review for aviation training organisations, taking a recurring performance or training problem from observation to a targeted, verifiable action.

2 pages A4 · Free · No sign-up

Page one of the PILOT Framework Review Canvas: the problem to solve, then one box each for Performance, Interpretation, Learning, Operational Transfer and Traceability, and the next action.

PILOT Framework Review Canvas

Print it, take it to your next training review, and work through one problem.

Get the PDF
PDF · Free · 2 pages
Diagnose

Separate what you observe from what you assume, before anyone proposes more training.

Decide

Agree one targeted intervention that addresses the likely cause, not the most visible symptom.

Verify

Define in advance how improvement will be tested in realistic conditions and reviewed.

What’s inside

Five questions, specific action.

Each letter of PILOT is one question. The canvas ends with an agreed action, an owner and a review date.

P

Performance

What exactly are we observing?

I

Interpretation

What could explain it, and what evidence is missing?

L

Learning

Are we developing the right capability, in the right way?

O

Operational Transfer

Will improvement hold beyond the training scenario?

T

Traceability

How will we know what worked, and when will we review it?

→

Our next action

What, who, and by when.

Who it’s for

From individual pilots to whole organisations.

Use it in a one-to-one development discussion, an instructor meeting or an organisation-wide training review. The questions stay the same; only the evidence changes.

Training leadership

Patterns across a cohort or fleet

For Heads of Training, training managers and CBTA/EBT leads reviewing problems that keep coming back.

Instructors, safety and HF teams

A shared structure for the discussion

For instructor meetings, performance development discussions and Human Factors reviews.

Worked example

Inconsistent instructor grading.

Instructors assign different grades when assessing similar performance against the same competency.

PPerformance
Instructors assign inconsistent grades despite using the same competency framework.
IInterpretation
They may differ in how they interpret behaviours, weigh evidence or apply performance thresholds. Review assessment records and discuss the reasoning behind grades.
LLearning
Introduce evidence-based calibration using common scenarios, structured debriefs and discussion of the reasoning behind assessments.
OOperational Transfer
Check whether improved agreement carries over from calibration exercises into real training and assessment sessions.
TTraceability
Compare grading patterns, supporting evidence and assessment rationales before and after the intervention. Review remaining discrepancies.
Next action

A structured instructor calibration session using three common scenarios.

Owner

Head of Training / Instructor Development Lead

Review

After the next agreed assessment cycle

The aim is not that instructors give identical grades. It is that their grades rest on a shared interpretation of the evidence and a common understanding of the standard.

How to use it

A 15–30 minute structured discussion.

  1. 1Choose one problem
  2. 2Work through the five questions
  3. 3Agree one targeted action
  4. 4Define how success will be checked
  5. 5Review and adjust
Aleksandra Kapela presenting on the main stage at the European Aviation Training Summit 2025
Who wrote it

Aleksandra Kapela

An EAAP-accredited aviation psychologist and author of Human Factors for Pilots and Aviation Specialists (CRC Press). She advises airlines and training organisations on human performance, instructor assessment and CBTA, and speaks on these topics at EATS, APATS, ATAC Canada, WATS and FSANA.

The canvas is the structure she uses when an organisation asks why a training problem keeps coming back.

EAAP accredited Human Factors, CRC Press KSA100 & CBTA

European Aviation Training Summit 2025, main stage.

Optional

Want the next worked examples?

Leave your email and we will send further PILOT examples from training reviews and instructor calibration.

Want to use PILOT with your instructor team?

Calibration workshops and training reviews, facilitated by an aviation psychologist.

Contact us

PILOT is a structured reflection and review framework. It is not a validated psychological assessment instrument. Developed by Aleksandra Kapela | MyWingman.