Experiment Card
A test and its pass mark
- PhaseTest
- Group1 to 8 people
- Time25 minutes
- SettingRoom or remote
- ExecutivesYes
What it is
An experiment card states the assumption being tested, the test (who, what, how long), what will be measured, the pass mark, what the team will do if it passes or fails, and who decides and by when. It is filled in before the test, so the result cannot be bent afterwards.
When to use it
Before any test, to agree what you are testing, how, and what result would change your mind.
When to skip it
When you only want general reactions. Use the Feedback Grid.
How to run it
- 5 minState the assumption to test, from the Assumption Map.
- 10 minDesign the smallest test that could prove it wrong: who, what, how long.
- 10 minSet the pass mark and say what you will do if it passes and if it fails.
About 25 minutes of method time. Add ten to fifteen minutes to open and close the session.
What to watch for
Setting the pass mark after seeing the results. A test that cannot fail. A test too big to run quickly.
The AI lens
Include an error rate and a trust measure in the pass mark, such as whether people checked the output. Usage alone is not enough.
What you leave with
A test with a pass mark and a decision rule, agreed before it starts.
An example
Assumption: agents will use the suggested reply at least half the time. Test: ten agents, one week. Pass mark: five out of ten. If it fails, the team changes the suggestion format and tests again.
How it compares
An Experiment Card plans one test. A Learning Log records what happened afterwards.
Related methods
Questions
What is Experiment Card?
An experiment card states the assumption being tested, the test (who, what, how long), what will be measured, the pass mark, what the team will do if it passes or fails, and who decides and by when. It is filled in before the test, so the result cannot be bent afterwards.
When should I use Experiment Card?
Before any test, to agree what you are testing, how, and what result would change your mind.
How long does Experiment Card take and how many people do I need?
Experiment Card takes about 25 minutes and suits 1 to 8 people, plus a facilitator. Add ten to fifteen minutes to open and close the session.
How is Experiment Card different from other methods?
An Experiment Card plans one test. A Learning Log records what happened afterwards.
Can I run Experiment Card remotely or with executives?
Yes. Experiment Card works in the room or remotely. Remotely, put the canvas on a shared board in advance and write silently in the board, not in chat. Executives: Yes, works with executives present.