SKILL HARNESS /// FIELD MANUAL   REV 2.6
[ SPECIMEN INDEX ]UNIT / D-01 COLLECTION 04PRODUCTION KEEP 00

Does this skill help?

>>> METHOD

It runs a task twice. Once with the skill, once without it. Then it compares the two runs.

>>> WHAT IT REFUSES

When the difference is too small to call, or the sample too thin, it says so. It does not fill the gap with a number.

One skill, measured

Each run of the task is one try. The same task runs eight times with the skill and eight times without, and the two sets are compared. The task hides a false fact on purpose, so a try either catches it or misses it.

SPECIMEN 02  ///  SQLITE-EXPERT
TASK / SPOT THE FALSE FACT
TRIES EACH WAY / 08
[ SET A ] WITH THE SKILL+
try 1 caught ittry 2 caught it try 3 caught ittry 4 caught it try 5 missed ittry 6 caught it try 7 missed ittry 8 caught it
6/8tries caught the false fact
[ SET B ] WITHOUT IT+
try 1 caught ittry 2 missed it try 3 caught ittry 4 missed it try 5 caught ittry 6 missed it try 7 caught ittry 8 missed it
4/8tries caught the false fact
CANT_TELL_YET
[ DETERMINATION ]

Two tries apart out of eight. That is not enough to tell the two sets apart, so no verdict is recorded. This is a result, not a failure. Widen the sample and the instrument will call it.

Where to go next

01 ///

Published determinations

Every skill measured so far, and the ones still waiting on evidence.

02 ///

What the instrument found

All results to date, including the runs that came back undetermined.

03 ///

Run it on your own skill

Install the package and audit a skill file on your own machine.

Pull your own proof >>>
$ pip install skill-harness   ///   MIT    REV 2.6    ®