How to use Swatch
Use Swatch when you want to understand a model through direct experience.
Select an experiment
Select the behavior that you want to examine. Read the purpose and observation guide before you start.
Keep the inputs equal
Give each model the same prompt, instructions, and files. Record all changes that you must make.
Save the raw output
Save the complete output in a new run folder. Do not correct the output or replace an old run.
Write observations
Write notes while the work is fresh. Record strengths, errors, assumptions, surprises, and patterns.
Compare runs
Compare runs that use the same experiment and inputs. Show the work before you add your conclusions.
Swatch