How to use Swatch

Use Swatch when you want to understand a model through direct experience.

Select an experiment

Select the behavior that you want to examine. Read the purpose and observation guide before you start.

Keep the inputs equal

Give each model the same prompt, instructions, and files. Record all changes that you must make.

Save the raw output

Save the complete output in a new run folder. Do not correct the output or replace an old run.

Write observations

Write notes while the work is fresh. Record strengths, errors, assumptions, surprises, and patterns.

Compare runs

Compare runs that use the same experiment and inputs. Show the work before you add your conclusions.