L16 Prompt Drift Experiment — Live Colab (GPT-2)

Posted by Mysterious_Doubt_341@reddit | LocalLLaMA | View on Reddit | 0 comments

L16 Prompt Drift Experiment — Live Colab (GPT-2)

Just ran a Taguchi L16 screening on prompt levers using COVID vaccine myths.

**Finding**:

- `"I'm absolutely sure"` → **+0.47 drift** (p=0.002)

- `"preconceived"` (rare) → **+0.23 drift** (p=0.009)

- Truth = 1.0 in all 16 runs

**Live Colab (run it!)**:

https://colab.research.google.com/drive/1CPUu9LhE-fBAwrsSA2z53hufIDsf1ed_?usp=sharing

CSV + plots + ANOVA inside.

Next: LLaMA-3-8B

Thoughts?