simengine Research
A library that simulates how a population responds, using LLM personas, and checks every result against simple baselines.
- Role
- Designed and directed (AI agent team)
- Period
- Oct 2026
- Team
- Solo, with coding agents
- Stack
- Python · scikit-learn · LLM APIs
- Impact
- Open source (AGPL-3.0)

What I did
I built simengine with an AI agent team: a library that simulates population responses (surveys, A/B tests, segments) with LLM personas. Its evidence pipeline compares results with simple baselines, audits them for leakage and memorisation, and can seal predictions before the real answer is revealed, so they cannot be adjusted afterwards.
Results
Its main finding is that pure persona panels rarely beat those simple baselines.


