Pouya Amiri
Hi there, welcome to my blog. I'm currently interested in mechanistic interpretability and alignment research. I run various ML experiments and record my findings here.
I'm also a Product Engineer at insightfactory.ai working across everything from infra to design, building a new platform for data analytics and AI.
I graduated from the University of Adelaide with a bachelor's in Computer Science (Advanced). During my studies I undertook research on the effectiveness of LLMs for ultrasound report generation. I also interned at the Australian Bureau of Statistics, Atlassian, and HENNGE (in Tokyo!).
I enjoy hiking. My favourite trail has been Sant Jeroni in Monserrat.
Things I'm learning / exploring (may or may not be up-to-date):
- Multi-agent RL
- Replacing attention heads with human-readable programs
- Improving monitorability through activation probes
If you're also excited about these topics, feel free to reach out!
Recent
-
Telling Gemma 4 12B it’s in a swarm changes its behaviour
In this experiment, I find that telling Gemma 4 12B it is in a swarm makes it more likely to follow a note left by a previous agent, rather than the user instructions.
-
Combining Synthetic Persona Pretraining with Model Spec Midtraining to Reduce Misalignment
Combining Synthetic Persona Pretraining with Model Spec Midtraining to Reduce Misalignment.
-
Steering Language Models and Interpretability
A primer on how LLMs work and a recap of some of the experiments I've been doing on LLMs as I get into mechanistic interpretability.
-
Building a little robot
I had my love for robotics reignited recently, so I decided to build little robot.