Noah Shinn Portfolio
Researcher (previously at Sierra and Northeastern University) who created Reflexion, a NeurIPS 2023 paper on giving language-model agents verbal self-reflection and reinforcement without updating model weights; also co-created tau-bench for evaluating tool-agent-user interactions in realistic multi-turn settings.
What makes it work
A breakdown of the choices that make this portfolio stand out.
A named architectural pattern for agent self-improvement
Reflexion gives agents a specific mechanism — reflect on a failed attempt in natural language, store that reflection, and use it on the next attempt — turning "agents that learn from mistakes" from a vague goal into an implementable pattern.
Weight-free learning as a deliberate architectural constraint
Choosing to improve agent behavior through stored verbal feedback rather than fine-tuning or RL weight updates is a specific design decision, one that made the pattern usable with any off-the-shelf model rather than requiring custom training.
Small, runnable projects that test the underlying idea narrowly
Repositories that apply the reflection-and-memory idea to narrow, checkable tasks let the architecture be evaluated in isolation rather than only inside one large, hard-to-debug system.
What AI Agent Architects can take from this
Specific, actionable tips to apply to your own portfolio — no generic advice.
Give your agent's self-improvement mechanism a specific, describable form (what gets stored, when it's used) rather than describing it only as "the agent learns."
Consider whether your architecture needs to retrain a model at all — a well-designed memory or feedback mechanism can improve behavior without touching model weights.
Test a new architectural idea on small, narrow, checkable tasks before deploying it inside one large agent — isolating the mechanism makes it easier to verify it actually works.
More AI Agent Architect portfolios
Ready to build your portfolio?
Follow the AI Agent Architect roadmap — skills, projects, and timeline to get hired.