Session

Harness Engineering 101: What Makes an AI Agent Finish the Job?

## Abstract

How does an AI agent know what it can do, what happened after it tried, and when the job is done? This talk introduces harness engineering, the practice of designing the software around a model that gives it context, runs its tools, and checks its work. You’ll learn how those pieces fit together and see them in action in a short coding-agent demo.

## Description

When you ask a coding agent to fix a bug, the model can propose an action like reading a file or running a command. The harness checks whether that action is allowed, executes it, and sends the result back to the model. The model uses that result to choose its next action. That cycle is the agent loop.

Harness engineering is about designing what happens around that loop. We’ll explore four decisions every agent builder faces.

- **Context.** What does the model need to see to make its next decision? That might include repository instructions, relevant files, and the results of earlier actions.
- **Tools and permissions.** What can the agent do, and which actions require a person’s approval?
- **Feedback and recovery.** When a command fails, what information helps the agent choose a better next step? When should it retry or ask for help?
- **Verification and stopping.** What evidence shows the task is complete? When should the harness end a run that’s going in circles?

A short Python demo will make those decisions concrete. We’ll give the same model the same bug twice and change one thing about the harness. In the second run, it can run tests and use failures to guide its next attempt. We’ll follow the tool calls and results to see how the feedback changes what the agent can do next.

## Key Takeaways

- Explain what an agent harness does and how it works with the model and its tools.
- Identify the design decisions behind context, permissions, feedback, and stopping conditions.
- Use an execution trace to see what the agent knew, what it tried, and where it got stuck.
- Define what counts as a completed task and how the harness can verify it.


## Session Type

Talk with a short live demonstration

## Talk Level

Beginner

## Audience

Software developers and engineers who want to understand how AI agents work or are considering building one. Basic Python familiarity helps with the demo. No prior experience with LLM APIs or agent frameworks is required.

## Duration

45 minutes, including 5 minutes for Q&A

Sujee Maniyam

Developer Advocate @ Nebius

San Jose, California, United States

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top