Needless to say the recent advances in autonomous agents like OpenClaw & Hermes Agent. Agent frameworks have made developer life easier with tool calling, skills & MCPs adding scaffold and orchestration harness. Almost all agentic architecture layers are prompt driven. Prompts are a great way of interacting with LLMs, but often leads to unreliable outputs. Tuning prompts is quite a manual intrinsic work, given the non-deterministic nature of LLMs.

Hence the next wave of prompting is through reflection driven methodologies that don’t essentially need explicitly RL or fine tuning but can still invoke the self evolving nature in agents. Can we build a system that learns through its own mistakes and makes it better at each turn?

We essentially need to optimize and quantify which change leads to affecting the overall system. One way to achieve this is through text space optimization by refining the behavioral patterns, validation and feedback loops via evaluation structures.