As company's convert to LLM based chatbots, a new attack vector arises. Manipulating the model instructions and command obfuscation can reveal sensitive data that model has been granted access to. Break the LLM by gaslighting it into thinking it is still doing the right thing. Lets dive into how this is accomplished using various methods.