Diptisha Samanta

Language models are becoming increasingly powerful, capable of generating detailed, coherent responses across a wide range of topics. To ensure these systems are used responsibly, they are equipped with safety mechanisms that help prevent them from responding to harmful or dangerous prompts. But what happens when those safety systems can be bypassed not through complex exploits, but through ordinary, harmless-sounding language?

Prompt injection attacks have emerged as one of the most persistent and evolving threats to the large language models. These attacks involve crafting inputs that cause a model to override its built-in safety mechanisms and follow instructions that should have been blocked. As language models become more advanced and their defenses more robust, attackers are developing new methods that are increasingly subtle and harder to detect.

Large Language Models (LLMs) like ChatGPT, Gemini, and Grok have become part of our daily tools, helping with everything from answering queries to customer support to business automation. But as these models become more common in real-world systems, a new kind of security risk is quietly growing — users inadvertently sharing sensitive personal information in their prompts. We often talk about whether an AI model says something it shouldn’t — but what about what we say to it?