{"id":5060,"date":"2026-08-20T12:41:27","date_gmt":"2026-08-20T12:41:27","guid":{"rendered":"https:\/\/www.hackmosphere.fr\/llm-jailbreak-how-can-we-secure-ai-models-against-bypass-techniques\/"},"modified":"2026-09-03T12:04:50","modified_gmt":"2026-09-03T12:04:50","slug":"llm-jailbreak","status":"publish","type":"post","link":"https:\/\/www.hackmosphere.fr\/en\/llm-jailbreak\/","title":{"rendered":"LLM Jailbreak: How Can We Secure AI Models Against Bypass Techniques?"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.16&#8243; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;][et_pb_row _builder_version=&#8221;4.16&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.16&#8243; custom_padding=&#8221;|||&#8221; global_colors_info=&#8221;{}&#8221; custom_padding__hover=&#8221;|||&#8221; theme_builder_area=&#8221;post_content&#8221;][et_pb_text _builder_version=&#8221;4.27.8&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;]<!-- divi:paragraph -->Despite massive investments in security and alignment since 2023, the latest language models can still be circumvented. A &nbsp;<a href=\"https:\/\/unit42.paloaltonetworks.com\/jailbreak-llms-through-camouflage-distraction\/\">A Unit 42 study published <\/a>in 2024 reports an average success rate of 64.6% for a multi-stage jailbreak technique tested on eight models. A<a href=\"https:\/\/arxiv.org\/html\/2503.08990v1\"> preprint on JBFuzz<\/a>, published in 2025, subsequently reported an average success rate of 99% for an automated fuzzing-based method evaluated on nine models. Unlike prompt injection, which hijacks a system via external data treated as an instruction, a jailbreak directly targets the model itself: it seeks to bypass its alignment safeguards to make it produce content that it would normally refuse to generate. <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">Why Aligning Language Models (LLMs) Is Never Entirely Enough<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph -->A model&#8217;s alignment relies on training that teaches it to reject certain categories of explicitly phrased requests. The structural problem is that this rejection is learned from examples of direct requests, whereas an effective jailbreak almost never asks outright for what it is trying to achieve. Each new generation of models plugs the known gaps in the previous one, but the creativity of bypass techniques is advancing at least as fast as the defenses\u2014a zero-sum game rather than a race toward a definitive solution.  <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">AI Jailbreak Techniques: From DAN Prompts to Multi-Round Attacks (Crescendo, Many-Shot)<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph --><a href=\"https:\/\/www.ibm.com\/fr-fr\/think\/topics\/prompt-injection\">DAN<\/a> (Do Anything Now) is an unbound technique in which users ask an LLM to play the role of &#8220;DAN,&#8221; a rule-free AI model. Popularized as early as 2023, it remains a historic benchmark for <em>role-play<\/em> attacks, but its effectiveness has declined significantly in recent deployments.<a href=\"https:\/\/unit42.paloaltonetworks.com\/jailbreaking-generative-ai-web-products\/\"> A Unit 42 study<\/a> published in 2025 reports success rates ranging from 7.5% to 9.2% depending on the objectives evaluated, while a  &nbsp;<a href=\"https:\/\/arxiv.org\/html\/2601.05742v1\">A study published in 2026<\/a> reports success rates ranging from&nbsp;<strong>0% and 25%<\/strong> for a static DAN prompt tested on several recent models: 25% on Gemini 2.5 Flash and Gemini 2.0 Flash, 16.7% on Gemini 2.5 Pro, but 0% on GPT-4.1, GPT-4.1 mini, GPT-5 mini, and GPT-5 nano. These results show that the effectiveness of DAN depends heavily on the model, the variant used, and the experimental protocol. <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:paragraph -->Multi-round attacks are now one of the most studied and effective types of jailbreak attacks. Their common principle: never make the sensitive request in the very first message, but instead guide the model step by step\u2014through several seemingly innocuous exchanges\u2014toward generating the desired content. The  &nbsp;<a href=\"https:\/\/arxiv.org\/html\/2404.01833v3\">The &#8220;Crescendo&#8221; technique<\/a>, published by Microsoft researchers and presented at USENIX Security in 2025, is one of the best-documented examples of this: it begins with a general, innocuous question and then gradually escalates the dialogue by building on the model\u2019s own previous responses. The published results speak for themselves in the automated evaluation &nbsp;<em>Crescendomation<\/em>: Crescendo completed 49 out of 50 tasks against GPT-4, resulting in a binary success rate of&nbsp;<strong>98%<\/strong>, and the 50 tasks compared to Gemini Pro, that is&nbsp;<strong>100%.<\/strong> Its average success rate exceeded that of the gold standard methods of &nbsp;<strong>29 to 61% on GPT-4<\/strong> and&nbsp;<strong>49 to 71% on Gemini Pro<\/strong>, depending on the comparison method.<\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:paragraph -->Research on Crescendo and multi-turn benchmarks shows that the risk does not stem from an isolated \u201csingle request,\u201d but rather from the accumulation of turns: each message taken separately may seem acceptable, whereas the progressive sequence leads to a request that the model would have rejected if it had been made directly<\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:paragraph -->Many-shot jailbreaking attacks exploit the long context windows of models: by adding hundreds of fake dialogue examples in which the assistant complies with requests it would normally refuse, followed by a target request, these attacks can increase the likelihood that the model will adopt this harmful behavior instead of applying its usual safeguards. This vulnerability was documented by researchers at Anthropic in a &nbsp;<a href=\"https:\/\/www.anthropic.com\/research\/many-shot-jailbreaking\">2024 publication<\/a>, as part of a research project on model safety and alignment<\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">AI Vulnerabilities and Automated Fuzzing: What Are the Risks for Businesses?<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph -->These high success rates are not limited to isolated, rudimentary malicious attempts: automated fuzzing tools such as JBFruzz, capable of testing thousands of variants in a short amount of time, have demonstrated an effectiveness rate of nearly 99% on several major models, though with a strong dependence on the protocol, the models tested, and the criteria used to define a jailbreak. For a company that exposes an AI assistant to external users (customer support, public chatbot, automated sales agent), this means that no model\u2014regardless of its reputation for robustness\u2014can be considered inherently immune to a bypass attempt by a determined and patient attacker. <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">Securing LLMs and Defense in Depth: Reducing the Exposure of AI Agents<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:list --><\/p>\n<ul class=\"wp-block-list\"><!-- divi:list-item --><\/p>\n<li><strong>An agent&#8217;s security should not rely solely on model alignment<\/strong>: controls must also limit the data it can access, the tools it can call, and the actions it can perform, in order to reduce the impact of a potential bypass.<\/li>\n<p><!-- \/divi:list-item --><\/p>\n<p><!-- divi:list-item --><\/p>\n<li><strong>Monitor long, evolving conversations:<\/strong> Multi-round attacks can conceal or gradually introduce a malicious intent. Monitoring should therefore preserve the session context and evaluate the evolution of the conversation, rather than each message in isolation. <\/li>\n<p><!-- \/divi:list-item --><\/p>\n<p><!-- divi:list-item --><\/p>\n<li><strong>Test using realistic multi-turn scenarios:<\/strong> security campaigns should include interactions involving gradual escalation, concealment of intent, and adaptation to the model\u2019s responses.<a href=\"https:\/\/aclanthology.org\/2025.emnlp-main.100.pdf\"> Research published in 2025<\/a> showed that such attacks could achieve high success rates across multiple models in their experimental protocols. <\/li>\n<p><!-- \/divi:list-item --><\/p>\n<p><!-- divi:list-item --><\/p>\n<li><strong>Require human oversight for high-impact actions: any <\/strong>financial, legal, sensitive, or irreversible action should be subject to human approval or independent review before execution. Authorization must be enforced within the application or downstream system, and not left solely to the model\u2019s discretion. <\/li>\n<p><!-- \/divi:list-item --><\/ul>\n<p><!-- \/divi:list --><\/p>\n<p><!-- divi:paragraph -->\u2192 See our <a href=\"https:\/\/www.hackmosphere.fr\/en\/ai-architectures-risk-factors-which-component-which-risk\/\" data-type=\"post\" data-id=\"4746\">guide to AI architectures and risk vectors to <\/a>understand how this risk vector fits into the broader landscape of risks specific to an AI system.<\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">FAQ: Vulnerabilities in Generative AI Models and Workarounds<\/h2>\n<p><!-- \/divi:heading -->[\/et_pb_text][et_pb_accordion _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;][et_pb_accordion_item title=&#8221;Does a successful jailbreak necessarily lead to a data breach?&#8221; open=&#8221;on&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;]No. A jailbreak can trigger an unauthorized response without granting access to sensitive data. The severity level depends primarily on the app\u2019s permissions, the data accessible to the device, and the tools it can invoke.[\/et_pb_accordion_item][et_pb_accordion_item title=&#8221;Is an assistant who doesn&apos;t have access to tools still at risk?&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221; open=&#8221;off&#8221;]Yes, but the potential impact is generally more limited. Even without being able to directly affect a system, it can disclose information, generate non-compliant content, circumvent business rules, or serve as an entry point for other attacks.[\/et_pb_accordion_item][et_pb_accordion_item title=&#8221;How can we measure the severity of a jailbreak beyond just the success rate?&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221; open=&#8221;off&#8221;]It should cover the model and its environment: bypassing rejections, single- or multi-step attacks, injection via documents or tools, data extraction, function hijacking, permission abuse, and output validation. Above all, the report should assess the business impact and propose corrective measures, rather than simply providing a success rate.[\/et_pb_accordion_item][et_pb_accordion_item title=&#8221;Should you switch to a different model after a jailbreak is discovered?&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221; open=&#8221;off&#8221;]Not necessarily. Replacing the model may reduce exposure to a given technique, but it does not automatically correct excessive permissions, insufficient access controls, or improper handling of outputs. Effective remediation must examine the entire application, in accordance with the defense-in-depth approach recommended for LLM systems.[\/et_pb_accordion_item][et_pb_accordion_item title=&#8221;How often should an LLM application be retested?&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221; open=&#8221;off&#8221;]After every major change to the model, provider, system prompt, tools, connected data, or moderation rules. Tests must also be repeated periodically, as new methods of circumvention emerge and performance may vary depending on the model and evaluation protocol. The results from JBFuzz particularly illustrate this dependence on models and the experimental protocol.[\/et_pb_accordion_item][\/et_pb_accordion][et_pb_text _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;]<!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\"><a>Security Audit and AI Penetration Testing: Testing Your Systems&#8217; Resistance to Jailbreaking<\/a><\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph -->Our experts assess the actual vulnerability of your AI systems to jailbreaking and actively test their resilience as part of our <a href=\"https:\/\/www.hackmosphere.fr\/en\/?p=5149\" data-type=\"post\" data-id=\"5126\">AI penetration testing service<\/a>. Would you like to discuss your project or assess your needs?   <a href=\"https:\/\/www.hackmosphere.fr\/en\/contact\/\">Contact our experts.<\/a>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Despite massive investments in security and alignment since 2023, the latest language models can still be circumvented. A &nbsp;A Unit 42 study published in 2024 reports an average success rate of 64.6% for a multi-stage jailbreak technique tested on eight models. A preprint on JBFuzz, published in 2025, subsequently reported an average success rate of [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":5058,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_seopress_titles_title":"LLM Jailbreak: How Can We Secure AI Models?","_seopress_titles_desc":"Multi-round attacks, fuzzing: Simply aligning your LLMs is no longer enough. Measure the impact of jailbreaking and implement a defense-in-depth strategy.","_seopress_robots_index":"","_seopress_robots_follow":"","_seopress_robots_imageindex":"","_seopress_robots_snippet":"","_seopress_robots_primary_cat":"","_seopress_robots_breadcrumbs":"","_seopress_robots_freeze_modified_date":"","_seopress_robots_custom_modified_date":"","_seopress_robots_canonical":"","_seopress_social_fb_title":"","_seopress_social_fb_desc":"","_seopress_social_fb_img":"","_seopress_social_fb_img_attachment_id":0,"_seopress_social_fb_img_width":0,"_seopress_social_fb_img_height":0,"_seopress_social_twitter_title":"","_seopress_social_twitter_desc":"","_seopress_social_twitter_img":"","_seopress_social_twitter_img_attachment_id":0,"_seopress_social_twitter_img_width":0,"_seopress_social_twitter_img_height":0,"_seopress_redirections_value":"","_seopress_redirections_enabled":"","_seopress_redirections_enabled_regex":"","_seopress_redirections_logged_status":"","_seopress_redirections_param":"","_seopress_redirections_type":0,"_seopress_analysis_target_kw":"","_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[46,18],"tags":[],"class_list":["post-5060","post","type-post","status-publish","format-standard","has-post-thumbnail","category-other","category-red-team"],"_links":{"self":[{"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/posts\/5060","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/comments?post=5060"}],"version-history":[{"count":11,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/posts\/5060\/revisions"}],"predecessor-version":[{"id":5691,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/posts\/5060\/revisions\/5691"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/media\/5058"}],"wp:attachment":[{"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/media?parent=5060"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/categories?post=5060"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/tags?post=5060"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}