{"id":4751,"date":"2026-08-04T10:38:55","date_gmt":"2026-08-04T10:38:55","guid":{"rendered":"https:\/\/www.hackmosphere.fr\/ai-architectures-risk-factors-which-component-which-risk\/"},"modified":"2026-09-03T12:38:57","modified_gmt":"2026-09-03T12:38:57","slug":"ai-architectures-risk-factors-which-component-which-risk","status":"publish","type":"post","link":"https:\/\/www.hackmosphere.fr\/en\/ai-architectures-risk-factors-which-component-which-risk\/","title":{"rendered":"AI Architectures &#038; Risk Factors: Which Building Block for Which Risk?"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.16&#8243; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;][et_pb_row _builder_version=&#8221;4.16&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.16&#8243; custom_padding=&#8221;|||&#8221; global_colors_info=&#8221;{}&#8221; custom_padding__hover=&#8221;|||&#8221; theme_builder_area=&#8221;post_content&#8221;][et_pb_text _builder_version=&#8221;4.27.8&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<p><!-- divi:paragraph -->An AI system in production rarely consists of just a single component: LLM, RAG, and vector databases; function calling; agents orchestrated via MCP; and MLOps and model serving infrastructure.<\/p>\n<p>ving. Each added building block expands the available attack surface, and most of the incidents documented in 2025\u20132026 occur precisely in the interfaces between these building blocks, rather than in the language model itself. This guide covers five architectural building blocks in the order in which they are typically stacked, identifying the risk vector(s) specifically associated with each one.  <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">LLM: prompt injection, jailbreak, and system prompt leak<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph -->The language model itself is the most mature component from a security perspective, precisely because it is the focus of the most research attention. Three<a href=\"https:\/\/www.hackmosphere.fr\/en\/prompt-injection\/\">attack vectors target it directly.Prompt<em> injection<\/em><\/a> inserts malicious instructions into the input processed by the model, either directly or via a document being accessed; this is currently the most well-documented attack vector, with the majority of production deployments being exposed to it in one way or another. <a href=\"https:\/\/www.hackmosphere.fr\/en\/llm-jailbreak\/\">Jailbreak aims <\/a>to bypass alignment safeguards to generate content that would normally be rejected. <a href=\"https:\/\/www.hackmosphere.fr\/en\/system-prompt-leakage\/\">System prompt leakage<\/a> targets internal instructions that configure an application\u2019s behavior; extracting these can reveal business logic or facilitate a more targeted attack.    <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:paragraph -->These three vectors have one thing in common: there is no foolproof defense against them; the probabilistic nature of an LLM makes protection a matter of reducing the attack surface and continuous detection rather than complete elimination.<\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">RAG and Vector Databases: RAG Poisoning<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph -->The RAG enriches a model\u2019s responses with documents retrieved from a vector database at the time of the query\u2014a critical component: these are often copies of data that is already sensitive elsewhere, with historically weaker protection. The associated risk, known as <a href=\"https:\/\/www.hackmosphere.fr\/en\/rag-poisoning\/\">RAG poisoning<\/a>, involves injecting malicious documents into this database: recent research shows that even a very small number of poisoned documents is sufficient to significantly influence the generated responses, even within an index containing several million legitimate documents. Any database fed by ungoverned sources (customer tickets, internal wikis, scraped content) must be treated as a full-fledged channel for indirect injection.  <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:paragraph -->Encryption at rest and in transit, as well as aligning the retention period for indexed documents with that of the original sources, remain basic measures that are often overlooked during the prototyping phase.<\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">MCP, function calling, and agents: inherited permissions and upstream poisoning<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph --><a href=\"https:\/\/www.hackmosphere.fr\/en\/ai-security-function-calling\/\">Function calling<\/a> allows a model to act beyond the text; the MCP protocol standardizes this connection to tools. The most fundamental risk principle can be summed up in one sentence: an <a href=\"https:\/\/www.hackmosphere.fr\/en\/?p=5395\">AI agent<\/a> acts within its own permissions, and any successful manipulation\u2014such as an indirect prompt injection hidden within a viewed document\u2014causes it to inherit that elevation of privileges. This is why <a href=\"https:\/\/www.hackmosphere.fr\/en\/ai-powered-access-and-identity-management-securing-your-api-keys\/\">managing AI access and identities<\/a> becomes a security component in its own right as soon as an agent has tools at its disposal. A CVE documented in early 2026 (<a href=\"https:\/\/aws.amazon.com\/fr\/security\/security-bulletins\/2026-007-AWS\/\">CVE-2026-4270 in awslabs.aws<\/a>) on a widely used MCP server illustrates this scenario: a flaw in file access restrictions exposed arbitrary local content without any compromise of the model.   <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:paragraph -->Autonomous agents pose this risk and add to it the risk of sub-goal hijacking, as well as a supply chain risk specific to their ecosystem: In early 2026, a <a href=\"https:\/\/www.trendmicro.com\/fr_fr\/research\/26\/b\/openclaw-skills-used-to-distribute-atomic-macos-stealer.html\">landmark incident<\/a> illustrated this risk when Openclaw\u2019s Clawhub marketplace was targeted by a campaign involving malicious \u201cskills.\u201d Researchers identified <strong>341 malicious skills<\/strong> out of 2,857 analyzed, several of which were used to install or distribute <strong>the Atomic macOS Stealer<\/strong> <strong>(AMOS)<\/strong> by masquerading as legitimate tools and exploiting the trust of users who had installed these extensions. Upstream from these components, <a href=\"https:\/\/www.hackmosphere.fr\/en\/?p=5482\">model poisoning<\/a> targets the training or fine-tuning process itself to introduce hidden behavior into the final model.  <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">Infrastructure and Model: Extraction, Inversion, and Slopsquatting<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph -->Beneath the application building blocks lie MLOps, model serving, and\u2014for sovereignty\u2014the self-hosted LLM. Two approaches target the model once it has been trained: <a href=\"https:\/\/www.hackmosphere.fr\/en\/model-extraction\/\">model extraction<\/a>, which reconstructs an approximation of the model through repeated queries to its API\u2014posing an intellectual property risk\u2014and model inversion, which reconstructs information about the training data from the responses\u2014posing a direct risk to privacy if that data were sensitive. <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:paragraph -->A more recent vector affects the development pipeline associated with these building blocks: <a href=\"https:\/\/www.hackmosphere.fr\/en\/?p=5071\">slopsquatting<\/a> exploits the fact that a code-generating template sometimes references package names that do not exist<br \/>(<a href=\"https:\/\/arxiv.org\/pdf\/2406.10279\"><strong>20% of <\/strong>generations, according to a study conducted by three universities<\/a>), which an attacker then registers in a public registry to trap developers.<\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">Deepfakes, AI-powered phishing, and data exfiltration: when the target is the architecture itself<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph -->Two types of attacks do not target any internal technical components: deepfakes and AI-assisted phishing use AI as a weapon against the company from the outside, without requiring any compromise of its information system. Finally, data exfiltration cuts across all the previous components (direct entry, a generated response revealing confidential content, or an agent with excessive access), making it less of an isolated vector and more of a potential consequence of any of the poorly secured components listed above. <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">A Single Framework for Prioritization: OWASP LLM Top 10<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph -->These building blocks and vectors largely align with the ten categories of<a href=\"https:\/\/www.hackmosphere.fr\/en\/owasp-llm-top-10-2026\/\">the OWASP LLM Top 10<\/a>, the most widely adopted framework for structuring an audit. Its practical benefit lies in distributing the workload across the relevant teams (application security for prompt injection, the data team for RAG poisoning, and the platform team for the supply chain and serving) rather than treating the ten categories as a flat list. The common aggravating factor across all these vectors is <strong>excessive human trust<\/strong> in the outputs of an AI system: a significant portion of risk reduction does not require expertise in machine learning, but rather the rigorous application of already-known principles (least privilege, input validation, human verification) to high-impact actions.  <\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading --><\/p>\n<h2 class=\"wp-block-heading\">Frequently Asked Questions About the Security of AI Architectures<\/h2>\n<p><!-- \/divi:heading --><\/p>\n<p>[\/et_pb_text][et_pb_accordion _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;][et_pb_accordion_item title=&#8221;Should all bricks be secured with the same level of strength?&#8221; open=&#8221;on&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221;]No. Prioritization should be based on the level of data access and the level of autonomy of each deployed building block, not on a uniform checklist applied indiscriminately.[\/et_pb_accordion_item][et_pb_accordion_item title=&#8221;Is a recent, well-aligned LLM sufficient to mitigate these risks?&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221; open=&#8221;off&#8221;]No. A well-aligned model does nothing to prevent a poisoned RAG, a misconfigured MCP server, or an exposed infrastructure: security is a property of the entire system, not just the model.[\/et_pb_accordion_item][\/et_pb_accordion][et_pb_text _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; theme_builder_area=&#8221;post_content&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p><!-- divi:heading {\"level\":3} --><\/p>\n<h3 class=\"wp-block-heading\">Securing Your End-to-End AI Architecture<\/h3>\n<p><!-- \/divi:heading --><\/p>\n<p><!-- divi:paragraph -->Our experts evaluate every component of your architecture and the associated risks, from mapping to penetration testing.<\/p>\n<p>Would you like to discuss your project or assess your needs?  <a href=\"https:\/\/www.hackmosphere.fr\/en\/contact\/\" data-type=\"page\" data-id=\"1780\">Contact our experts.  <\/a><\/p>\n<p><!-- \/divi:paragraph --><\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>An AI system in production rarely consists of just a single component: LLM, RAG, and vector databases; function calling; agents orchestrated via MCP; and MLOps and model serving infrastructure. ving. Each added building block expands the available attack surface, and most of the incidents documented in 2025\u20132026 occur precisely in the interfaces between these building [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":4994,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_seopress_titles_title":"AI Architectures and Risk Factors: LLMs, MCPs, and Agents","_seopress_titles_desc":"Learn about the main risks associated with AI architectures: prompt injection, RAG poisoning, MCP, AI agents, and LLM security.","_seopress_robots_index":"","_seopress_robots_follow":"","_seopress_robots_imageindex":"","_seopress_robots_snippet":"","_seopress_robots_primary_cat":"","_seopress_robots_breadcrumbs":"","_seopress_robots_freeze_modified_date":"","_seopress_robots_custom_modified_date":"","_seopress_robots_canonical":"","_seopress_social_fb_title":"","_seopress_social_fb_desc":"","_seopress_social_fb_img":"","_seopress_social_fb_img_attachment_id":0,"_seopress_social_fb_img_width":0,"_seopress_social_fb_img_height":0,"_seopress_social_twitter_title":"","_seopress_social_twitter_desc":"","_seopress_social_twitter_img":"","_seopress_social_twitter_img_attachment_id":0,"_seopress_social_twitter_img_width":0,"_seopress_social_twitter_img_height":0,"_seopress_redirections_value":"","_seopress_redirections_enabled":"","_seopress_redirections_enabled_regex":"","_seopress_redirections_logged_status":"","_seopress_redirections_param":"","_seopress_redirections_type":0,"_seopress_analysis_target_kw":"","_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[46,18],"tags":[],"class_list":["post-4751","post","type-post","status-publish","format-standard","has-post-thumbnail","category-other","category-red-team"],"_links":{"self":[{"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/posts\/4751","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/comments?post=4751"}],"version-history":[{"count":19,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/posts\/4751\/revisions"}],"predecessor-version":[{"id":5714,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/posts\/4751\/revisions\/5714"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/media\/4994"}],"wp:attachment":[{"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/media?parent=4751"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/categories?post=4751"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hackmosphere.fr\/en\/wp-json\/wp\/v2\/tags?post=4751"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}