{"id":4539,"date":"2025-05-13T17:23:32","date_gmt":"2025-05-13T15:23:32","guid":{"rendered":"https:\/\/datalchemy.net\/nos-prestations\/automatic-ai-moderation\/"},"modified":"2025-08-19T10:18:41","modified_gmt":"2025-08-19T08:18:41","slug":"automatic-ai-moderation","status":"publish","type":"projet","link":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/","title":{"rendered":"Automatic AI moderation"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\"><strong>Background and challenges<\/strong><\/h2>\n\n<p>With the democratization of digital platforms (social networks, messaging services), content moderation and toxicity detection have become crucial issues for both private players (X\/Twitter, TikTok, YouTube, Instagram&#8230;) and public authorities (notably the European Commission and its Digital Services Act of August 2023 aimed at establishing a &#8220;safer digital space&#8221;). Manual moderation, defined as the review and removal of problematic user-generated content, faces three major obstacles: <\/p>\n\n<ul class=\"wp-block-list\">\n<li><strong>Volume and speed<\/strong>: millions of publications to be analyzed in real time make the task unviable from a financial and organizational point of view.<\/li>\n\n\n\n<li><strong>Variety of formats<\/strong>: text, images, videos and emojis require multiple skills, and limit the efficiency of manual processes.<\/li>\n\n\n\n<li><strong>Stress for moderators<\/strong>: repeated exposure to shocking content, leading to post-traumatic stress and psychological disorders.<\/li>\n<\/ul>\n\n<p>Faced with these challenges, automated moderation and detection of toxic messages is the only solution that is both scalable and ethical. We carried out an automatic moderation project for one of our customers.   <\/p>\n\n<h2 class=\"wp-block-heading\"><strong>Work performed<\/strong><\/h2>\n\n<ul class=\"wp-block-list\">\n<li><strong>Prompt engineering<\/strong>: design of dedicated prompts for our in-house LLM, to classify messages according to their degree of toxicity.<\/li>\n\n\n\n<li><strong>Test architecture and datasets: <\/strong>set up an architecture to automatically test thousands of annotated messages and easily evaluate the performance of different versions of prompts and templates.  <\/li>\n\n\n\n<li><strong>Integration into a scalable pipeline<\/strong>: implementation of a clustering architecture capable of handling massive flows in parallel.<\/li>\n\n\n\n<li><strong>Connection to production<\/strong>: continuous deployment of the module within the operational environment, guaranteeing immediate support for new content.<\/li>\n<\/ul>\n\n<h2 class=\"wp-block-heading\"><strong>Benefits<\/strong><\/h2>\n\n<ul class=\"wp-block-list\">\n<li><strong>Contextual understanding<\/strong>: fine detection of message toxicity and correct classification of messages containing problematic language in a non-toxic context (calls for help, alerts, quotation of abusive language as part of a complaint, etc.).<\/li>\n\n\n\n<li><strong>Moderator protection<\/strong>: total elimination of human intervention to preserve user anonymity and the mental health of moderators.<\/li>\n\n\n\n<li><strong>Scalability<\/strong>: mass processing with no linear increase in costs or human resources.<\/li>\n\n\n\n<li><strong>Explainability of moderation:<\/strong> thanks to categorization, the explanation of moderation is accessible to moderation teams.  <\/li>\n<\/ul>\n\n<h2 class=\"wp-block-heading\"><strong>Results<\/strong><\/h2>\n\n<p>The pipeline implemented enabled <strong>100% of<\/strong> toxic messages to be blocked during a coordinated attack, whereas competing solutions had to suspend their service for lack of scalability or suitable tools.<\/p>\n\n<p>100% of problematic messages are blocked, and false positives are very rare. Internal moderation teams have seen their workload drastically reduced.   <\/p>\n","protected":false},"featured_media":3769,"template":"","meta":{"_acf_changed":false,"inline_featured_image":false},"tags":[219,202,194,215,221,195,216,218,217],"class_list":["post-4539","projet","type-projet","status-publish","has-post-thumbnail","hentry","tag-hibernate-en","tag-java-en","tag-llm-en","tag-llm-grammar-en","tag-opensearch-en","tag-prompt-engineering-en","tag-prompt-extraction-en","tag-rabbitmq-en","tag-spring-boot-en"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Automatic AI moderation - Datalchemy<\/title>\n<meta name=\"description\" content=\"Implementation of an automatic moderation tool within a messaging system with over a million users.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Automatic AI moderation - Datalchemy\" \/>\n<meta property=\"og:description\" content=\"Implementation of an automatic moderation tool within a messaging system with over a million users.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/\" \/>\n<meta property=\"og:site_name\" content=\"Datalchemy\" \/>\n<meta property=\"article:modified_time\" content=\"2025-08-19T08:18:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/05\/toxicite.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/\",\"url\":\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/\",\"name\":\"Automatic AI moderation - Datalchemy\",\"isPartOf\":{\"@id\":\"https:\/\/datalchemy.net\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/05\/toxicite.png\",\"datePublished\":\"2025-05-13T15:23:32+00:00\",\"dateModified\":\"2025-08-19T08:18:41+00:00\",\"description\":\"Implementation of an automatic moderation tool within a messaging system with over a million users.\",\"breadcrumb\":{\"@id\":\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#primaryimage\",\"url\":\"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/05\/toxicite.png\",\"contentUrl\":\"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/05\/toxicite.png\",\"width\":1024,\"height\":1024,\"caption\":\"toxicite\u0301\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/datalchemy.net\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Projects\",\"item\":\"https:\/\/datalchemy.net\/en\/our-services\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Automatic AI moderation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/datalchemy.net\/en\/#website\",\"url\":\"https:\/\/datalchemy.net\/en\/\",\"name\":\"Datalchemy\",\"description\":\"Expertise, accompagnement  et R&amp;D en data et IA\",\"publisher\":{\"@id\":\"https:\/\/datalchemy.net\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/datalchemy.net\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/datalchemy.net\/en\/#organization\",\"name\":\"Datalchemy\",\"url\":\"https:\/\/datalchemy.net\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/datalchemy.net\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/08\/logo-datalchemy.gif\",\"contentUrl\":\"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/08\/logo-datalchemy.gif\",\"width\":696,\"height\":696,\"caption\":\"Datalchemy\"},\"image\":{\"@id\":\"https:\/\/datalchemy.net\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.linkedin.com\/company\/sas-datalchemy\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Automatic AI moderation - Datalchemy","description":"Implementation of an automatic moderation tool within a messaging system with over a million users.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/","og_locale":"en_US","og_type":"article","og_title":"Automatic AI moderation - Datalchemy","og_description":"Implementation of an automatic moderation tool within a messaging system with over a million users.","og_url":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/","og_site_name":"Datalchemy","article_modified_time":"2025-08-19T08:18:41+00:00","og_image":[{"width":1024,"height":1024,"url":"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/05\/toxicite.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/","url":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/","name":"Automatic AI moderation - Datalchemy","isPartOf":{"@id":"https:\/\/datalchemy.net\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#primaryimage"},"image":{"@id":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#primaryimage"},"thumbnailUrl":"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/05\/toxicite.png","datePublished":"2025-05-13T15:23:32+00:00","dateModified":"2025-08-19T08:18:41+00:00","description":"Implementation of an automatic moderation tool within a messaging system with over a million users.","breadcrumb":{"@id":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#primaryimage","url":"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/05\/toxicite.png","contentUrl":"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/05\/toxicite.png","width":1024,"height":1024,"caption":"toxicite\u0301"},{"@type":"BreadcrumbList","@id":"https:\/\/datalchemy.net\/en\/our-services\/automatic-ai-moderation\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/datalchemy.net\/en\/"},{"@type":"ListItem","position":2,"name":"Projects","item":"https:\/\/datalchemy.net\/en\/our-services\/"},{"@type":"ListItem","position":3,"name":"Automatic AI moderation"}]},{"@type":"WebSite","@id":"https:\/\/datalchemy.net\/en\/#website","url":"https:\/\/datalchemy.net\/en\/","name":"Datalchemy","description":"Expertise, accompagnement  et R&amp;D en data et IA","publisher":{"@id":"https:\/\/datalchemy.net\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/datalchemy.net\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/datalchemy.net\/en\/#organization","name":"Datalchemy","url":"https:\/\/datalchemy.net\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/datalchemy.net\/en\/#\/schema\/logo\/image\/","url":"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/08\/logo-datalchemy.gif","contentUrl":"https:\/\/datalchemy.net\/wp-content\/uploads\/2025\/08\/logo-datalchemy.gif","width":696,"height":696,"caption":"Datalchemy"},"image":{"@id":"https:\/\/datalchemy.net\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/sas-datalchemy\/"]}]}},"_links":{"self":[{"href":"https:\/\/datalchemy.net\/en\/wp-json\/wp\/v2\/projet\/4539","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/datalchemy.net\/en\/wp-json\/wp\/v2\/projet"}],"about":[{"href":"https:\/\/datalchemy.net\/en\/wp-json\/wp\/v2\/types\/projet"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/datalchemy.net\/en\/wp-json\/wp\/v2\/media\/3769"}],"wp:attachment":[{"href":"https:\/\/datalchemy.net\/en\/wp-json\/wp\/v2\/media?parent=4539"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/datalchemy.net\/en\/wp-json\/wp\/v2\/tags?post=4539"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}