Skip to main content

Write a PREreview

Mitigating LLM Prompt Injections via Multi-Vector Representation and Voting-Based Routing

Posted
Server
Preprints.org
DOI
10.20944/preprints202609.1352.v1

Large Language Models (LLMs) suffer from the problem of prompt injection vulnerability, but typical one-step defenses generally fail at the task by having a high amount of false positives. We introduce an innovative two-sided defense architecture that applies semantic multi-vector diversification and ensemble modeling to provide LLM protection without the need for closed black-box solutions. In our framework, we use three different semantic spaces mapping via publicly available embedding algorithms, where each is then scored by parallel classifiers based on gradient boosting machines. The inputs go through an adaptive voting-based routing process; those that receive low entropy ratings are classified normally, while high entropy items are sent through a secondary classifier – a local LLM expert, the Llama Guard 3, that handles the input. Importantly, this solution uses a two-way protection method, which checks the generated outputs and catches late execution and context manipulation vectors. Our experiments on a 93K dataset show that the ensemble approach performed better than any individual sub-model, reaching 90.69 % accuracy and 94.11 % specificity, minimizing any user experience disturbances. The multi-vector layer demonstrated high empirical resilience to tokenization errors, while the output layer filtered out many bypassed malicious items.

You can write a PREreview of Mitigating LLM Prompt Injections via Multi-Vector Representation and Voting-Based Routing. A PREreview is a review of a preprint and can vary from a few sentences to a lengthy report, similar to a journal-organized peer-review report.

Before you start

We will ask you to log in with your ORCID iD. If you don’t have an iD, you can create one.

What is an ORCID iD?

An ORCID iD is a unique identifier that distinguishes you from everyone with the same or similar name.

Start now