Saltar al contenido principal

Escribe una PREreview

Mitigating LLM Prompt Injections via Multi-Vector Representation and Voting-Based Routing

Publicada
Servidor
Preprints.org
DOI
10.20944/preprints202609.1352.v1

Large Language Models (LLMs) suffer from the problem of prompt injection vulnerability, but typical one-step defenses generally fail at the task by having a high amount of false positives. We introduce an innovative two-sided defense architecture that applies semantic multi-vector diversification and ensemble modeling to provide LLM protection without the need for closed black-box solutions. In our framework, we use three different semantic spaces mapping via publicly available embedding algorithms, where each is then scored by parallel classifiers based on gradient boosting machines. The inputs go through an adaptive voting-based routing process; those that receive low entropy ratings are classified normally, while high entropy items are sent through a secondary classifier – a local LLM expert, the Llama Guard 3, that handles the input. Importantly, this solution uses a two-way protection method, which checks the generated outputs and catches late execution and context manipulation vectors. Our experiments on a 93K dataset show that the ensemble approach performed better than any individual sub-model, reaching 90.69 % accuracy and 94.11 % specificity, minimizing any user experience disturbances. The multi-vector layer demonstrated high empirical resilience to tokenization errors, while the output layer filtered out many bypassed malicious items.

Puedes escribir una PREreview de Mitigating LLM Prompt Injections via Multi-Vector Representation and Voting-Based Routing. Una PREreview es una revisión de un preprint y puede variar desde unas pocas oraciones hasta un extenso informe, similar a un informe de revisión por pares organizado por una revista.

Antes de comenzar

We will ask you to log in with your ORCID iD. If you don’t have an iD, you can create one.

What is an ORCID iD?

An ORCID iD is a unique identifier that distinguishes you from everyone with the same or similar name.

Comenzar ahora