Quantum Circuits Enhance AI Memory Efficiency with Minimal Parameters
Quantum circuits help AI overcome memory limitations with minimal new parameters

Image: Phys.org
Researchers at Multiverse Computing in San Sebastián, Spain, have developed a method using quantum circuits to enhance large language models (LLMs) like Llama 3.1 8B, reducing memory demands with minimal new parameters. This hybrid approach could lead to more efficient AI systems as quantum technology advances.
- 01The study led by Borja Aizpurua introduces quantum circuits to enhance LLMs without significantly increasing memory requirements.
- 02The team achieved a 1.4% reduction in perplexity for the Llama 3.1 8B model by adding only 6,000 new parameters.
- 03Performance improvements were also noted in a smaller model, SmolLM2, which could answer questions incorrectly handled by classical versions.
- 04Current gains are modest and limited by existing quantum hardware capabilities.
- 05The research suggests a promising future for AI development as quantum processors become more powerful.
Advertisement
In-Article Ad
A team from Multiverse Computing in San Sebastián, Spain, led by Borja Aizpurua, has made strides in enhancing large language models (LLMs) using quantum circuits, as detailed in their recent preprint on arXiv. This innovative approach addresses the growing memory demands associated with scaling LLMs like ChatGPT and Claude, which rely on vast numbers of adjustable parameters. Instead of adding numerous classical parameters, the researchers incorporated small quantum circuit blocks into pre-trained models. This hybrid system allows for the encoding of complex relationships with fewer parameters. Testing their method on the eight-billion-parameter Llama 3.1 8B model, they achieved a 1.4% reduction in perplexity with only 6,000 additional parameters. They also observed consistent performance improvements in the smaller 135-million-parameter SmolLM2 model. While current performance gains are limited by quantum hardware capabilities, the researchers believe that advancements in quantum technology could significantly enhance AI development, offering a cost-effective alternative to expanding infrastructure.
Advertisement
In-Article Ad
Advertisement
In-Article Ad
Reader Poll
Do you think quantum computing will significantly impact AI development?
Connecting to poll...
Read the original article
Visit the source for the complete story.





