Skip to main content
Almaviva
  1. home-icon /
  2. What we do /
  3. Insight /
  4. Stories /
  5. MeMo - language models based on associative memory mechanisms
INSIGHT

RESEARCH PROJECTS

MeMo - language models based on associative memory mechanisms

Development and definition of the neural architecture of the language model with associative memory mechanisms, and its experimentation

3 min-reading

Additional story details

Industry

Citizenship & Government

Team

Almawave Labs

Digital technologies

Artificial Intelligence

Digital platform

Velvet

Additional story details

Industry

Citizenship & Government

Team

Almawave Labs

Digital technologies

Artificial Intelligence

Digital platform

Velvet

The opportunity

Current LLMs learn through statistical accumulation over vast amounts of data within largely “black box” architectures: the process by which information is learned remains opaque and difficult to interpret. This creates a critical trade-off: generative power versus controllability and transparency.

Developed in partnership with the University of Rome Tor Vergata and funded by the Italian Ministry of University and Research’s Fund for Applied Sciences, MeMo is a cutting-edge research project proposing a fundamental shift: moving from models that implicitly learn what to remember to models that make memory mechanisms structured, inspectable, and editable.

The challenge

The innovation lies in a revolutionary architecture based on Correlation Matrix Memories, explicit associative memories materializing memory as a queryable data structure rather than distributing it across the network’s parameters.

The solution

We contributed to the development and definition of the neural architecture of the new language model, as well as to its experimentation, with the aim of achieving greater control over the information embedded in the model and its reliability.

In addition, we provide support for the experimentation and evaluation of this new class of models, leveraging the know-how gained from training Velvet models in terms of:

  • validation of the new architecture
  • support across the different training phases by identifying the optimal training pipeline
  • definition of workflows for the inspection and modification of data stored within the model

Reduced requirements

related to computation and lower training costs

Targeted removal

of specific information

Greater transparency

regarding how and why responses are generated

Enhanced control

to ensure trustworthy, governable, and regulation-compliant AI

Reduced requirements

related to computation and lower training costs

Targeted removal

of specific information

Greater transparency

regarding how and why responses are generated

Enhanced control

to ensure trustworthy, governable, and regulation-compliant AI

You might be interested in

STORIES

Digital leaders

We shape the future together with digital leaders: people, companies, and institutions.
All the stories
Smart equipment and continuous monitoring for water network
Success stories

Smart equipment and continuous monitoring for water network

Success stories

Smart equipment and continuous monitoring for water network

Permanent water flow, pressure and quality measurement system for reliable data to support data-driven water network and pressure management, and district metering

Smart water management for a predictive water network
Success stories

Smart water management for a predictive water network

Success stories

Smart water management for a predictive water network

Digital system for network efficiency improvement water loss reduction, and environmental sustainability enhancement

Digital water identity for an accessible transparent water network
Success stories

Digital water identity for an accessible transparent water network

Success stories

Digital water identity for an accessible transparent water network

Web portal dedicated to water supply and geolocation system for public drinking fountains

Technology and data for efficient water management​
Success stories

Technology and data for efficient water management​

Success stories

Technology and data for efficient water management​

Early warning system for pollution event monitoring and flow and pressure meter for realtime network supervision

Water loss reduction​ smart management
Success stories

Water loss reduction​ smart management

Success stories

Water loss reduction​ smart management

Pre-localization of leaks across the network to reduce intervention times and improve efficiency in leak detection operations

Anti-drone surveillance
Use cases

Anti-drone surveillance

Use cases

Anti-drone surveillance

End-to-end anti-drone system combining sensors, hardware, software, and countermeasures in a single architecture with AI and cybersecurity by design

Anti-money laundering platform
Success stories

Anti-money laundering platform

Success stories

Anti-money laundering platform

Cloud-based anti-money laundering platform for the integrated management of KYC (Know Your Customer), risk profile, and transaction monitoring for a securities brokerage company

Diagnostic imaging service
Success stories

Diagnostic imaging service

Success stories

Diagnostic imaging service

Regional cloud platform for centralizing and sharing diagnostic images in a regional healthcare system

Almaviva Logo
  • Accessibility
  • CNA - Voluntary Disclosure Policy
  • Contact us
  • Privacy & legal notices
  • Supplier Area