Popular GPUs Used AI Systems Vulnerable to Memory Leak Flaw [Video]

Artificial Intelligence & Machine Learning , Next-Generation Technologies & Secure Development

LeftoverLocals Affects Apple, AMD and Qualcomm Devices (asokan_akshaya) • January 18, 2024    

Researchers uncovered a critical vulnerability in graphic processing units of popular devices that could allow attackers to access data from large language models.

See Also: OnDemand | Integrating Splunk and Panther for Real-Time Alerting and Custom Dashboarding

The flaw, dubbed LeftoverLocals, affects the GPU frameworks of Apple, AMD and Qualcomm devices. Researchers at security firm Trail of Bits, who uncovered the flaw, said it stems from how the affected devices don’t isolate kernel memory, allowing an attacker to simply write GPU kernel code to prompt the targeted devices to dump data from memory.

To orchestrate the hack, the researchers used llama.cpp, Meta’s open-source LLM model, on AMD Radeon RX 7900 XT GPU. They also used open-source …