Idioma:

PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference

Aayush Ankit ; Izzat El Hajj ; Sai, Rahul Chalamalasetti ; Ndu, Geoffrey ; Foltin, Martin ; R Stanley Williams ; Faraboschi, Paolo ; Wen-mei Hwu ; Strachan, John Paul ; Kaushik, Roy ; Milojicic, Dejan S

arXiv.org, 2019-01

Ithaca: Cornell University Library, arXiv.org

Texto completo disponível

Citações Citado por

Enviar para

Título:
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference
Autor: Aayush Ankit ; Izzat El Hajj ; Sai, Rahul Chalamalasetti ; Ndu, Geoffrey ; Foltin, Martin ; R Stanley Williams ; Faraboschi, Paolo ; Wen-mei Hwu ; Strachan, John Paul ; Kaushik, Roy ; Milojicic, Dejan S
Assuntos: Accelerators ; Analog circuits ; Artificial intelligence ; Circuits ; Computer architecture ; Computer Science - Emerging Technologies ; Computer Science - Hardware Architecture ; Computer simulation ; Computing time ; Efficiency ; Energy consumption ; Inference ; Machine learning ; Machine translation ; Mathematical analysis ; Matrix algebra ; Matrix methods ; Memristors ; Neural networks ; Object recognition ; Power consumption ; Power efficiency ; Register allocation ; State of the art ; Synapses ; Workloads
É parte de: arXiv.org, 2019-01
Descrição: Memristor crossbars are circuits capable of performing analog matrix-vector multiplications, overcoming the fundamental energy efficiency limitations of digital logic. They have been shown to be effective in special-purpose accelerators for a limited set of neural network applications. We present the Programmable Ultra-efficient Memristor-based Accelerator (PUMA) which enhances memristor crossbars with general purpose execution units to enable the acceleration of a wide variety of Machine Learning (ML) inference workloads. PUMA's microarchitecture techniques exposed through a specialized Instruction Set Architecture (ISA) retain the efficiency of in-memory computing and analog circuitry, without compromising programmability. We also present the PUMA compiler which translates high-level code to PUMA ISA. The compiler partitions the computational graph and optimizes instruction scheduling and register allocation to generate code for large and complex workloads to run on thousands of spatial cores. We have developed a detailed architecture simulator that incorporates the functionality, timing, and power models of PUMA's components to evaluate performance and energy consumption. A PUMA accelerator running at 1 GHz can reach area and power efficiency of \(577~GOPS/s/mm^2\) and \(837~GOPS/s/W\), respectively. Our evaluation of diverse ML applications from image recognition, machine translation, and language modelling (5M-800M synapses) shows that PUMA achieves up to \(2,446\times\) energy and \(66\times\) latency improvement for inference compared to state-of-the-art GPUs. Compared to an application-specific memristor-based accelerator, PUMA incurs small energy overheads at similar inference latency and added programmability.
Editor: Ithaca: Cornell University Library, arXiv.org
Idioma: Inglês

Links

View paper in arXiv

Voltar para lista de resultados

Realização: Logos de Redes Sociais:

PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference

Aayush Ankit ; Izzat El Hajj ; Sai, Rahul Chalamalasetti ; Ndu, Geoffrey ; Foltin, Martin ; R Stanley Williams ; Faraboschi, Paolo ; Wen-mei Hwu ; Strachan, John Paul ; Kaushik, Roy ; Milojicic, Dejan S

Ithaca: Cornell University Library, arXiv.org

Buscando em bases de dados remotas. Favor aguardar.