High performance computing on Tensor Streaming Processors for large-scale dense linear algebra

In the framework of the Master in High Performance Computing (MHPC) and the Master Degree in Data Science and Scientific Computing (DSSC), and with the collaboration of the "HPC Training and Research for Earth Sciences" (HPC-TRES) programme, we are organising a joint seminar, on December 6th at 15:00 at the University of Trieste, Room 1_A - Edificio D (Dip. Scienze Economiche, Aziendali, Matematiche e Statistiche, Via Valerio n. 4/1 - 34127 Trieste => MAP). 

Abstract

With emphasis on large-scale dense linear algebra, the static and deterministic dataflow computing paradigm that characterizes Groq's Tensor Streaming Processor (TSP) will be presented. The novelty of this SIMD approach will emerge through an overview of the HW architecture and its scalability. The resulting HPC programming environment will be illustrated with some examples of data analysis and with the simulated adiabatic and chaotic evolution of a classical nonlinear system to solve the Max-Cut optimization problem in the Qubo/Ising form. Finally, the recent performance with an inference rate of 237 tokens/s on Lama-2 70B, a large language model, will be highlighted.

Ernesto Bonomi graduated as an Engineer in Physics from the Swiss Federal Institute of Technology in Lausanne, Switzerland and completed the Advanced Master's degree in Physics (Doctorat de 3-ème Cycle) at the University of Orléans, France. He was also awarded a Ph.D. in Theoretical Physics (Doctorat ès Science Physique) at the Ecole Polytechnique and University of Paris XI, France.
Former Director at CRS4 of the "HPC for Energy and Environment" Sector. Currently, Adjunct Professor of "Numerical Simulation and HPC" at the Department of Mathematics and Computer Science of the University of Cagliari, and consultant in the areas of scientific applications of HPC and science education.

After the seminar, a coffee break will ease the discussion.

In this form, you can inform us whether you have any food allergies.

If you are interested in attending the seminar, please fill in the form by December 1st.