Supercharge Inferencing of GenAI & LLM on AI PC

Supercharge Inferencing of GenAI & LLM on AI PC

No more seats available
Thursday, July 18, 2024 4:00 PM to 6:00 PM · 2 hr. (Europe/Vienna)
Workshop M4
Workshop
AI

Information

In this session, we will introduce how to run local, fast AI inferencing for LLM and gen AI on AI PC with the help of OpenVINO, of which the main points are: a) AI PC quick overview b) OpenVINO Notebooks intro & demo (quick demos/GIFs of different use cases on CPU, GPU and NPU) c) Challenges of AI deployment and general overview of OpenVINO (developer journey) d) Introduction of main features intro, including - Model converter - NNCF (weights compression for LLM) - Optimum-Intel (GenAI) - Deployment (AUTO plugin)

Log in