Intel Demos Meteor Lake’s VPU, Delivering Huge Boost To Generative AI Content & Stable Diffusion

Hassan Mujtaba
Intel Demos Meteor Lake's VPU, Delivering Huge Boost To Generative AI Content & Stable Diffusion 1

Intel Meteor Lake CPUs are right around the corner and the company gave us an early demo of the AI performance we can expect from its VPU.

Meteor Lake's VPU Is A Dedicated Low Power AI-Engine Designed By Intel To Power Generative AI Applications & More

The demo provided to us by Intel was brief but Intel did give us a taste of the performance with the Meteor Lake VPU enabled in two demos. Before going into those details, we should also state the Meteor Lake CPUs are on track for launch later this summer and more details are going to be revealed in the third quarter of 2023 (August-September). Intel also told us that they will reveal information regarding the new "Core" branding scheme in early June so that's also not that far.

Related Story Intel Core i9-11900K With DDR4 Memory Dethrones Core i9-14900KS With DDR5 Memory In PYPrime Latency Benchmark World Record

So getting on with the details, Intel once again highlighted the disaggregated architecture for Meteor Lake CPUs that are utilizing several Lego-Like tiles as we had reported earlier. A key enabler for Meteor Lake CPUs is the use of Forveros 3D Packaging technology &  it marks the beginning of the ramp for Intel 4 for the client segment. The company calls it the first true "IDM 2.0" client CPU. Some of the main features of Intel's Meteor Lake CPUs include:

  • Next-gen power management
  • New Built-in Intel Arc graphics
  • New integrated AI Engine (VPU)

Intel also shed some light on the Arc Alchemist "Xe-LPG" graphics tile being used by the Meteor Lake CPUs and says that you will see the same technologies as the discrete Arc graphics cards such as DX12 Ultimate, Ray Tracing, and XeSS support in a perfectly balanced thermal envelope.

mtl-ai-deck-for-may-2023-press-brief-page-010
mtl-ai-deck-for-may-2023-press-brief-page-011
mtl-ai-deck-for-may-2023-press-brief-page-012
mtl-ai-deck-for-may-2023-press-brief-page-014
mtl-ai-deck-for-may-2023-press-brief-page-015
mtl-ai-deck-for-may-2023-press-brief-page-017
mtl-ai-deck-for-may-2023-press-brief-page-018
mtl-ai-deck-for-may-2023-press-brief-page-020

Moving over to the AI side of things, Intel highlights the advantages that each of its tiles would bring and these include:

  • GPU - Ideal for AI-infused Media/3D/Render pipeline (Performance Parrleism and Throughput)
  • VPU - Ideal for sustained AI and AI offload (Dedicated Low Power AI Engine across all SKUs)
  • CPU - Ideal for light-weight, single inference low-latency AI tasks (Fast Response)

The VPU will be featured across all Intel Meteor Lake SKUs. Talking to Intel, we were also able to confirm that while the VPU sits within the SoC tile, it is based on a different IP and doesn't uses the two additional Crestmont E-Cores featured on the SOC tile.

An Actual Intel Meteor Lake CPU Powered Laptop:

20230528_154304-2
screenshot_20230529_194922_gallery
20230528_154250-2

The SKU shown was a 16-core and 22-thread chip  (more here) which falls in the 6+8 configuration (6/12 + 8/8Intel has two main advantages of having a dedicated VPU onboard the Meteor Lake CPU. The first tier advantages come in applications on the client side which include:

  • Enhanced Audio Effects
  • Creator And Gaming Effects
  • AI Assistants (Microsoft 365 Copilot)
  • Bringing AI locally to client machines.

The second-tier advantages come in pure and dedicated AI workloads which include:

  • AI Compute Required For Enhancements  GOPS
  • AI Compute Required For Large Language Models (TOPS) - ChatGPT

Intel showed two demos, one with Stable Diffusion AI processing and the other with Advanced Blue processing, The Blur processing achieved with the VPU not only looked better than without the VPU but also consumed 1/5th of the power.

The Stable Diffusion demo was run within GIMP using an open-source plugin developed by Intel. The VPU generated images in a very short time compared to what it usually takes on a standard CPU or iGPU. Although we were unable to get a comparison between VPU off and VPU on, it's still a big deal for consumers.

Intel's Meteor Lake is going to be a big deal as Chipzilla expects to ship millions of units in the coming year. Expect more deep dives by the company in the coming months as we get closer to the launch.

Intel Mobility CPU Lineup:

CPU FamilyPanther LakeLunar LakeArrow LakeMeteor LakeRaptor LakeAlder Lake
Process Node (CPU Tile)Intel 18AIntel 20AIntel 20AIntel 4Intel 7Intel 7
Process Node (GPU Tile)TSMC 3/2nm?TSMC 3nm?TSMC 3nmTSMC 5nmIntel 7Intel 7
CPU ArchitectureHybridHybridHybrid (Four-Core)Hybrid (Triple-Core)Hybrid (Dual-Core)Hybrid (Dual-Core)
P-Core ArchitectureCougar CoveLion CoveLion CoveRedwood CoveRaptor CoveGolden Cove
E-Core ArchitectureSkymont?N/ASkymontCrestmontGracemontGracemont
LP E-Core Architecture (SOC)Skymont?SkymontCrestmontCrestmontN/AN/A
Top ConfigurationTBD4+4 (MX Series)TBD6+8 (H-Series)6+8 (H-Series)
8+16 (HX-Series)
6+8 (H-Series)
8+8 (HX-Series)
Max Cores / ThreadsTBD8/8?TBD14/2014/2014/20
Planned LineupH/P/U SeriesV-SeriesH/P/U SeriesH/P/U SeriesH/P/U SeriesH/P/U Series
GPU ArchitectureXe3-LPG (Celestial)Xe2-LPG (Battlemage)Xe-LPG (Alchemist)Xe-LPG (Alchemist)Iris Xe (Gen 12)Iris Xe (Gen 12)
GPU Execution UnitsTBD64 EUs192 EUs128 EUs (1024 Cores)96 EUs (768 Cores)96 EUs (768 Cores)
Memory SupportTBDLPDDR5X-8533TBDDDR5-5600
LPDDR5-7400
LPDDR5X - 7400+
DDR5-5200
LPDDR5-5200
LPDDR5-6400
DDR5-4800
LPDDR5-5200
LPDDR5X-4267
Memory Capacity (Max)TBD32 GBTBD96 GB64 GB64 GB
Thunderbolt PortsTBDTBDTBD4 (TB4)4 (TB4)4 (TB4)
WiFi CapabilityTBDWiFi 7TBDWiFi 6EWiFi 6EWiFi 6E
TDPTBD17-30WTBD7W-45W15-55W15-55W
Launch2H 20252H 20242H 20242H 20231H 20231H 2022
Share this story

Deal of the Day

Comments