INT8 Inference of Quantization-Aware trained models using ONNX-TensorRT
9:45
INT8 Inference of Quantization-Aware trained models using ONN…
4.4K viewsJul 15, 2022
YouTubeONNX
Understanding int8 neural network quantization
22:53
Understanding int8 neural network quantization
4.4K viewsJan 28, 2024
YouTubeOscar Savolainen
Lecture 30: Quantized Training
1:16:40
Lecture 30: Quantized Training
3.1K viewsOct 7, 2024
YouTubeGPU MODE
Start Post-Training Static Quantization | AI Model Optimization with Intel® Neural Compressor
3:59
Start Post-Training Static Quantization | AI Model Optimizati…
220.7K viewsJul 12, 2023
YouTubeIntel Software
[LLMs 实践] 08 LLM.int8 量化细节 （load_in_8bit）以及 bitsandbytes 库
18:12
[LLMs 实践] 08 LLM.int8 量化细节 （load_in_8bit）以及 bitsandbyte…
6.9K viewsJul 9, 2023
bilibili五道口纳什
Day 60/75 LLM Quantization to Convert Float32 to Int8 | LLM Evaluation Framework | Scalable LLM
8:49
Find in video from 03:43How to Perform Quation to Int8
Day 60/75 LLM Quantization to Convert Float32 to Int8 | LLM Eval…
562 viewsApr 9, 2024
YouTubeFreeBirds Crew - Data Science and GenAI
Deep Dive: Quantizing Large Language Models, part 1
40:28
Find in video from 02:05What is quantization?
Deep Dive: Quantizing Large Language Models, part 1
22.8K viewsMar 6, 2024
YouTubeJulien Simon
2:40
Object detection - Yolo quantized INT8
1.5K viewsMay 14, 2018
YouTubeComputerVision_VirtualReality
32:55
Find in video from 01:02Importance of Quantization
Part 1-Road To Learn Finetuning LLM With Custom Data-Quantizati…
156.8K viewsFeb 15, 2024
YouTubeKrish Naik
21:56
YOLO VISION 2023 | Deploying Quantized YOLOv8 Models on Edg…
3.8K viewsMar 27, 2024
YouTubeUltralytics
23:55
Find in video from 20:25Converting the model to a "true" quantized int8 model.
How to statically quantize a PyTorch model (Eager mode)
3K viewsFeb 14, 2024
YouTubeOscar Savolainen
1:21
Raspberry Pi AI: YOLOv8s Object Detection with Int8 Format Using …
2K viewsJul 19, 2024
YouTubeSeeed Studio
50:55
Quantization explained with PyTorch - Post-Training Quantizati…
50.2K viewsDec 11, 2023
YouTubeUmar Jamil
3:48
How Quantization Makes AI Models Faster and More Efficient
2.7K viewsNov 20, 2024
YouTubeDigitalBrainBase
26:13
Quantization Aware Training (QAT) With a Custom DataLoader: Begin…
2.4K viewsApr 9, 2024
YouTubeOscar Savolainen
56:09
vLLM Office Hours - FP8 Quantization Deep Dive - July 9, 2…
3.3K viewsJul 11, 2024
YouTubeNeural Magic
14:57
Simple quantization of LLMs - a hands-on
1.3K viewsMar 14, 2024
YouTubeAI Bites
1:05:42
Find in video from 54:50Static quantization, turning off observers
How to Quantize a ResNet from Scratch! Full Coding Tutorial (Eag…
2K viewsFeb 26, 2024
YouTubeOscar Savolainen
9:49
QTIP - Quantize Models to 2bit and 3bit with Trellises - Hands-on Demo
710 viewsNov 3, 2024
YouTubeFahd Mirza
10:57
Find in video from 00:40Types of Quantization Operations
Day 63/75 What is LLM Quantization? Types of Quantizati…
550 viewsApr 13, 2024
YouTubeFreeBirds Crew - Data Science and GenAI
9:57
What is LLM Quantization ?
2.9K views11 months ago
YouTubeNew Machina
27:43
Find in video from 13:00Understanding Quantization Algorithms
Quantize any LLM with GGUF and Llama.cpp
19.5K viewsMar 2, 2024
YouTubeAI Anytime
10:24
Find in video from 01:01Potential of Extreme Low Bit Quantization
1-Bit Precision LLM Installation - Llama 2 7B in 1-Bit
2.1K viewsMar 28, 2024
YouTubeFahd Mirza
20:51
Advanced PyTorch Graph Manipulation: FX Graph Mode Qua…
483 viewsMar 22, 2024
YouTubeOscar Savolainen
3:16
5 - Stdint library: uint8_t, int8_t, uint16_t, int16_t, uint32_t, int32_t, ...
20.8K viewsApr 22, 2022
YouTubeSteppe School
0:51
TinyChat Computer running Llama2-7B Jetson Orin Nano. Key techniq…
3.7K viewsApr 16, 2024
YouTubeMIT HAN Lab
9:58
SmoothQuant
4.3K viewsOct 25, 2023
YouTubeMIT HAN Lab
33:39
AI Model Efficiency Toolkit (AIMET) Quantization Simulation
649 viewsAug 28, 2024
YouTubeQualcomm Developer
7:48
Find in video from 01:17Partial Quantization Technique
Day 61/75 LLM Quantization | How Accuracy is maintained? | How FP…
568 viewsApr 10, 2024
YouTubeFreeBirds Crew - Data Science and GenAI
23:08
Supporting INT8 Quantized Networks with Unity Sentis (Prese…
77 viewsApr 17, 2024
bilibiliEIGEN_VECTOR
See more videos
Static thumbnail place holder