Skip to content

Shuo Yang

@Andy_ShuoYang · view on X ↗

2nd year phd at Berkeley; Efficient ML System;

4.7K followers
1 thread on ThreadOut

Unrolled threads

Every thread by Shuo Yang that readers unrolled on ThreadOut.

Shuo Yang@Andy_ShuoYang

Your gaming PC can now serve frontier models at interactive speed using official checkpoints without extreme quantization! Qwen3.6 35B → 8GB RTX 4060 laptop @ 39 tok/s DeepSeek-V4-Flash 284B → RTX 5...

SummaryFreeToken enables running large frontier AI models on consumer GPUs through optimizations like bandwidth-adaptive CPU-GPU execution and semantic caching, achieving 3-4x faster decode speeds than Ollama. The tool offers a native GUI for easy installation on Windows/Linux and can run models like Qwen3.6 35B on an 8GB RTX 4060 at 39 tokens/second.Aug 21, 20264 tweets♥ 3.8K