Skip to content

Kye Gomez (swarms)

@KyeGomezB · view on X ↗

22 y/o Founder @swarms_corp - Building The Agent Economy. Researching Multi-Agent Collaboration, Multi-Modal Models, SSM models, and more https://t.co/ZVoQJD6HQW

33.8K followers
1 thread on ThreadOut

Unrolled threads

Every thread by Kye Gomez (swarms) that readers unrolled on ThreadOut.

Apr 19, 2026
Introducing OpenMythos An open-source, first-principles theoretical reconstruction of Claude Mythos, implemented in PyTorch. The architecture instantiates a looped transformer with a Mixture-of-Expe...
SummaryOpenMythos is an open-source PyTorch implementation of a Recurrent-Depth Transformer (RDT) architecture that applies a fixed transformer block iteratively with Mixture-of-Experts routing, enabling improved efficiency-performance tradeoffs through inference-time reasoning depth rather than parameter count. The architecture uses LTI-stable recurrent injection, sparse expert activation, and multi-latent attention to achieve comparable performance to larger models with significantly fewer parameters.10 tweets1 min read