Menan Velayuthan's picture

3 8 2

Menan Velayuthan

velmen

·

AI & ML interests

Machine learning with graphs

Recent Activity

reacted to Jaward's post with ❤️ 4 days ago

nanoBLT: Simplified lightweight implementation of a character-level Byte Latent Transformer model (under 500 lines of code). The model is 2x4x2 (n_layers_encoder, n_layers_latent, n_layers_decoder) layer deep trained on ~1M bytes of tiny Shakespeare with a patch size of 4. Code: https://github.com/Jaykef/ai-algorithms/blob/main/byte_latent_transformer.ipynb

upvoted an article 6 days ago

Tokenization in Transformers v5: Simpler, Clearer, and More Modular

upvoted an article 10 days ago

Gotchas in Tokenizer Behavior Every Developer Should Know

View all activity

Organizations

liked a Space 14 days ago

Porting nanochat to Transformers: an AI modeling history lesson

Learn about ML and Transformers through nanochat

liked a model about 2 years ago

facebook/mbart-large-50-many-to-many-mmt

Translation • 0.6B • Updated Sep 28, 2023 • 304k • • 402