Posts

Last updated on Sep 2, 2025 1 min read

Everything about Distributed Training and Efficient Finetuning

A deep dive into distributed training and efficient finetuning - DeepSpeed ZeRO, FSDP, practical guidelines and gotchas with multi-GPU and multi-node training

Last updated on Jan 19, 2024 40 min read

Notes on "An Observation on Generalization"

Diving into “An Observation on Generalization”, a talk by Ilya Sutskever at the Large Language Models and Transformers Workshop, Simons Institute, 2023.

Last updated on Sep 15, 2023 13 min read

Quotes to Ponder On

Who doesn’t like a good quote?

Last updated on Sep 1, 2025 5 min read

Moral rules from the ground up

How do you reason about moral rules? Isn’t it all relative? What can we learn from Adam Smith and Newton’s third law of motion?

Last updated on Sep 27, 2022 7 min read