Posts

Tap or Bottled Water?
Decisions, decisions….
Last updated on Nov 5, 2024 3 min read
Everything about Distributed Training and Efficient Finetuning
A deep dive into distributed training and efficient finetuning - DeepSpeed ZeRO, FSDP, practical guidelines and gotchas with multi-GPU and multi-node training
Last updated on Jan 19, 2024 40 min read
Notes on "An Observation on Generalization"
Diving into “An Observation on Generalization”, a talk by Ilya Sutskever at the Large Language Models and Transformers Workshop, Simons Institute, 2023.
Last updated on Sep 15, 2023 13 min read
Quotes to Ponder On
Who doesn’t like a good quote?
Last updated on Nov 19, 2024 5 min read
Moral rules from the ground up
How do you reason about moral rules? Isn’t it all relative? What can we learn from Adam Smith and Newton’s third law of motion?
Last updated on Sep 27, 2022 7 min read