Everything about Tokenization
A mini-course on the various aspects of LLM tokenization
Integrating $(IA)^3$ with HuggingFace’s PEFT
Implemented and benchmarked $(IA)^3$, a new parameter-efficient fine tuning method. Our code is now a part of HuggingFace’s PEFT !
Surfstore - A dropbox-like service
Built a scalable, distributed Dropbox-like cloud service for file syncing, with fault-tolerance.
Jester- A text-to-meme generation engine
Type in any text. Select a meme template of your choice. Get a witty meme powered by GPT-3.
Image Restoration for Under-Display Cameras
Under-display cameras offer a number of benefits, but the images aren’t great yet. We trained a deep network for image restoration, published in ECCV 2020.
Adversarial attacks and model uncertainty
Studied different measures and methods of quantifying uncertainty in deep neural nets. Applied them against adversarial attacks.