Hi 🤝 I am Rahul, I recently worked as a Research Fellow at Microsoft Research (2021-2023) with Yashoteja Prabhu and Manik Verma on Transformer Compression and Extreme Classification . Right now I am working on the current thing.

I did my undergraduate thesis at VAL, Indian Institue of Science on Capsule Networks and before that spent 3 months at Indian Institute of Remote Sensing as a research intern. In a previous life I also spent 2 years as a software engineer at Arcesium.

I graduated with a B.Tech (Hons.) in Computer Science from BITS Pilani, India in 2019. For more details, check my CV. Here is a list of papers I am currently reading : [List]

Publications

Enhancing Tail Performance in Extreme Classifiers by Label Variance Reduction
Anirudh Buvanesh*, Rahul Chand*, Yashoteja Prabhu, Manish Gupta, Manik Verma (* = Equal Contribution)
ICLR'24 | International Conference on Learning Representations
pdf| abstract

DSFormer: Effective Compression of Text-Transformers by Dense-Sparse Weight Factorization
Rahul Chand, Yashoteja Prabhu, Pratyush Kumar
pdf| abstract

CapsFlow: Optical Flow Estimation with Capsule Networks
Rahul Chand, Rajat Arora, Ram Prabhakar Venkatesh Babu
pdf| abstract

Open Source

gpu_poor (450+ stars)
Tool to check vRAM and token/s requirement for any LLM for consumer hardware. It supports ggml, HuggingFace, bitsandbytes, QLoRA and gradient checkpointing.

llama2.c-for-dummies (175+ stars)
Starter tutorial for inference with LLaMA in C

Microsoft Research
2021 - 2023
Arcesium
2019-2021
IISC
S2019
IIRS
S2018
BITS Pilani
2015 - 2019