Nikhil Jain

I’m a software engineer currently pursuing an M.S. in Computer Science at UC Santa Cruz focused on LLM inference. I completed my B.A. in Computer Science at UC Berkeley and was in the industry for several years.

I’ve worked at Uber on large-scale distributed systems for maps and search, at SambaNova Systems on a compiler for AI hardware, and at Microsoft on the C++ linker team.

I am currently contributing to the llama.cpp WebGPU runtime and creating tinyLLM, a lightweight inference engine.