Running Pikachu

Hi, I'm Aditya

Software engineer, DYEL bro, technology enthusiast. Curious about startups, history, space, geopolitics, climate, energy, physics and math.

Currently interested in vector stores, eval engines, and building my own toy systems. I loved space as a child and dreamt of being an astronaut (unironically).

I now work at Uber eats, in the search team which leverages lexical + semantic search for retrieval and a bunch of user interaction data for ranking. I'm working on using semantic ids & near real time features for ranking & using multi-modal embeddings for retrieval. I spent ~4.25 years at Amazon building systems that power payment selection, payment processing and transaction history for India marketplace. Simplistically, if you've ever paid on Amazon, you have touched code that I wrote. I spent almost ~0.75 years at a early stage vector search engine company where we vectorised products using embedding models and stored their vector embeddings in a vector store to enable search & recommendations usecases.

When I'm not coding, you can find me exploring new music, working out, reading history or geopolitics.

Connect

Latest writing

Building an inference server from scratch, Part #2: streaming, or how time to first token went from 30 s to 0.24 s

I added token streaming to my LLM inference server, shipped an emoji bug without noticing, and measured what streaming really buys you: first text in 0.24 s whether the answer is 32 tokens or 512. It doesn't make generation faster though, and it falls apart the moment a few users show up at once.
Read more →