Services

GenAI Consulting Service

I offer consulting for tech startups and manufacturers aiming to add Generative AI to their products. I believe Generative AI will revolutionize all industries, but talent is scarce. My services include product ideation, early-stage prototyping, and system design.

Rates are project-based and vary according to the project's scope.

Career Coaching

I provide career coaching for individuals aiming to transition into Generative AI, ML Infrastructure, or Data Science. Originating from a mechanical engineering background, I cultivated my skills in ML independently. Notably, I advanced to lead ML infrastructure projects at both Robinhood and Google.

My services encompass comprehensive resume reviews, thorough interview preparation, and strategic career guidance.

The hourly rate is $300 (USD). Coaching sessions can be scheduled through my email.

LLM Serving System Course

Currently under development. This course will offer a comprehensive summary of the latest research progress in Large Language Model (LLM) serving systems, presented in an easily digestible format. Participants will benefit from step-by-step exercises and weekly QA sessions.

• Transformer Architecture with deep dive into attention
• Techniques to speed up inference
• Sampling / Decoding Process
• Implement a single-machine Chat system
• Distributed LLM serving

Join the waitlist to receive notifications about the course's availability.