Skip to content
View Rajat123456789's full-sized avatar
🎯
Focusing
🎯
Focusing
  • San Francisco
  • 07:45 (UTC -07:00)

Highlights

  • Pro

Block or report Rajat123456789

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Rajat123456789/README.md

Hi, I'm Rajat 👋

Software Engineer focused on high-performance systems, GPU computing, and local LLMs. I work at the intersection of low-level CUDA programming and modern ML — from kernel-level optimizations to memory-efficient LLM training and inference.


🔧 What I Build

  • Scalable backends — Spring Boot microservices on Kubernetes, Apache Spark, AWS EKS
  • GPU-accelerated pipelines — CUDA kernels, cuPy/cuDF, Nsight/nvprof profiling, parallel algorithm design
  • Local LLMs — LoRA/QLoRA fine-tuning on NVIDIA GPUs, exploring Apple MLX for on-device inference
  • Distributed ML systems — multi-GPU training with NCCL, torch.distributed, mixed precision, gradient checkpointing

🧠 Tech Stack

Languages     C/C++  ·  CUDA  ·  Python  ·  Java  ·  Bash
ML / DL       PyTorch  ·  TensorFlow  ·  LoRA  ·  HuggingFace  ·  Apple MLX
GPU           CUDA  ·  cuPy  ·  cuDF  ·  Nsight  ·  nvprof
Infra         AWS EKS  ·  Docker  ·  Kubernetes  ·  Terraform  ·  Jenkins
Algorithms    Numerical Optimization  ·  Spatial DS  ·  Graph Algorithms

📌 Selected Projects

Side-by-side benchmark of LLaMA training throughput and memory efficiency on Apple Silicon (MLX) vs NVIDIA CUDA GPUs. Explores unified memory advantages, framework differences, and practical trade-offs for local LLM development.

🏆 OpenAI Parameter Golf (contributor)

Competition to train the smallest LM that fits in 16MB. Explored aggressive quantization and model compression techniques on 8×H100 hardware.

Data harmonization pipeline unifying fragmented labor market datasets — normalization, schema standardization, and semantic enrichment using Python (Pandas, NumPy).


🎓 Background

  • M.S. Artificial Intelligence — San Jose State University Coursework: CUDA Architecture, GPU Programming, Deep Learning, Computer Vision
  • B.Tech Computer Engineering — University of Mumbai

📊 GPU Work Highlights

Project Result
CUDA preprocessing pipeline (160K+ records) 45 hrs → 3 hrs (15× speedup)
LoRA fine-tuning on LLaMA (A100) ~90% memory reduction, no quality loss
Locally hosted finetuned Llama 3 model on Apple Silicon Hosted a server to process requests locally

🌐 Find Me

LinkedIn Tensara Email


Currently exploring MLX for on-device inference

Pinned Loading

  1. openai/parameter-golf openai/parameter-golf Public

    Train the smallest LM you can that fits in 16MB. Best model wins!

    Python 5.2k 3.3k

  2. compare-llama-training-on-apple-silicon-and-cuda-gpu compare-llama-training-on-apple-silicon-and-cuda-gpu Public

    Python 1

  3. Synthesizing-Job-Market-Data-for-Unified-Insights Synthesizing-Job-Market-Data-for-Unified-Insights Public

    Jupyter Notebook 1

  4. introspect introspect Public

    HTML 3 1

  5. DeepDataMiningLearning DeepDataMiningLearning Public

    Forked from lkk688/DeepDataMiningLearning

    Data mining, machine learning, and deep learning sample code

    Jupyter Notebook