HKContact
§ 02 — Case Studies

Selected Projects

01Ongoing

Turbo-LLM

Fast Memory-Efficient Inference Engine for Large MoE Models

Turbo-LLM is an experimental inference engine designed to run very large Mixture-of-Experts language models under strict VRAM constraints using dynamic expert execution and adaptive memory management.

35B MoE
Model Scale Supported
~6 GB
Peak VRAM Consumption
2.3 tok/s
RTX 3050 Laptop Speed
~21.0×
Throughput Gain vs Baseline
PythonPyTorchCUDAC++
Read Case Study
02Completed

TinyStories-17M

Training a 17.2M Parameter Language Model From Scratch

TinyStories-17M is a decoder-only Transformer trained entirely from scratch on 2.1 million TinyStories-style synthetic stories to explore how capable modern Small Language Models can become through high-quality data and efficient architecture.

17.2M
Trained Parameters
2.1M
Synthetic Stories
8 Layers
Transformer Depth
512
Context Window Length
PyTorchSentencePieceParquetHugging Face
Read Case Study
03Completed

Spam Detection Model

From Classical Machine Learning to Knowledge Distillation

An end-to-end email classification system that explores multiple machine learning paradigms, progressing from TF-IDF baselines to deep neural networks and finally a lightweight distilled model for efficient deployment.

98.38%
Teacher Accuracy
98.12%
Distilled Model
80M
Teacher Parameters
2M
Student Parameters
PythonPyTorchScikit-learnNumPy
Read Case Study
04Research

Indian Legal LLM

Domain Adaptation of Open Language Models for Indian Legal Reasoning

A series of domain-specific fine-tuning experiments exploring how high-quality legal instruction datasets improve small language models for Indian legal question answering, structured reasoning, and long-form explanation.

2 Models
Versions Trained
171K+
Legal Instructions
1.7B
Max Parameters
GGUF
Deployment Format
PyTorchTransformersGGUFHugging Face
Read Case Study
05Completed

MathInstruct v1

Supervised Fine-Tuning for Mathematical Reasoning

MathInstruct v1 is a mathematics-focused instruction-tuned language model created by supervised fine-tuning Qwen3-0.6B on NVIDIA OpenMathInstruct-2 to improve mathematical instruction following, solution generation, and benchmark performance.

600M
Parameters (Qwen3-0.6B)
0.1 Epoch
Training Duration
OpenMath-2
Fine-Tuning Dataset
SFT
Alignment Protocol
PyTorchTransformersHugging FacePython
Read Case Study