Principal Engineer

Microsoft

Biography

I am currently a principal engineer at Microsoft GenAI. My main focus is to bring GenAI to practically serve Microsoft and its custmers on realistic scenarios. In the last few years, I

  • help to drive the creation and release of the Phi model series including Phi-4-multimodal, Phi-4-mini (February, 2025), Phi-3.5, Phi-3 to both open source community and Azure AI.
  • drove AI strategies at scale and bring clarity to the leadership team at the Microsoft Office of the CTO, particularly on large model training roadmap and real-world product scenarios.

My professional career is a mix of industrial research labs and startups. I spend a few years at the Machine Intelligence Technology Lab, DAMO Academy, Alibaba. My main focus is to break the language barriers across the Alibaba ecosystem by researching and developing AI solutions for eCommerce scenarios. I was an early machine learning engineer at Textio, a start-up of augmented writing, where I was responsible for training and deploying prediction models. I worked for Microsoft on machine learning models in wearable devices such as the HoloLens project. I was a machine translations researcher at SDL. I am actively coaching and consultanting early-stage startups and young engineers in Vietnam.

Specialties: GenAI, AI strategies, LLM, multimodal, AI product deployments.

Interests

  • Large Language and Multimodal Modeling
  • Model Benchmarks
  • Agentic-based Applications
  • Data Synthetics and Curation

Education

  • PhD in Language Technology, 2012

    Carnegie Mellon University

  • MS in Computer Science, 2005

    Johns Hopkins University

  • BSc in Maths & CS, 2001

    Vietnam National University, Hanoi

Experience

 
 
 
 
 

Principal engineer

Microsoft

Nov 2021 – Present Redmond, Washington
AI at Scale
 
 
 
 
 

Staff engineer

Alibaba

Jul 2018 – Nov 2021 Bellevue, Washington
Breaking language barriers in the Alibaba ecosystem
 
 
 
 
 

Software engineer

Textio

Oct 2016 – Jul 2018 Seattle, Washington

As the 1st machine learning engineer, I’ve helped build Textio’s core predictive engine and learning loop for the augmented writing platform which already used by thousands of companies worldwide.

  • Spearheaded the development of the Textio core models with cutting-edge technologies in statistical natural language processing and machine learning.

  • Design, develop, ship, and improve production features, such as prediction engines for equal opportunity employment, job type, and document type.

  • Created scoring models that helped increase predictive power significantly while preserving explainability and interpretability.

 
 
 
 
 

Research scientist

Microsoft

Jan 2014 – Oct 2016 Redmon, Washington

Working on the next generation of wearable devices at Microsoft, e.g. HoloLens:

  • BCI with deep learning models, e.g. CNN, LSTM, GRU, with a patent pending on eye tracking technology.

  • Implement speaker verification systems on DSP which includes enrollment with MAP adaptation, verification with novel scoring methods, and back-end training pipeline for GMMs.

  • Reduce memory footprint and speed up runtime for i-Vector speaker recognition system with matrix factorization. Implement average stochastic gradient descent with L2 regularization to train sub-matrices.

Research on deep neural network for brain computer interface, i-Vector, probabilistic linear discriminant analysis, matrix factorization, and DNN for multiple-speaker identification.

 
 
 
 
 

Research scientist

SDL

Feb 2012 – Jan 2014 Los Angeles, California

R&D in commercial machine translation systems.

  • Model adaptation: worked on techniques to automatically adapt background translation system to a specific domain/genre via information retrieval approach and machine learning methods.

  • Confidence estimation: explored methods for machine translation quality-prediction including SVM and M5P decision tree. Member of the SDL Language Weaver team that won the 2012 MT quality prediction competition.

  • Reordering models: implemented lexicalized reordering models with distributed Hadoop/Pig training pipeline and real-time decoding.

Skills

Leadership

Guiding teams to reach ambitious goals

Managing cross-organization teams

Ensure seamless teamwork.

Software engineering

Enough to get things done timely

Machine learning

Be able to explain LLMs to a kid

Data munging

Extract gold from dirt

Product development

Turn research ideas to business opportunities

Publications

Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs

We introduce Phi-4-Mini and Phi-4-Multimodal, compact yet highly capable language and multimodal models. Phi-4-Mini is a …

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

We introduce phi-3-mini, a 3.8 billion parameter language model trained on 3.3 trillion tokens, whose overall performance, as measured …