Lightfield AI San Francisco, CA

Redefining the CRM category with AI.

Tome AI San Francisco, CA

Developing new paradigms for AI-powered products in the productivity space.

MBZUAI Abu Dhabi, UAE

Advising research efforts on LLMs and their applications to real-world problems.

Facebook / Meta Inc Menlo Park, CA

Project Highlights

• MultiRay Built a service to run multiple very large and accurate models on the same input, and share the majority of the computational costs. MultiRay makes it possible for very accurate self-supervised models to be run on every piece of content. (paper, blog)
• Cross-lingual NLP through XLM-R Trained XLM-R, a state-of-the-art large-scale multilingual language model (paper, blog) and applied it to extend Integrity classifiers to many languages (blog). Extended upon previous work on multilingual word embeddings (blog).
• RoBERTa and applications to Integrity Trained RoBERTa, a robustly optimized BERT pretraining approach, a state-of-the-art self-supervised method (paper, blog, blog). Applied it to identifying violations such as hate speech (blog) and bullying (paper, blog).
• Neural Machine Translation Shipped the first large-scale commercial Neural MT system with big improvements to translation quality. (blog, news)
• NLP for Search Shipped several impactful NLP features to Facebook Search including phonetic name search, intent classification and keyword typeahead.

CLSP, Johns Hopkins University

• Computing Innovation Fellowship (awarded by CRA).
• Performed research on Machine Learning for Structured Prediction.