• PhD / Founder
  • Computer Vision & NLP
  • Researcher @ DeepMind

Hi, this is Jason Lin|

who .

 NEW!  Creator of Transformer & Attention Mechanisms for Udacity's Generative AI degree.
 NEW!  Invited by United Nations to deliver opening keynote at 2022 Innovations Dialogue.

About Me

headshot

LinkedIn
Jason Lin


Hi! I graduated with a M.S. in Computer Science from Georgia Institute of Technology, specializing in Machine Learning and Computer Vision . I earned my dual degree in Computer Science & Business Administration at the University of Southern California (USC).

 [2021-] I focus on large language models (LLMs), retrieval, and multimodal NLP. 
My M.S. research interests were in deep learning-based object detection and 3D understanding, with an emphasis on perception for autonomy and human-centered AI. In undergrad I specialized in OS, networking and security.

I've been fortunate to live in many places: New York, Los Angeles, Atlanta, Philadelphia, Hong Kong, San Jose, Palo Alto, and (currently) San Francisco. In my spare time, I enjoy hiking outdoors and reading history.

Research

   

ScreenAI: A Vision-Language Model for UI and Infographics Understanding
anonymous.
International Joint Conferences on Artificial Intelligence (IJCAI)
, under review
paper. 2024.

   

Explore, Establish, Exploit: Red Teaming Language Models from Scratch
Stephen Casper, Jason Lin, et al.
International Conference on Learning Representations (ICLR)
, under review
paper. 2023.

   

Zorro: the masked multimodal Transformer
Adria Recasens, Jason Lin, Joao Carreira, et al.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
, under review
paper. 2023.

   

Diffusion Models as Visual Reasoners
Jason Lin*, Maya Srikanth*.
AAAI Conference on Artificial Intelligence (AAAI) workshop
, Creative AI Across Modalities
paper. poster. 2023.

   

A Distribution-Aware Approach to Dense Retrieval
Jason Lin, Justin Young, Simran Arora.
Best Poster Award / CS224N, advised by Christopher Manning (Stanford)
paper. poster. 2022.

   

IOTA: A Cryptographic Perspective
Bryan Baek, Jason Lin.
Blockchain and Cryptocurrency, advised by Vladimir Kolesnikov (Georgia Tech)
paper. Technical Report 2019.

   

AutoML: Automatic Data Augmentation with LSTM and Policy Optimization
Yousef Emam, Jason Lin.
Reinforcement Learning and Adaptive Control, advised by Byron Boots (UW)
paper. code. 2019.

   

Interactive Classification for Deep Learning Interpretation
Angel Cabrera, Fred Hohman, Jason Lin, Duen Horng Chau.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Demo

arXiv. code. 2018.

   

AdVis: Visualizing and Attributing ML Attacks to scalable Adversarial Inputs
Jason Lin, Dilara Soylu.
Advanced Computer Vision, advised by James Hays (Georgia Tech)
poster. code. YouTube. 2018.

   

Detecting Graphical Regions of Interest with Gaussian Process Bayesian Optimization
Jason Lin, Hakki Mert Torun, Weihua Zhu, Jingjing Pan.
Probabilistic Graphical Models, advised by Faramarz Fekri (Georgia Tech)
slides. 2018.



Research interests: computer vision, language reasoning, deep learning  
Contact: jlin401 [at] gatech [dot] edu  Google Scholar

 

Experience

2019


Google X

2020


Lyft Self-Driving

2021


Faber Labs

2022


DeepMind

Projects

2019

3D Detection with RGB-D

Indoor scene understanding

BubblePop: Gamify Awareness

Opinion exchanges & Inclusion offline

Automatic Augmentation

Image Augmentation from experience

2018

CVPR: Visualizing Classifers

Interactive Deep Learning Classification

Advanced CV: AdVis.js

Exploring Adversarial Attacks

PGM - Regions of Interest

Graphical Models in Saliency Detection

2017

Graduate Computer Vision

SIFT, Projection, Scene Understanding

Cue: Bias-busting VR

Exposing unconscious bias by Q&A

Artemis

Food-tracking IoT Intelligence

Stockpedia

Data Driven Stock Analytics

Keplerian VR

Immersive team collaboration in VR


2016

SoundScape

Location Aware Speakers

OlympicBPM

Biosensor in Olympics

SudoMap

Never miss a beat

Speed of Sound

NLP: Summarize & review on the fly

FooedBar

VR Food Experience

2015

Innovation Insight

Computer vision for the blind

Groupazza

Study group & chatrooms

Jola!

Android personal assistant

Vectorizor

Pencil sketch to SVG

TweeTINT

Sentiment Analysis Webapp

Data Visualization

D3.js rendering



#HackathonWinners
                                                      


Blog

Like what you see? There's always more. Somewhere.

Visit Blog Medium
unique visitors since July 2015