XDFusion

Cross-lingual adaptive response generation

• PDF

• Code

• ACL 2023

ACL Outstanding Paper Award (Oral Presentation) [Meta Reality Labs] Adopt mSeq2seqs for cross-lingual transfer in low-resource language generation.

LABAN

Multi-intent Zero-shot Detection

• PDF

• Code

• EMNLP 2021

Enabled zero-shot intent detection with linear approximation of a user utterance using label BERT embeddings.

Intent Clustering

Contrastive Context Clustering for intent induction

• PDF

• Interspeech 2022

An unsupervised approach to induce dialog intents with a new contrastive learning-based clustering method.

CKA-NLU

Context and Knowledge augmented SLU network. Published in Interspeech '21, ICASSP '22, EACL '23.

• PDF1/ PDF2/ PDF3

• Code

Enabled context and commonsense knowledge awareness for multi-intent and slot filling detection.

ASR with LTR

Learning to rank in ASR second pass rescoring

• PDF

• Code

• Interspeech 2022

Enabled zero-shot intent detection with linear approximation of a user utterance using label BERT embeddings.

Skill Routing Robustness

Heterogeneous data augmentation in skill routing

• Preprint 2023

[Amazon Alexa NLU] Adopt generative language models for heterogeneous data augmentation to improve skill routing model robustness in tail domains.

Deep EyeNet

Retinal image report generation

• Paper

• Code

• WACVx3, ICIP, ICMR

Generate medical descriptions for retinal images with keyword reinforced. This is a collaborative project with published papers. See more in the following link in github pages.

Stack Boxer

Interactive Chatroom with AI chatbot

• Chatbot

• UCB~TFD

• 05/05/2019

A fancy chatroom for you to chat with a deep minded chatbot both in english and chinese.
Three chatbots: StackBot, MovieBot, ChickBot!!

Make Hatsune & Naruto Image

Comic image generation

• GAN

• Side Projects

• 09/12/2019

Simulated the style drawing of Naruto figures to construct new naruto characters completely by artificial intelligence with deep convolutional generative adversarial networks (GAN).

Malaria Image Prediction

• CNN

• Side Projects

• 01/15/2019

Classify and diagnose disease possiblity of a malaria cell dataset with modified resnet50 structure implemented with pytorch, achieving testing accuracy around 85%.

Compose Chinese Lyrics

• RNN

• Side Projects

• 10/12/2018

Trained machine to generate Chinese lyrics based on dataset of composed songs from four popular singers scraped from internet in Taiwan by pytorch with self-defined input words.

Describe an image (Contest)

• RNN

• Competition

• 2/21/2019

Describe a general image with 1-2 sentences by using datasets from Google's Conceptual Captions Competition. Extract and train with ~50000 images to get decent results.