1

X-EVAL: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects

Natural Language Generation (NLG) typically involves evaluating the generated text in various aspects (e.g., consistency and …

Minqian Liu, Ying Shen, Zhiyang Xu, Yixin Cao, Eunah Cho, Vaibhav Kumar, Reza Ghanadan, Lifu Huang

X-EVAL: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects

MULTISCRIPT: Multimodal Script Learning for Supporting Open Domain Everyday Tasks

Automatically generating scripts (i.e. sequences of key steps described in text) from video demonstrations and reasoning about the …

Jingyuan Qi, Minqian Liu, Ying Shen, Zhiyang Xu, Lifu Huang

MULTISCRIPT: Multimodal Script Learning for Supporting Open Domain Everyday Tasks

MULTIINSTRUCT: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning

Instruction tuning, a new learning paradigm that fine-tunes pre-trained language models on tasks specified through instructions, has …

Zhiyang Xu, Ying Shen, Lifu Huang

MULTIINSTRUCT: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning

The Art of Socratic Questioning: Recursive Thinking with Lange Language Models

Chain-of-Thought (CoT) prompting enables large language models to solve complex reasoning problems by generating intermediate steps. …

Jingyuan Qi, Zhiyang Xu, Ying Shen, Minqian Liu, Di Jin, Qifan Wang, Lifu Huang

The Art of Socratic Questioning: Recursive Thinking with Lange Language Models

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviours

Humans convey their intentions through the usage of both verbal and nonverbal behaviors during face-to-face communication. Speaker …

Yansen Wang, Ying Shen, Zhun Liu, Paul Liang, Amir Zadeh, Louis-Philippe Morency

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviours

Efficient Low-rank Multimodal Fusion with Modality-Specific Factors

Multimodal research is an emerging field of artificial intelligence, and one of the main research problems in this field is multimodal …

Zhun Liu, Ying Shen, Varun Bharadhwaj, Paul Liang, Amir Zadeh, Louis-Philippe Morency

Efficient Low-rank Multimodal Fusion with Modality-Specific Factors