Big Data technology has been one of key engines driving the new industrial revolution. However, the majority of current Big Data research efforts have been devoted to single-modal data analysis, which leads to a huge gap in performance when algorithms are carried out separately. Although significant progress has been made, single-modal data is often insufficient to derive accurate and robust models in many applications. Multimodal is the most general form for information representation and delivery in a real world. Multimodal data analytics algorithms often outperform single modal data analytics in many real-world problems. This workshop aims to generate momentum around this topic of growing interest, and to encourage interdisciplinary interaction and collaboration between Natural Language Processing (NLP), computer vision, machine learning, multimedia, robotics, Human-Computer Interaction (HCI), cloud computing, Internet of Things (IoT), and geospatial communities. It serves as a forum to bring together active researchers and practitioners from academia and industry to share their recent advances in this promising area.

Accepted Papers & Program Schedule

MMBD 2021 -  Dec. 16, 2021

Time ID Type Paper Title Author(s) Session Chair
1:00pm - 1:25pm S43201 Regular Predicting Mental Health Problems with Personality, Behavior, and Social Networks Dongyu Zhang, Teng Guo, Shiyu Han, Sadaf Vahabli, Mehdi Naseriparsa, and Feng Xia Dr. Lindi Liao
1:25pm - 1:50pm S43208 Regular A Re-thinking ASR Modeling Framework using Attention Mechanisms Chih-Ying Yang and Kuan-Yu Chen
1:50pm - 2:15pm S43206 Regular Improving Sign Video Modeling Using Graph Neural Network Al Amin Hosain, Huzefa Rangwala, and Jana Kosecka
2:15pm - 2:40pm BigD276  Regular Relation-Guided Network for Image-Text Retrieval Yulou Yang, Ming Yang, and Hao Shen
2:40pm - 2:50pm     Coffee Break    
2:50pm - 3:10pm S43204 Short Fingerphoto Presentation Attack Detection: Generalization in Smartphones Emanuela Marasco and Anudeep Vurity Dr. Ge Jin
3:10pm - 3:30pm BigD546  Short Multimodal Product Matching and Category Mapping: Text+Image based Deep Neural Network Ketki Gupte and Linsey Pang
3:30pm - 3:50pm S43203 Short ConOffense: Multi-modal multitask Contrastive learning for offensive content identification Debaditya Shome and T Kar
3:50pm - 4:10pm BigD545  Short Deep Learning Approach Towards Squat Isolation in a Multi-Embedded Track Geometry Defects Ibrahim Balogun, Mark Leadingham II, Dominique Gulliot, and Nii Attoh-Okine
4:10pm - 4:25pm S43209 Extended Abstract COVID-19 Multi-Modal Data Analysis with Alexa Voice and Conversational AI Applications Alex Kaplunovich
4:25pm - 4:40pm BigD635 Extended Abstract Multi-modal Hate Speech Detection Using Machine Learning Fariha Tahosin Boishakhi, Ponkoj Chandra Shill, and Md. Golam Rabiul Alam

*The program schedule is subject to change.