Workshop on
    Computational Models for Learning Systems
    and Educational Assessment (CMLA   2016)
     Las Vegas, June 26, 2016





To be successful in today’s rapidly evolving, technology-mediated world, students must not only possess strong skills in areas such as reading, math and science, but they must also be adept at “21st-century” skills such as critical thinking, communication, problem-solving, persistence and collaboration.


Building learning and assessment systems that facilitate the development of such skills requires the recognition and extraction of patterns of human behavior and activities. Advances in computer vision, machine learning, educational data mining, and affective computing have made it possible to analyze a much wider range of student responses and activities. This is enabling the expansion of the types of tasks to elicit the knowledge, skills and attributes of learners and, hence, an expansion of the forms of learning and assessments systems we can use.


Inexpensive and ubiquitous sensors like webcams and microphones enable comprehensive sensing of the user’s behavior with real-time capture and recognition of gaze, facial expressions, gestures, body pose, spoken responses and paralinguistics. Such different modalities can then be integrated to model the user’s cognitive thought processes and non-cognitive behavior such as engagement, motivation, persistence and affective (emotional) state during interaction with learning or assessment systems such as educational games and automated tutors.


CMLA 2016 held in conjunction with CVPR 2016 provides an excellent platform for the sharing of knowledge and ideas across disciplines including computer vision, educational measurement and social science. Our hope is that by bringing together the best minds in these fields we will be able to further the state of the art and generate further interest and excitement in this area.


Specifically, the workshop will focus on the following areas:

  . Computational models of human behavior that utilize multimodal data, including but not limited to videos and audios

  . Educational learning and assessment systems that utilize machine learning, affective computing or computer vision

  . Immersive interfaces for simulation training and learning systems that are sensitive to human behavior

  . Applications of multimodal systems for educational assessment, learning systems, training and pedagogy

  . Adoption or fusion of novel research in areas of vision, speech, affect for modeling of social behaviors


Program: Sunday June 26, 8AM - 12PM

  . 0815: Welcome & Opening Remarks

  . 0830: Invited Speaker: Ajay Divakaran, SRI International

  . 0900: Invited Speaker: Robert Mislevy, ETS

  . 0930: Short Talks & Discussion

       - Jonathan Ventura, Steve Cruz and Terrance Boult. Improving Teaching and Learning through Video Summaries of Student Engagement

       - Vikram Ramanarayanan, David Suendermann-Oeft, Patrick Lange, Robert Mundkowsky, Alexei V. Ivanov, Zhou Yu, Yao Qian and Keelan Evanini. Development of an Audiovisual Database of Human-Machine Conversations for Educational Learning and Assessment Applications

  . 1000: Coffee Break

  . 1015: Short Talks & Discussion

       - Rachit Dubey and Zachary Pardos. Understanding & predicting engagement in lecture videos

       - Habiba Khan and Gahangir Hossain. Assessing Adaptive Learning Gain and its Confluence with Task Difficulty

  . 1045: Invited Speaker: Louis-Philippe Morency, CMU

  . 1115: Invited Speaker Jonathan Huang, Google

  . 1145: Open Disucssion Attendees and CMLA Organizing Committee

  . 1200: Closing Remarks CMLA Organizing Committee




  . Jonathan Huang, Google Inc.

  . Ajay Divakaran, SRI International

  . Louis-Philippe Morency, CMU

  . To be determined


Paper Submission


CMLA 2016 is inviting high quality papers in the areas described above. Of particular interest are contributions that investigate multi-disciplinary research in the areas of computer vision, machine learning and new forms of educational learning and assessment tools. CMLA 2016 will offer two publication formats as follows:

  . 4-page short paper, for original contributions incorporating latest results and can be reported briefly;

  . 2-page extended abstract, for work that is in early stages and for novel and promising idea.


Submissions are now closed.


The format of the papers is the same as the CVPR main conference. Manuscript templates can be found at the main conference website:



  . Paper Submission Deadline April 1st, 2016 (Submissions are now closed)

  . Decisions to Authors: April 16th, 2016

  . Camera-ready Deadline: April 29th, 2016

  . Workshop Date: June 26th, 2016 (morning session)

  . Location: In conjunction with CVPR 2016 held at the Caesar's Palace from June 26 - July 1 in Las Vegas, Nevada.




  . Saad Khan, email:, Educational Testing Service

  . Yuchi Huang, Educational Testing Service

  . Alina von Davier, Educational Testing Service

  . Sidney D’Mello, University of Notre Dame

  . Demitris Metaxas, Rutgers University