Jacob Whitehill

Machine Perception Lab



Jacob Whitehill



Department of Computer Science & Engineering
University of California, San Diego
Email:

I

I finished my PhD in Computer Science at UCSD in October 2012. My research advisors were Dr. Javier Movellan and Prof. Gary Cottrell. I completed my undergraduate degree in computer science at Stanford, and my master's degree in computer science at the University of the Western Cape (South Africa).

I am now working at Emotient.

Teaching

Talks

Research Interests

Machine learning, computer vision, stochastic optimal control, and their applications.
Optimal teaching.

Publications

Jacob Whitehill, Zewelanji Serpell, Yi-Ching Lin, Aysha Foster, and Javier Movellan, "The Faces of Engagement: Automatic Recognition of Student Engagement from Facial Expressions", accepted to Transactions on Affective Computing, 2014. PDF. (Copyright (c) 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.)

Jacob Whitehill, "A Stochastic Optimal Control Perspective on Affect-Sensitive Teaching", Ph.D. dissertation, University of California, San Diego, 2012. PDF.

Jacob Whitehill and Javier Movellan, "Discriminately Decreasing Discriminability with Learned Image Filters", Computer Vision and Pattern Recognition, 2012. PDF. Download Software for DDD. See Supplemental Materials. Also, here is a Danish translation by Excellent Worlds.

Jacob Whitehill, Zewelanji Serpell, Aysha Foster, Yi-Ching Lin, Brittney Pearson, Marian Bartlett, and Javier Movellan, "Towards an Optimal Affect-Sensitive Instructional System of Cognitive Skills", Computer Vision and Pattern Recognition Workshop on Human Communicative Behavior, 2011. PDF.

Jacob Whitehill, Paul Ruvolo, Jacob Bergsma, Tingfan Wu, and Javier Movellan, "Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise", Advances in Neural Information Processing Systems (forthcoming), 2009. PDF. Download Software for GLAD. See Supplementary Derivations. Also, the Duchenne experiment data are available.

Jacob Whitehill, Gwen Littlewort, Ian Fasel, Marian Bartlett, and Javier Movellan, "Toward Practical Smile Detection", Transactions on Pattern Analysis and Machine Intelligence, 2009. PDF

Louis-Philippe Morency, Jacob Whitehill, and Javier Movellan, "Monocular head pose estimation using generalized adaptive view-based appearance model". Image and Vision Computing, 2009.

Louis-Philippe Morency, Jacob Whitehill, and Javier Movellan, "Generalized Adaptive View-based Appearance Model: Integrated Framework for Monocular Head Pose Estimation". Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition, 2008. PDF. Best paper award.

Paul Ruvolo, Jacob Whitehill, Marjo Virnes, and Javier Movellan, "Building a More Effective Teaching Robot Using Apprenticeship Learning", Proceedings of the International Conference on Development and Learning, 2008. PDF.

Jacob Whitehill and Javier Movellan, "A Discriminative Approach to Frame-by-Frame Head Pose Tracking", Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition, 2008. PDF

Jacob Whitehill and Javier Movellan, "Personalized Facial Attractiveness Prediction", Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition, 2008. PDF

Jacob Whitehill, Marian Bartlett, and Javier Movellan, "Measuring the Perceived Difficulty of a Lecture Using Automatic Facial Expression Recognition", Intelligent Tutoring Systems, 2008. PDF
View this page in Romanian courtesy of azoft

Jacob Whitehill, Marian Bartlett, and Javier Movellan, "Automatic Facial Expression Recognition for Intelligent Tutoring Systems", Proceedings of the CVPR Workshop on Human Communicative Behavior Analysis, 2008. PDF

Jacob Whitehill and Christian W. Omlin, "Local versus Global Segmentation for Facial Expression Recognition", Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition, 2006. PDF

Jacob Whitehill and Christian W. Omlin, "Haar Features for FACS AU Recognition", Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition, 2006. PDF

Jacob Whitehill, Automatic Real-Time Facial Expression Recognition for Signed Language Translation, M.Sc. thesis, University of the Western Cape (South Africa), 2006. This thesis contains a fairly comprehensive literature review of automatic facial expression recognition (FER) literature through 2005, which may be helpful for other researchers. PDF

Unpublished

Jacob Whitehill, "Understanding ACT-R: An Outsider's Perspective". Understanding Anderson's ACT-R model of cognition can be difficult for an outsider, especially because the literature is distributed over a large collection of texts, and the definitions are often vague. This is my summary of the most important topics of the theory. PDF

Jacob Whitehill, "Optimal Teaching Machines". A review paper on formulating automated teaching as an optimal control problem. This is a work in progress. PDF

Personal

I occasionally wrestle with San Diego Wrestling. Ich spreche auch fliessend Deutsch.