Publications

2009

  • Micah Eckhardt, Ian Fasel, Javier R. Movellan,” Towards Practical Facial Feature Detection”, International Journal of Pattern Recognition and Artificial Intelligence, 23,3, 379-400, 2009
    Download
    Bibtex
  • Tingfan Wu, Nicholas J. Butko, Paul Ruvulo, Marian S. Bartlett, Javier R. Movellan, “Learning to Make Facial Expressions,” International Conference on Developmental Learning (ICDL) 2009.
    Download
    Bibtex
  • A. Meltzoff, P. Kuhl, J. R. Movellan, T. Sejnowski “Foundations for a New Science of Learning”, Science, 235,5938, 284-288, 2009.
    Download
    Bibtex

  • Nicholas J. Butko, Javier R. Movellan, “Optimal Scanning for Faster Object Detection”, Computer Vision and Pattern Recognition (CVPR) 2009.
    Demo: Comparison of MIPOMDP Retina + Active Search to Full-Frame Viola Jones. [Right-click to save]
    Source Code: Download source code for visual search software.
    Download
    Poster
    BibTex
    Source Code BibTex
  • Paul Ruvolo, Ian R. Fasel, Javier R. Movellan, “Optimization on a Budget: A Reinforcement Learning Approach” Advances in Neural Information Processing Systems, In Press (2009)
    Download
    BibTex

  • J. R. Movellan, M. Eckhardt, M. Virnes, A. Rodriguez (2009) Sociable Robot Improves Toddler Vocabulary Skills. Proceedings of the International Conference on Human Robot Interaction, HRI2009.
    Download
    BibTex

  • Gwen C. Littlewort, Marian Stewart Bartlett, Kang Lee, “Automatic Coding of Facial Expressions Displayed During Posed and Genuine Pain” Image and Vision Computing , In Press (2009)
    Download

  • Marks, T. Hershey, J. Movellan, J. (in press). Tracking Motion, Deformation, and Texture using Conditionally Gaussian Processes. Transactions on Pattern Analysis and Machine Intelligence.
    Download
    BibTex

  • Jacob Whitehill, Gwen Littlewort, Ian Fasel, Marian Bartlett, and Javier Movellan (2009). Towards Practical Smile Detection. Transactions on Pattern Analysis and Machine Intelligence.
    Download
    BibTex
  • Jacob Whitehill, Paul Ruvolo, Tingfan Wu, Jacob Bergsma, and Javier Movellan (2009). Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise. Advances in Neural Information Processing Systems.
    Download

2008

  • Littlewort, Bartlett, & Lee (in press). Automatic coding of Facial Expressions displayed during Posed and Genuine Pain. Image and Vision Computing

  • Bartlett, M. Littlewort, G. Vural, E., Lee, K., Cetin, M., Ercil, A., and Movellan, M. (2008). Data mining spontaneous facial behavior with automatic expression coding. Lecture Notes in Computer Science 5042, p. 1-21.
    Download

  • Vural, E., Cetin, M., Ercil, A., Littlewort, G., Bartlett, M., and Movellan, J. (2008). Automated Drowsiness Detection For Improved Driving Safety. Proc. 4th international conference on automotive technologies. Istanbul.
    Download

  • Cockburn, J., Bartlett, M., Tanaka, J., Movellan, J., Pierce, M., and Schultz, R. (2008). SmileMaze: A Tutoring System in Real-Time Facial Expression Perception and Production for Children with Autism Spectrum Disorder. Intl Conference on Automatic Face and Gesture Recognition, Workshop on Facial and Bodily expressions for Control and Adaptation of Games.
    Download

  • Nicholas J. Butko, Lingyun Zhang, Garrison W. Cottrell, and Javier R. Movellan, “Visual Saliency Model for Robot Cameras”, Proceedings of the 2008 IEEE International Conference on Robotics and Automation (ICRA), pp. 2398–2403, Pasadena, CA, USA, May 19–23, 2008
    Demo 1: Online Saliency Computation Drives a Robotic Camera in Real Time. [Right-click to save]
    Demo 2: Offline Saliency Computation Proceeds Faster than Real Time. [Right-click to save]
    Source Code: Download source code for salience software.
    Download
    BibTex
    Source Code BibTex

  • Nicholas J. Butko and Javier R. Movellan, “I-POMDP: An Infomax Model of Eye Movement”, Proceedings of the 2008 IEEE International Conference on Development and Learning (ICDL), August 9–12, 2008
    Download
    BibTex

  • Ruvolo, P. and Movellan, J. R. Automatic Cry Detection in Early Childhood Education Settings. International Conference on Development and Learning.
    Download

  • Ruvolo, P., Whitehill, J., Virnes, M., and Movellan, J. R. Building a More Effective Teaching Robot Using Apprenticeship Learning. International Conference on Development and Learning.
    Download

  • Ruvolo, P., Fasel, I., and Movellan, J. R. Auditory Mood Detection for Social and Educational Robots. IEEE International Conference on Robotics and Automation.
    Download

  • Whitehill, J., Bartlett, M.S., and Movellan, J.R. Measuring the Difficulty of a Lecture
    Using Automatic Facial Expression Recognition. Intelligent Tutoring Systems 2008 (short paper).
    Download

  • Whitehill, J., Bartlett, M.S., and Movellan, J.R. Automatic Facial Expression Recognition for Intelligent Tutoring Systems. CVPR 2008 Workshop on Human Communicative Behavior Analysis.
    Download

  • Whitehill, J. and Movellan, J.R. Personalized Facial Attractiveness Prediction. Proceedings of the International Conference on Face and Gesture Recognition 2008.
    Download

  • Whitehill, J. and Movellan, J.R. A Discriminative Approach to Frame-by-Frame Head Pose Tracking. Proceedings of the International Conference on Face and Gesture Recognition 2008.
    Download

  • Morency, L.P., Whitehill, J., and Movellan, J.R. Generalized Adaptive View-based Appearance Model: Integrated Framework for Monocular Head Pose Estimation. Proceedings of the International Conference on Face and Gesture Recognition 2008. Download

2007

  • Nicholas J. Butko, Javier R. Movellan, “Learning to Learn”, Proceedings of the International Conference on Development and Learning (ICDL) 2007.
    Download
    BibTex
  • Movellan, J. R. (in press). Contrastive Divergence in Gaussian Diffusions. Neural Computation.
    Download

  • Tanaka F., Cicourel, A. and Movellan, J. R. (2007). Socialization Between Toddlers and Robots at an Early Childhood Education Center. Proceedings of the National Academy of Science. Vol 194, No 46, 17954 x17958.
    Download

  • Bartlett, M.S. (in press). Information maximization in face processing. Neurocomputing. Special Issue on Development and Learning.
    Download

  • Deak, G., Bartlett, M., and Jebara, T. (in press). New trends in integrative cognitive science: Approaches to development and learning. Neurocomputing. Special Issue on Development and Learning.
    Download

  • Vural, E., Cetin, M., Ercil, A., Littlewort G., Bartlett, M. S. and Movellan, J. R. (2007). Drowsy Driver Detection Through Facial Movement Analysis. ICCV 2007.
    Download

  • M.R. Eckhardt, I.R. Fasel and J.R. Movellan,.(under review). Towards Practical Facial Feature Detection. (comments welcome)
    Download

2006

  • Bartlett, M.S., Littlewort, G., Frank, M.G., Lainscsek,C., Fasel, I., Movellan, J.R., Automatic Recognition of Facial Actions in Spontaneous Expressions. Journal of Multimedia
    Download

  • Bartlett, M.S., Littlewort, G.C., Lainscsek, C., Fasel, I., Frank, M.G., Movellan, J.R. (2006). Fully automatic facial action recognition in spontaneous behavior. 7th International Conference on Automatic Face and Gesture Recognition, p. 223-228.
    Download

  • Bosworth, R.G., Bartlett, M. S., and Dobkins, K. R., Image Statistics of American Sign Language: Comparison to Faces and Natural Scenes. Journal of the Optical Society of America A.
    Download

  • Fasel, I.R. (2006). Learning Real-Time Object Detectors: Probabilistic Generative Approaches. Doctoral dissertation, Department of Cognitive Science, University of California, San Diego.
    Download

  • Littlewort, G., Bartlett, M., Fasel, I., Susskind, J., and Movellan, J. (2006). An automatic system for measuring facial expression in video. Computer Vision and Image Understanding, Special Issue on Face Processing in Video. 24(6) p. 615-625.
    Download

  • Marks, T.K. (2006). Facing Uncertainty: 3D Face Tracking and Learning with Generative Models. Doctoral dissertation, Department of Cognitive Science, University of California, San Diego

  • Marks, T.K. and Movellan, J.R. (2006). Invisible face painting: Using Infrared marks for 3D measurements during video collection. Proceedings of the CVPR workshop on Performance Evaluation of Tracking and Surveillance.

  • Susskind, J.M., Littlewort, G.C., Bartlett, M.S., Movellan, J.R., and Anderson, A.K.. Human and Computer Recognition of Facial Expressions of Emotion. Neuropsychologia.
    Download

  • Tanaka, F. and J.R. Movellan(2006). The RUBI Project: Designing Everyday Robots by Immersion. Fifth International Conference on Development and Learning (ICDL)Bloomington, U.S.A., June 2006.

  • Tanaka, F. and J.R. Movellan (2006). Behavior Analysis of Children’s Touch on a Small Humanoid Robot: Long-term Observation at a Daily Classroom over Three Months. Proceedings of the 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), in press Hatfield, United Kingdom, September 2006.

  • Tanaka, F., J. R. Movellan, B. Fortenberry, and K. Aisaka (2006). Daily HRI evaluation at a classroom environment: Reports from dance interaction experiments. In Proceedings of the 2006 Conference on Human-Robot Interaction (HRI), Salt Lake City, 2006.
    Download
  • N. Butko, I. R. Fasel, and J. R. Movellan (2006) Learning about humans during the first 6 minutes of life. Abstract Only. In Proceedings of the 2006 IEEE International Conference on Development and Learning.
    Download
    BibTex

2005

  • Bartlett, M.S., Littlewort, G., Frank, M.G., Lainscsek, C., Fasel, I., and Movellan, J. (2005). Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior. IEEE International Conference on Computer Vision and Pattern Recognition. p. 568-573.
    Download

  • Bartlett, M.S., Movellan, J.R. and Sejnowski, T.J. (2005). Face modeling by information maximization. Invited chapter in Face Processing: Advanced Modeling and Methods. R. Chellappa and W. Zhao, Eds., Academic Press.
    Download

  • Bartlett, M.S., Movellan, J.R., Littlewort, G.C., Braathen, B., Frank, M.G., & Sejnowski, T.J. (2005). Towards automatic recognition of spontaneous facial actions. Afterword by J.R. Movellan and M.S. Bartlett: The next generation of automatic facial expression measurement. In P. Ekman (Ed.), What the Face Reveals, 2nd Edition, Oxford University Press, p. 393-426.
    Download

  • MPT, the machine perception toolbox. If you use it, please cite those below:Fasel, Ian, Bret Fortenberry, and J. R. Movellan. A generative framework for boosting with applications to real-time eye coding. Computer Vision and Image Understanding, 2005.
    Download

  • Ian Fasel, Bret Fortenberry, and J. R. Movellan. A generative framework for real-time object detection and classification. Computer Vision and Image Understanding, 98, 2005.
    Download

  • Fasel, Ian and Javier R Movellan. Weakly-supervised robust, real-time object detection and localization. In NIPS Workshop on Automatic Discovery of Object Categories, Whistler, BC, December 2005.

  • Marks, T.K., Hershey, J., Roddey, J.C., and Movellan, J.R. (2005) Joint Tracking of Pose, Expression, and Texture using Conditionally Gaussian Filters. Advances in Neural Information Processing Systems. Volume 17. MIT Press.
    Download

  • Movellan, J.R. (2005). An infomax controller for real time detection of contingency. In Proceedings of the International Conference on Development and Learning (ICDL05), Osaka, Japan, 2005.
    Download

  • Movellan, J.R., F. Tanaka, B. Fortenberry, and K. Aisaka. (2005). The RUBI project: Origins, principles and first steps. In Proceedings of the International Conference on Development and Learning (ICDL05), Osaka, Japan, 2005.

  • Tanaka, F., B. Fortenberry, K. Aisaka, and J. R. Movellan (2005). Plans for developing real-time dance interaction between qrio and toddlers in a classroom environment. In Proceedings of the International Conference on Development and Learning (ICDL05), Osaka, Japan, 2005.

  • Tanaka, F., B. Fortenberry, K. Aisaka and J.R. Movellan (2005).Developing Dance Interaction between QRIO and Toddlers in a Classroom Environment: Plans for the First Steps.Proceedings of the 2005 IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN), p.223-228 Nashville, U.S.A., August 2005. (Best Paper Award).

2004

  • Bartlett, M., Littlewort, G. Lainscsek, C., Fasel, I., and Movellan, J. (2004). Machine learning methods for fully automatic recognition of facial expressions and facial actions. In IEEE International Conference on Systems, Man & Cybernetics, The Hague, Netherlands, October 2004. p. 592-597
    Download

  • Littlewort, G., Bartlett, M., Fasel, I., Susskind, J., and Movellan, J. (2004). Dynamics of facial expression extracted automatically from video. In IEEE Conference on Computer Vision and Pattern Recognition, Workshop on Face Processing in Video, 2004.

  • Littlewort, G.C., Bartlett, M.S., Chenu, J., Fasel, I., Kanda, T., Ishiguro,H., & Movellan, J.R. (2004). Towards social robots: Automatic evaluation of human-robot interaction by face detection and expression classification. In S. Thrun & L. Saul & B. Schoelkopf, (Eds.) Advances in Neural Information Processing Systems, Vol 16. pg 1563-1570, MIT Press.

  • Littlewort G., Marian Stewart Bartlett, Ian Fasel, Joel Chenu, and Javier R. Movellan. Analysis of machine learning methods for real-time recognition of facial expressions from video. Computer Vision and Pattern Recognition, 2004 (Face Processing Workshop).

  • Marks, T.K., Hershey, J., Roddey, J.C., and Movellan, J.R. (2004) 3D Tracking of Morphable Objects Using Conditionally Gaussian Nonlinear Filters. IEEE Conf. Computer Vision and Pattern Recognition, 2004.

  • Movellan, J. R., J. Hershey, and J. Susskind (2004). Large scale convolutional HMMs for real time video tracking. Computer Vision and Pattern Recognition.

  • Takayuki Kanda, Nicolas Miralles, Masayuki Shiomi, Takahiro Miyashita, Ian Fasel, Javier R. Movellan, and Hiroshi Ishiguro. Face-to-face interactive humanoid robot. IEEE 2004 International Conference on Robotics and Automation, 2004.

2003

  • Bartlett, M.S., Littlewort, G., Braathen, B., Sejnowski, T.J., & Movellan, J.R. (2003). A prototype for automatic recognition of spontaneous facial actions. In S. Becker & S. Thrun & K. Obermayer, (Eds.) Advances in Neural Information Processing Systems, Vol 15, p. 1271-1278, MIT Press.
    Download

  • Bartlett, M.S., Braathen, B., Littlewort, G., Smith, E., Movellan, J.R.. An approach to automatic recognition of spontaneous facial actions. In Advances in Neural Information Processing Systems, 4 number 15. MIT Press, Cambridge, Massachusetts, 2003.
    Download

  • Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R. (2003). Real time face detection and expression recognition: Development and application to human-computer interaction. CVPR Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction.
    Download

  • Bartlett, M.S., J. R. Movellan, G. Littlewort, B. Braathen, Frank M. G., and T. J. Sejnowski. Towards automatic recognition of spontaneous facial actions. In Paul Ekman, editor, What the Face Reveals. Oxford University Press, 2003.
    Download

  • Bosworth, R. G., Wright, C. E., Bartlett, M. S., Corina, D. P., and Dobkins, K. R. Characterization of visual properties of spatial frequency and speed in American Sign Language (2003). In A. E. Baker, B. van den Bogaerde, & O. Crasborn (Eds), Cross-Linguistic Perspectives in Sign Language Research: Selected Papers from TISLR 2000. Hamburg: Signum Press. pg. 265-282
    Abstract
    Download

  • Bartlett, M.S., G. Littlewort, I. Fasel, and J. R. Movellan. Real time recognition of facial expressions: Development and applications to human computer interaction. In Computer Vision and Pattern Recognition. 2003.
    Download

  • Cole, R., van Vuure, S., Pellom, B., Hacioglu, K., Ma, J., Movellan, J., Schwartz, S., Wade-Stein, D., Ward, W., and Yang, J. (2003). Perceptive animated interfaces: First steps toward a new paradigm for human computer interaction. Proceedings of the IEEE, Special Issue on Human Computer Multimodal Interfaces, 91(9):1391 x1405.
    Download

  • Draper, J., Baek, K., Bartlett, M.S., & Beveridge, J.R. (2003). Recognizing faces with PCA and ICA. Computer vision and image understanding 91: Special issue on Face Recognition,p. 115-137.
    Download

  • Marks, T.K., Roddey, J.C., Hershey, J., and Movellan, J.R. Determining 3D Face Structure from Video Images using G-Flow. Demo, Neural Information Processing Systems 16 (NIPS 2003).

  • Marks, T.K., Roddey, J.C., Hershey, J., and Movellan, J.R. G-Flow: a Generative Framework for Nonrigid 3D tracking. Proceedings of 10th Joint Symposium on Neural Computation, 2003.

  • Movellan, Javier, Ian Fasel, and Hiroshi Ishiguro. ATRV-I: a dataset for development and evaluation of pose estimation and expression recognition systems. In Proceedings of the X Joint Symposium Neural Computation, Irvine, CA, 2003.

  • Movellan, J.R., Marks, T.K., Hershey, J., and Roddey, J.C. Gflow: A Generative Model for Tracking Morphable Objects. DARPA Human ID Workshop, September 29 x30, 2003.
  • Movellan, J. R., T. Wachtler, T. D. Albright, and T. Sejnowski (2003). Morton-style factorial coding of color in primary visual cortex. In Advances in Neural Information Processing Systems, number 15. MIT Press, Cambridge, Massachusetts.

  • Odelia Schwartz, Javier R. Movellan, Thomas Wachtler, Thomas D, and Terrence J. Sejnowski. Spike count distributions, factorability, and contextual e?ects in area V1. In Proceedigns Computational Neuroscience. 2003.
    Download

2002

  • Bartlett, M.S., Movellan, J.R., & Sejnowski, T.J. (2002). Face recognition by independent component analysis. IEEE Transactions on Neural Networks 13(6) p. 1450-64.
    Download

  • Braathen, B., Bartlett, M.S., Littlewort-Ford, G., Smith, E. and Movellan, J.R. (2002). An approach to automatic recognition of spontaneous facial actions. Fifth International Conference on automatic face and gesture recognition.
    Download

  • Fasel, I., Bartlett, M.S., Movellan, J.R.. (2002). A comparison of Gabor filter methods for automatic detection of facial landmarks. Fifth International Conference on automatic face and gesture recognition.
    Download

  • Fasel, I., Movellan, J.R.. Comparison of neurally inspired face detection algorithms. In Proceedings of the international conference on artificial neural networks (ICANN 2002). UAM, 2002.
    Download

  • Fasel, I., Bartlett, M.S., Littelwort, G. and Movellan, J.R.. Real time fully automatic coding of facial expressions from video. In Proceedings of the 9th Symposium on Neural Computation. California Institute of Technology, May 2002.

  • Fasel, I., and Movellan, J.R.. Object detection as a Markov decision process. In Proceedings of the 9th Symposium on Neural Computation. California Institute of Technology, May 2002.

  • Fasel, I., Deak, G.O., Triesch, J., and Movellan, J.R.. Combining embodied models and empirical research for understanding the development of shared attention. In Proceedings of the second international conference on development and learning (ICDL02). MIT, 2002.
    Download

  • Littlewort, G., Bartlett, M.S., Fasel, I., Chenu, J., Takayuki K., Hiroshi I., and Movellan, J.R.. Towards social robots: Automatic evaluation of human-robot interaction by face detection and expression classification. In Advances in Neural Information Processing Systems. MIT Press, Cambridge, Massachusetts, in press.
    Download

  • Littlewort, G., Bartlett, M.S., Fasel, I., Chenu, J., and Movellan, J.R.. Analysis of machine learning methods for real-time recognition of facial expressions from video. Computer Vision and Pattern Recognition, under review.
    Download

  • Takayuki Kanda, Nicolas Miralles, Masayuki Shiomi, Takahiro Miyashita, Ian Fasel, Javier R. Movellan, and Hiroshi Ishiguro. Face-to-face interactive humanoid robot. International Conference on Robotics and Automation, under review.
    Download

  • Movellan, J.R., Hershey, J., and Susskind, J.. Large scale convolutional HMMs for real time video tracking. Computer Vision and Pattern Recognition, under review.
    Download

  • J. R. Movellan, J. Hershey, T. K. Marks, and C. Roddey. G-flow: A generative model for fast tracking using 3D deformable models. Computer Vision and Pattern Recognition, under review.
    Download

  • Littlewort, G.C., Bartlett, M.S., Chenu, J., Fasel, I., Kanda, T., Ishiguro,H., & Movellan, J.R. (in press). Towards social robots: Automatic evaluation of human-robot interaction by face detection and expression classification. In S. Thrun & B. Schoelkopf, (Eds.) Advances in Neural Information Processing Systems, Vol 16. MIT Press.
    Download

  • Bartlett, M.S., Movellan, J.R., Littlewort, G.C., Braathen, B., Frank, M.G., & Sejnowski, T.J. (in press). Towards automatic recognition of spontaneous facial actions. Afterword by J.R. Movellan and M.S. Bartlett: The next generation of automatic facial expression measurement. In P. Ekman (Ed.), What the Face Reveals, 2nd Edition, Oxford University Press.
    Download

2001

  • Bartlett, M.S., Braathen, B., Littlewort, G., Sejnowski, T.J., and Movellan, J.R. (2001). A comparative study of alternative FACS coding algorithms. MPLAB-TR-2001-06, Institute for Neural Computation, University of California, San Diego.
    Download

  • Braathen, B., Bartlett, M.S., Littlewort, G., and Movellan, J.R. (2001). First Steps Towards automatic recognition of spontaneous facial action units. Proceedings of the ACM Comference on Perceptual User Interfaces.
    Download

  • Braathen, B., Bartlett, M.S., and Movellan, J.R. (2001). 3-D head pose estimation from video by stochastic particle filtering. Proceedings of the 8th Annual Joint Symposium on Neural Computation.
    Download

  • Littlewort, G., Bartlett, M.S., and Movellan, J.R. (2001). Are your eyes smiling? Detecting genuine smiles with support vector machines and Gabor wavelets. Proceedings of the 8th Annual Joint Symposium on Neural Computation.
    Download

  • Smith, E., Bartlett, M.S., and Movellan, J.R. (2001). Computer recognition of facial actions: A study of co-articulation effects. Proceedings of the 8th Annual Joint Symposium on Neural Computation.
    Download

Prior Work

  • Hershey, J. and Movellan, J. R. (1999) Audio-Vision: Using Audiovisual Synchrony to Locate Sounds. in Solla, Leen and Mullre, Advances in Neural Information Processing. MIT Press.
    Download