The basic processing steps for each frame of video, or individual image is:
- The image is given to an automated face and feature detector
- The face is cropped and rotated based on feature positions
- Then passed into the action unit coding system
- Depending on which set of weight files are used a number of different AU's will be calculated. For example:
- AU 1: Inner brow raise
- AU 2: Outer brow raise
- AU 4: Brow corrugator
- AU 5: Upper lid raise
- AU 10: Nasolabial furrow, "disgust"
- AU 12: Lip corner pull, "smile"
- AU 14: Dimpler
- AU 20: Lip stretch, (pull down corners of the mouth) "Eeek!"
- Each output value gives a relative indication of how much a particular AU is present.
For more details about the AU processing, see
this page of the main
MPLab web site.
After launching CERT you should see the main window with the following parts:
- The MPLab logo at the top with buttons and a text field below it.
- The image view is below the buttons, on the left.
- Depending on which plugins are enabled, there may be a progress indicator showing the status of loading data files.
- Also depending on which plugins are enabled, there may be some data views (graphs) to the right of the image view.
- Below the image view is a box with more controls.
In addition to the main window there is a Preferences window with general preferences along with plugin related items.
There is also a Face/AU Data window that is used for viewing or saving CERT output.