Face Detection

Face detection finds and identifies a face within the provided image and returns its parameters.

The face detection component is provided by Mobile libraries:

• Android Face Auto Capture component
• iOS face Auto Capture component

The Digital Identity Service (DIS) provides the face detection functions in two ways. Either as dedicated Face API functions, or as part of the Onboarding API.

The extended functionality of Face API can be used also for faces uploaded to Onboarding API. Use the self link returned in the customers/{id}/selfie call in the calls of Face API.

Face Detection Result#

When a face is detected, various operations can be performed and more detailed info about the face can be obtained. This includes:

• Face Detection - Face detection confidence and rectangle where the face was found, in the response of the POST faces API call.
• Face Quality - Quality attributes (e.g. brightness, shadow, etc.).
• Face Crop - Straightened image, cropped from the original that contains ICAO defined margin around the face.
• Face Template - Compact representation of the face generated by a neural network. This template can be used for matching. Templates are not compatible across major product upgrades.
• Face aspects - Age and gender estimation.
• Glasses - Confidence score that the person is wearing glasses
• Face mask - Confidence score that the person is wearing a face mask
• Removed background - Face crop with removed background.

Image#

All attributes are calculated from the original image.

Full Frontal Image#

Full frontal image can be used for storing face images in a standard aspect, and can be later used for template creation or matching.

If you need to evaluate passive liveness on the server, cropped images cannot be used because more context around the face is needed for evaluation. For this purpose, you should use the original image.

Face aspects#

• Eye distance - Distance between eyes in pixels.

Face quality#

• Image quality
  • Sharpness - A face attribute for evaluating whether an area of the face image is blurred. Values near 0.0 indicate ‘very blurred’, values near 1.0 indicate ‘very sharp’. The decision threshold is around 0.5.
  • Brightness - A face attribute for evaluating whether an area of the face is correctly exposed. Values near 0.0 indicate ‘very dark’, values near 1.0 indicate ‘very light’, values around 0.5 indicate OK. The decision thresholds are around 0.25 and 0.75.
  • Contrast - A face attribute for evaluating whether an area of the face has sufficient contrast. Values near 0.0 indicate ‘very low contrast’, values near 1.0 indicate ‘very high contrast’, values around 0.5 indicate OK. The decision thresholds are around 0.25 and 0.75.
  • Unique intensity levels - A face attribute for evaluating whether an area of the face has an appropriate number of unique intensity levels. Values near 0.0 indicate ‘very few unique intensity levels’, values near 1.0 indicate ‘enough unique intensity levels’. The decision threshold is around 0.5.
  • Shadow - A face attribute for evaluating whether an area of the face is overshadowed. Values near 0.0 indicate ‘very strong global shadows present’, values near 1.0 indicate ‘no global shadows present’. The decision threshold is around 0.5.
  • Specularity - A face attribute for evaluating whether spotlights are present on the face. Values near 0.0 indicate ‘very strong specularity present’, values near 1.0 indicate ‘no specularity present’. The decision threshold is around 0.5.
  • Background uniformity - A face attribute for evaluating whether the background is uniform. Values near 0.0 indicate ‘non-uniform background present’, values near 1.0 indicate ‘uniform background present’. The decision threshold is around 0.5.
• Head pose
  • Roll - A face attribute representing the rotation angle of the head towards the camera reference frame around Z-axis as per DIN9300.
  • Yaw - A face attribute representing the rotation angle of the head towards the camera reference frame around Y-axis as per DIN9300.
  • Pitch - A face attribute representing the rotation angle of the head towards the camera reference frame around X-axis as per DIN9300.
• Wearables
  • Glasses - A face attribute for evaluating glasses presence. Values near 0.0 indicate ‘no glasses present’, values near 1.0 indicate ‘glasses present’. The decision threshold is around 0.5. This attribute can be also taken as an ICAO feature.
  • Mask
• Expression
  • Eyes
    • Right eye - A face attribute for evaluating right eye status. Values near 0.0 indicate ‘closed, narrowed or bulged eye’, values near 1.0 indicate ‘normally opened eye’. The decision threshold is around 0.5.
    • Left eye - A face attribute for evaluating left eye status. Values near 0.0 indicate ‘closed, narrowed or bulged eye’, values near 1.0 indicate ‘normally opened eye’. The decision threshold is around 0.5.
  • Mouth - A face attribute for evaluating mouth status. Values near 0.0 indicate ‘open mouth, smile showing teeth or round lips present’, values near 1.0 indicate ‘mouth with no expression’. The decision threshold is around 0.5.