Skip to content

QIF-T0102

low

Passive facial geometry estimation via display-as-illuminator inverse photometry (presence/orientation detection without camera)

Tier 7 — Speculative

Legacy status: SPECULATIVE

The device display functions as a structured light source — each frame emits a known photon distribution. Reflected light from the user's face is captured by the ambient light sensor (ALS). The known spectral emission S(x,y,λ) and measured reflected irradiance E_sensor = ∫∫ ρ(x,y)cos(θ)S(x,y,λ)/r² dA constrain an inverse photometry problem. CRITICAL FEASIBILITY CAVEAT: A single ALS integrates the entire reflected light field into one scalar value, making 3D geometric reconstruction an ill-posed inverse problem. With current single-sensor hardware, achievable resolution is limited to basic presence detection, head orientation, and coarse proximity estimation — NOT high-fidelity facial geometry. Identity matching might be feasible only against a small template library with strong a priori constraints. Future multi-pixel ALS or multi-sensor arrays could significantly improve reconstruction fidelity. Despite geometric limitations, the same ALS reliably detects physiological signals: pulse-modulated skin reflectance for PPG heart rate (demonstrated in Samsung Galaxy phones) and skin color variations for SpO2 estimation.

Technique Details

Tactic
QIF-S.SC
Status
SPECULATIVE
Bands
S3, S2

Therapeutic Application

Display photon emission reflects off user's face; ambient light sensor captures aggregate reflected irradiance; inverse photometry estimates facial presence, orientation, and physiological signals

Clinical Analog

Photoplethysmography (PPG) via screen light for contactless vital sign monitoring

Treats

  • contactless heart rate monitoring via screen-based PPG (Samsung Galaxy, demonstrated)
  • remote SpO2 estimation via skin color variation (de Haan & Jeanne 2013)
  • neonatal jaundice screening via skin color analysis from reflected screen light
  • facial affect recognition for depression monitoring without camera
  • dermatological screening via structured light skin assessment

Neural Impact

2 of 7 neural bands affected

S3 S2

Drag to rotate. Click a region to learn more.

Click or hover over a glowing region to see the attack techniques targeting it and their severity.

Scoring

NISS v1.1 NISS:1.1/BI:N/CR:N/CD:N/CV:P/RV:F/NP:N
CVSS v4.0 CVSS:4.0/AV:L/AC:H/AT:P/PR:L/UI:P/VC:L/VI:N/VA:N/SC:N/SI:N/SA:N
0.7Low
BICRCDCVRVNP
 

Governance

Neurorights at Risk

This technique threatens 2 of the 4 proposed neurorights (Ienca & Andorno, 2017).

Consent Complexity
0.16 / 4.0

FDORA §3305 Compliance

Cyber Device
Regulatory Coverage
0.4 / 1.0
524B Requirements
TM VA SBOM PM
Regulatory Gaps
  • ! No FDA pathway for consumer sensor exploitation
  • ! Threat not yet in regulatory threat catalogs

Population Vulnerability

CRB vulnerability adjustment (γ=0.30) accounts for age, diagnosis severity, consent capacity, and device dependency.

Population NISS Base Adjusted Severity Delta
Adult (Default) 0.7 0.7 Low -
Child (10yr) + ADHD 0.7 0.8 Low +0.12
Adult with ALS 0.7 0.8 Low +0.11

Validation Status

Theoretical / Not yet validated. This technique has not been independently tested. See the validation dashboard for what has been tested.

Qinnovate Neural Security Atlas Edit this on GitHub