Skip to content

Validation Status

Transparency about what has been tested, how it was tested, and what remains untested. This project is solo research. Honest reporting of validation boundaries is more valuable than overstating results.

Data Source Disclaimer

All EEG-based tests were conducted using synthetic EEG signals generated by BrainFlow's Synthetic Board. No real human EEG data and no human subjects were involved.

  • BrainFlow API: BrainFlow provides a uniform API to acquire raw EEG, EMG, and ECG data streams from supported biosensing hardware (OpenBCI, ANT Neuro, and others). Our tests used BrainFlow's Synthetic Board, which generates artificial signals mimicking real EEG characteristics.
  • Data Format: Data is provided as a 2D NumPy array containing EEG channels, accelerometer, and timestamps, enabling detailed real-time analysis.
  • Synthetic Data for Development: When real hardware is unavailable, BrainFlow includes a Synthetic Board and playback board that generate artificial signals mimicking real data. These emulators are intended for software development and testing, not clinical use.
9
Components Tested
6
Not Yet Tested
0
On Real Hardware

Validation Tiers

Simulation 7

Tested against synthetic data or simulated environments

Independent Validation 2

Verified by independent code, separate implementation, or third-party tool

Coordinated Disclosure 1

Vulnerability confirmed through responsible disclosure process

Analytical Review 1

Systematic review of constraints, equations, or logic by structured analysis

Cross-AI Verification 1

Independently verified by multiple AI systems (Claude, Gemini, GPT)

Clinical / IRB 0

Tested on real human subjects with IRB approval

Real Hardware 0

Tested on physical BCI hardware or real EEG equipment

Tested Components

VAL-001 Pass

Neurowall Coherence Monitor

2026-02-15

11/14 attacks detected at 15s window, 9/9 at 20s. 50-run statistical validation.

Simulation Independent Validation
Details

Methodology

Simulated 14 distinct attack patterns against the coherence monitoring pipeline. Each attack tested with 50 independent runs to establish statistical significance. Detection thresholds calibrated against synthetic EEG baselines.

Results

  • 15-second window: 11/14 attack types detected (78.6%)
  • 20-second window: 9/9 tested attack types detected (100%)
  • 50-run stats: mean detection latency, false positive rate, confidence intervals computed
  • Zero false positives across all 50-run batches at 20s window

Limitations

  • All tests used synthetic EEG data, not real brain signals
  • Attack patterns are theoretical, not from actual adversaries
  • Detection window trade-off: faster detection = lower accuracy
VAL-002 Pass

BrainFlow Independent Validation

2026-02-15

100% detection rate, 0% false positive rate across 16 simulated channels.

Independent Validation Simulation
Details

Methodology

Independent validation using BrainFlow SDK to generate synthetic multi-channel EEG. Coherence analysis pipeline tested against known-good and known-bad signal patterns across 16 channels simultaneously.

Results

  • 16-channel simultaneous monitoring: all channels processed correctly
  • 100% detection rate for injected anomalies
  • 0% false positive rate on clean synthetic signals
  • BrainFlow SDK confirmed as viable real-hardware integration path

Limitations

  • BrainFlow synthetic board, not real EEG hardware
  • Single session duration, not long-term stability tested
  • 16 channels is below clinical-grade density (64-256 channels)
VAL-003 Pass

NSP Transport Pipeline

2026-02-10

Round-trip encryption/decryption PASS. 65-90% payload compression ratio.

Simulation
Details

Methodology

End-to-end simulation of the Neural Sensory Protocol transport layer. Test vectors include ML-KEM-768 key exchange, AES-256-GCM-SIV encryption, frame serialization, and payload compression benchmarks.

Results

  • Round-trip encrypt/decrypt: PASS (all test vectors)
  • 65-90% compression ratio depending on signal type
  • Frame format serialization/deserialization: PASS
  • Post-quantum key exchange simulation: PASS

Limitations

  • Software simulation only, not tested on implant-class hardware (ARM Cortex-M4)
  • Latency benchmarks are desktop-class, not embedded
  • No real BCI data streams tested
VAL-004 Pass

NISS Scoring Engine

2026-02-08

Escalation behavior correct across all 103 techniques. PINS flag triggers verified.

Simulation
Details

Methodology

All 103 TARA techniques scored through the NISS engine. Verified that severity levels escalate correctly, PINS flag triggers when BI >= High or RV = Irreversible, and context profiles shift scores as specified.

Results

  • 103/103 techniques scored without errors
  • PINS flag correctly triggered for all qualifying techniques
  • Severity thresholds (Critical/High/Medium/Low/None) verified
  • Context profiles (Clinical, Research, Consumer, Military) shift weights correctly

Limitations

  • Scoring correctness is self-referential (no external NISS implementation to compare against)
  • Clinical appropriateness of score magnitudes not validated by clinicians
  • Equal-weight default assumption untested against real BCI incident data
VAL-005 Pass

L1 Signal Boundary (Analog Front-End)

2026-02-12

Notch filters + impedance guard verified in simulation. Signal integrity PASS.

Simulation
Details

Methodology

Simulated the S1 (Analog) band boundary conditions: 50/60 Hz notch filtering, electrode impedance monitoring, and signal amplitude guards. Verified that out-of-band signals are rejected and impedance drift triggers alerts.

Results

  • Notch filters: 50/60 Hz rejection verified at -40dB
  • Impedance guard: drift detection triggers at configured threshold
  • Signal amplitude clipping: out-of-range values rejected
  • Baseline coherence maintained through filtering pipeline

Limitations

  • Simulated signals, not real electrode recordings
  • No tissue-electrode interface modeling
  • Single-channel validation only

Related TARA Techniques

VAL-006 Confirmed

BCI Streaming Protocol Vulnerability

2026-02-11

Real vulnerability found in a widely-used BCI data streaming protocol. Coordinated disclosure in progress.

Coordinated Disclosure
Details

Methodology

Protocol analysis of a widely-used open-source BCI streaming library revealed missing authentication, encryption, and integrity verification. Proof-of-concept developed and tested.

Results

  • Vulnerability confirmed in protocol design
  • PoC demonstrates unauthenticated stream injection
  • Coordinated disclosure initiated with maintainers
  • Details withheld pending vendor response

Limitations

  • PoC tested against software implementation, not clinical deployment
  • Impact assessment is theoretical for clinical BCI contexts
  • Awaiting vendor response for severity classification

Related TARA Techniques

VAL-007 Pass

Physics Security Guardrails

2026-02-18

12/13 physics constraints verified. 4-layer guardrail architecture derived from first principles.

Analytical Review Cross-AI Verification
Details

Methodology

Systematic derivation of security guardrails from physics equations (thermodynamics, electromagnetism, information theory). Each constraint cross-verified by multiple AI systems (Claude, Gemini). Architecture reviewed for internal consistency and completeness.

Results

  • 12/13 constraint equations verified as physically sound
  • 4-layer architecture: Physics Boundary, Signal Integrity, Anomaly Detection, Protocol Enforcement
  • 1 constraint (mechanical mismatch epsilon_safe) flagged as requiring empirical calibration
  • Cross-AI verification: Claude and Gemini independently confirmed constraint derivations
  • No published equivalent found (gap confirmed in literature)

Limitations

  • Analytical derivation, not empirical validation
  • Constraint parameters need calibration against real BCI hardware
  • Architecture is concept design, not implemented
  • Cross-AI verification does not substitute for peer review
VAL-008 Pass (with issues)

Fact-Checking Pipeline

2026-02-21

19/20 field journal posts passed automated fact-check. 1 dead URL found.

Simulation
Details

Methodology

Automated pipeline resolves DOIs, arXiv references, and hyperlinks. Searches Crossref for named citations. Flags unsourced numerical claims. Run against all 20 field journal blog posts.

Results

  • 19/20 posts passed (fact_checked: true)
  • 1 failure: Entry 011 dead URL (qinnovate.com/blog/hourglass-compute-hypothesis)
  • 59 warnings: unsourced numerical claims (expected for personal journal entries)
  • All DOIs and arXiv references resolved successfully

Limitations

  • Cannot verify claims that lack citations (by design, journals are personal)
  • Crossref search is fuzzy matching, may miss edge cases
  • Pipeline does not verify claim accuracy, only link/reference liveness
VAL-009 Pass

Citation Verification

2026-02-12

3 fabricated AI-hallucinated citations caught and removed from preprint.

Simulation
Details

Methodology

Manual and automated verification of all citations in the Zenodo preprint. Every DOI resolved via Crossref API. Author lists checked against publisher pages. Process triggered after Dr. Schroder flagged a fabricated citation publicly.

Results

  • 3 fabricated citations identified and removed
  • 3 wrong author lists corrected
  • All remaining citations verified via DOI resolution
  • Verification protocol now mandatory for all future publications

Limitations

  • Caught after publication (v1.0), not before
  • Manual process, not fully automated
  • Only covers DOI-resolvable references
Featured VAL-007

Physics Security Guardrails

BCI security guardrails derived from physics first principles. 12/13 constraint equations verified as physically sound. 4-layer architecture: Physics Boundary, Signal Integrity, Anomaly Detection, Protocol Enforcement. Independently verified by Claude and Gemini. To our knowledge, no published equivalent exists.

Analytical Review Cross-AI Verification
Read the full guardrails document

Not Yet Tested

These components require resources beyond what a solo researcher can provide. They are listed here for transparency.

Component Why Not Tested What's Needed
NISS Clinical Validation Requires clinician review of score magnitudes against real BCI incident data. No IRB access.
Clinical BCI expertsBCI incident databaseIRB approval
DSM-5-TR Diagnostic Mappings 103 technique-to-diagnosis mappings need clinical psychiatrist review. Analytical derivation only.
Clinical psychiatrist with BCI experienceCase study data
BCI Limits Equation Unified constraint system is a hypothesis. Individual equations are established physics, but the integration is novel and unvalidated.
BCI hardware labMulti-site measurementsPeer review
NSP on Real Hardware Protocol tested in software simulation only. Not deployed on ARM Cortex-M4 or any implant-class hardware.
ARM Cortex-M4 dev boardReal-time latency measurementPower profiling
Real EEG Validation All coherence monitoring tested against synthetic signals. No real EEG data from human subjects.
EEG equipment (clinical or consumer grade)IRB approval for human subjectsBaseline recording protocol
Real BCI Attack Testing All attack patterns are theoretical models. No adversarial testing against physical BCI devices.
BCI hardware (invasive or non-invasive)Controlled lab environmentIRB + security ethics approval