Validation Status
Transparency about what has been tested, how it was tested, and what remains untested. This project is solo research. Honest reporting of validation boundaries is more valuable than overstating results.
Data Source Disclaimer
All EEG-based tests were conducted using synthetic EEG signals generated by BrainFlow's Synthetic Board. No real human EEG data and no human subjects were involved.
- BrainFlow API: BrainFlow provides a uniform API to acquire raw EEG, EMG, and ECG data streams from supported biosensing hardware (OpenBCI, ANT Neuro, and others). Our tests used BrainFlow's Synthetic Board, which generates artificial signals mimicking real EEG characteristics.
- Data Format: Data is provided as a 2D NumPy array containing EEG channels, accelerometer, and timestamps, enabling detailed real-time analysis.
- Synthetic Data for Development: When real hardware is unavailable, BrainFlow includes a Synthetic Board and playback board that generate artificial signals mimicking real data. These emulators are intended for software development and testing, not clinical use.
Validation Tiers
Tested against synthetic data or simulated environments
Verified by independent code, separate implementation, or third-party tool
Vulnerability confirmed through responsible disclosure process
Systematic review of constraints, equations, or logic by structured analysis
Independently verified by multiple AI systems (Claude, Gemini, GPT)
Tested on real human subjects with IRB approval
Tested on physical BCI hardware or real EEG equipment
Tested Components
Neurowall Coherence Monitor
11/14 attacks detected at 15s window, 9/9 at 20s. 50-run statistical validation.
Details
Methodology
Simulated 14 distinct attack patterns against the coherence monitoring pipeline. Each attack tested with 50 independent runs to establish statistical significance. Detection thresholds calibrated against synthetic EEG baselines.
Results
- 15-second window: 11/14 attack types detected (78.6%)
- 20-second window: 9/9 tested attack types detected (100%)
- 50-run stats: mean detection latency, false positive rate, confidence intervals computed
- Zero false positives across all 50-run batches at 20s window
Limitations
- All tests used synthetic EEG data, not real brain signals
- Attack patterns are theoretical, not from actual adversaries
- Detection window trade-off: faster detection = lower accuracy
BrainFlow Independent Validation
100% detection rate, 0% false positive rate across 16 simulated channels.
Details
Methodology
Independent validation using BrainFlow SDK to generate synthetic multi-channel EEG. Coherence analysis pipeline tested against known-good and known-bad signal patterns across 16 channels simultaneously.
Results
- 16-channel simultaneous monitoring: all channels processed correctly
- 100% detection rate for injected anomalies
- 0% false positive rate on clean synthetic signals
- BrainFlow SDK confirmed as viable real-hardware integration path
Limitations
- BrainFlow synthetic board, not real EEG hardware
- Single session duration, not long-term stability tested
- 16 channels is below clinical-grade density (64-256 channels)
NSP Transport Pipeline
Round-trip encryption/decryption PASS. 65-90% payload compression ratio.
Details
Methodology
End-to-end simulation of the Neural Sensory Protocol transport layer. Test vectors include ML-KEM-768 key exchange, AES-256-GCM-SIV encryption, frame serialization, and payload compression benchmarks.
Results
- Round-trip encrypt/decrypt: PASS (all test vectors)
- 65-90% compression ratio depending on signal type
- Frame format serialization/deserialization: PASS
- Post-quantum key exchange simulation: PASS
Limitations
- Software simulation only, not tested on implant-class hardware (ARM Cortex-M4)
- Latency benchmarks are desktop-class, not embedded
- No real BCI data streams tested
NISS Scoring Engine
Escalation behavior correct across all 103 techniques. PINS flag triggers verified.
Details
Methodology
All 103 TARA techniques scored through the NISS engine. Verified that severity levels escalate correctly, PINS flag triggers when BI >= High or RV = Irreversible, and context profiles shift scores as specified.
Results
- 103/103 techniques scored without errors
- PINS flag correctly triggered for all qualifying techniques
- Severity thresholds (Critical/High/Medium/Low/None) verified
- Context profiles (Clinical, Research, Consumer, Military) shift weights correctly
Limitations
- Scoring correctness is self-referential (no external NISS implementation to compare against)
- Clinical appropriateness of score magnitudes not validated by clinicians
- Equal-weight default assumption untested against real BCI incident data
L1 Signal Boundary (Analog Front-End)
Notch filters + impedance guard verified in simulation. Signal integrity PASS.
Details
Methodology
Simulated the S1 (Analog) band boundary conditions: 50/60 Hz notch filtering, electrode impedance monitoring, and signal amplitude guards. Verified that out-of-band signals are rejected and impedance drift triggers alerts.
Results
- Notch filters: 50/60 Hz rejection verified at -40dB
- Impedance guard: drift detection triggers at configured threshold
- Signal amplitude clipping: out-of-range values rejected
- Baseline coherence maintained through filtering pipeline
Limitations
- Simulated signals, not real electrode recordings
- No tissue-electrode interface modeling
- Single-channel validation only
BCI Streaming Protocol Vulnerability
Real vulnerability found in a widely-used BCI data streaming protocol. Coordinated disclosure in progress.
Details
Methodology
Protocol analysis of a widely-used open-source BCI streaming library revealed missing authentication, encryption, and integrity verification. Proof-of-concept developed and tested.
Results
- Vulnerability confirmed in protocol design
- PoC demonstrates unauthenticated stream injection
- Coordinated disclosure initiated with maintainers
- Details withheld pending vendor response
Limitations
- PoC tested against software implementation, not clinical deployment
- Impact assessment is theoretical for clinical BCI contexts
- Awaiting vendor response for severity classification
Related TARA Techniques
Physics Security Guardrails
12/13 physics constraints verified. 4-layer guardrail architecture derived from first principles.
Details
Methodology
Systematic derivation of security guardrails from physics equations (thermodynamics, electromagnetism, information theory). Each constraint cross-verified by multiple AI systems (Claude, Gemini). Architecture reviewed for internal consistency and completeness.
Results
- 12/13 constraint equations verified as physically sound
- 4-layer architecture: Physics Boundary, Signal Integrity, Anomaly Detection, Protocol Enforcement
- 1 constraint (mechanical mismatch epsilon_safe) flagged as requiring empirical calibration
- Cross-AI verification: Claude and Gemini independently confirmed constraint derivations
- No published equivalent found (gap confirmed in literature)
Limitations
- Analytical derivation, not empirical validation
- Constraint parameters need calibration against real BCI hardware
- Architecture is concept design, not implemented
- Cross-AI verification does not substitute for peer review
Fact-Checking Pipeline
19/20 field journal posts passed automated fact-check. 1 dead URL found.
Details
Methodology
Automated pipeline resolves DOIs, arXiv references, and hyperlinks. Searches Crossref for named citations. Flags unsourced numerical claims. Run against all 20 field journal blog posts.
Results
- 19/20 posts passed (fact_checked: true)
- 1 failure: Entry 011 dead URL (qinnovate.com/blog/hourglass-compute-hypothesis)
- 59 warnings: unsourced numerical claims (expected for personal journal entries)
- All DOIs and arXiv references resolved successfully
Limitations
- Cannot verify claims that lack citations (by design, journals are personal)
- Crossref search is fuzzy matching, may miss edge cases
- Pipeline does not verify claim accuracy, only link/reference liveness
Citation Verification
3 fabricated AI-hallucinated citations caught and removed from preprint.
Details
Methodology
Manual and automated verification of all citations in the Zenodo preprint. Every DOI resolved via Crossref API. Author lists checked against publisher pages. Process triggered after Dr. Schroder flagged a fabricated citation publicly.
Results
- 3 fabricated citations identified and removed
- 3 wrong author lists corrected
- All remaining citations verified via DOI resolution
- Verification protocol now mandatory for all future publications
Limitations
- Caught after publication (v1.0), not before
- Manual process, not fully automated
- Only covers DOI-resolvable references
Physics Security Guardrails
BCI security guardrails derived from physics first principles. 12/13 constraint equations verified as physically sound. 4-layer architecture: Physics Boundary, Signal Integrity, Anomaly Detection, Protocol Enforcement. Independently verified by Claude and Gemini. To our knowledge, no published equivalent exists.
Not Yet Tested
These components require resources beyond what a solo researcher can provide. They are listed here for transparency.
| Component | Why Not Tested | What's Needed |
|---|---|---|
| NISS Clinical Validation | Requires clinician review of score magnitudes against real BCI incident data. No IRB access. | Clinical BCI expertsBCI incident databaseIRB approval |
| DSM-5-TR Diagnostic Mappings | 103 technique-to-diagnosis mappings need clinical psychiatrist review. Analytical derivation only. | Clinical psychiatrist with BCI experienceCase study data |
| BCI Limits Equation | Unified constraint system is a hypothesis. Individual equations are established physics, but the integration is novel and unvalidated. | BCI hardware labMulti-site measurementsPeer review |
| NSP on Real Hardware | Protocol tested in software simulation only. Not deployed on ARM Cortex-M4 or any implant-class hardware. | ARM Cortex-M4 dev boardReal-time latency measurementPower profiling |
| Real EEG Validation | All coherence monitoring tested against synthetic signals. No real EEG data from human subjects. | EEG equipment (clinical or consumer grade)IRB approval for human subjectsBaseline recording protocol |
| Real BCI Attack Testing | All attack patterns are theoretical models. No adversarial testing against physical BCI devices. | BCI hardware (invasive or non-invasive)Controlled lab environmentIRB + security ethics approval |