AI / Systems Engineer

Emergences LabsProduct

Verified by NeoHuman

The assessment

Keep NeoHuman's exact-vs-inferred labels honest when a capture sensor fails mid-session — ship a runnable provenance-fallback engine with a proof harness.

No materials and no questions are shown until you start.

About 90 minutes

One sitting

+ more

Any AI agent

Bring your own

NeoHuman desktop app

Where it runs

AI Quotient + Competency

What you get

Start the assessment

We’ll email you the entry link for the desktop app. Your result goes to this employer and becomes your reusable Arena score.

Results publish under your pseudonym · your name reaches the employer only when you choose

Leaderboard — this assessment

No published takers yet. Be the first.

The role

AI / Systems Engineer

Senior, Remote-friendly, Remote

Role Overview

Own the reliability and quality of the NeoHuman desktop capture and trace-fusion pipeline—the technical core that turns candidate behavior into assessment evidence. Ship cross-platform (macOS/Windows) capture systems with strong ownership of fallback strategies and data integrity.

Responsibilities

Own end-to-end reliability of desktop capture across macOS and Windows: diagnose gaps (AX vs. OCR vs. keyboard triggers), design fallback strategies, implement fixes with strong semantics tracking (exact vs. inferred evidence).
Ship cross-platform systems: native Accessibility APIs (macOS AX, Windows UIA), vision-based fallbacks (OCR), input tracking, clipboard monitoring. Use AI assistants (Claude, Cursor) heavily during implementation.
Define and enforce evidence-quality standards: track what we capture with confidence vs. what we infer. Document gap semantics for every fallback path. Ensure candidates and hiring managers know what is exact evidence vs. model inference.
Operate as a reliability engineer on the critical path: monitor capture quality metrics (% exact evidence), triage production issues, own incident follow-up and blameless postmortems.
Mentor 1-2 mid-level engineers on the platform team; raise the bar on systems thinking and shipping under ambiguity.

Required Qualifications

5+ years shipping production systems in startups or high-growth companies; demonstrated ownership of a reliability-critical or platform component.
Deep hands-on experience with desktop / cross-platform systems: have shipped on macOS and Windows, comfortable with native APIs (Accessibility frameworks, Win32, CGEventTap).
Strong systems thinking: can reason about fallback strategies, data integrity, and edge cases. Design for graceful degradation when sensors fail.
Track record of shipping under ambiguity: comfortable with incomplete specifications, iterating with real production data, and making trade-offs without perfect information.
Excellent written communication; can document complex fallback decisions and defend semantics choices to non-technical stakeholders (hiring managers).

Preferred Qualifications

Experience with Electron, desktop app architecture, or cross-platform tooling.
Background in evaluation, assessment, or workforce intelligence—understand why capture evidence matters to hiring decisions.
Shipped systems that integrate multiple sensor modalities (video, accessibility events, OCR); comfortable with uncertainty and sensor fusion.
Experience mentoring junior engineers or leading on-call rotations; have grown someone's systems-thinking abilities.

Tech Stack

TypeScript / Node.js, Electron (desktop framework), macOS Accessibility APIs / AX, Windows UI Automation (UIA), Vision / OCR (Apple Vision, Win32 OCRA or similar), PostgreSQL / Supabase (trace storage), Next.js / React (web control surfaces)

Reports To

CTO and Cofounder