About the role
You’ll direct AI agents to answer business questions about customer behavior, sales, and operations. Your primary responsibility is to design evaluations and validate the agents’ work. You’ll define the business question, give agents the metric definitions and operating context they need, and decide whether the evidence is reliable enough to act on.
What you'll do
- Translate decisions about acquisition, retention, segmentation, pricing, or store performance into clear agent instructions and acceptance criteria.
- Direct agents to write SQL and Python for queries, transformations, and statistical analysis. Review their logic and independently reproduce critical calculations when needed.
- Build and maintain evals with benchmark questions, known-good answers, edge cases, and explicit pass criteria. Run regression checks when data, metric definitions, or agent workflows change.
- Reconcile results against trusted sources and check joins, grain, time windows, denominators, and missing data. Flag unsupported causal claims and define when uncertain results need human review.
- Save validated analyses as workflows other analysts can rerun. Capture the metric definitions, business rules, and checks that agents should apply, and work with forward deployed engineers to deliver the results and supporting evidence in the tools teams already use.
What you bring
- A record of owning customer or commercial analysis from a business question through a decision, including setting the quality bar for the evidence.
- Strong SQL and Python skills to inspect, debug, and independently validate agent-generated work on large transactional or behavioral datasets.
- Depth in segmentation, cohort analysis, statistical modeling, and evaluation methods appropriate to customer behavior.
- Hands-on experience directing AI agents and designing repeatable evaluations for data accuracy, analytical reasoning, and evidence quality.
- The ability to recognize when a statistically sound analysis answers the wrong business question.
- Confidence communicating with senior stakeholders and challenging assumptions with evidence.
- An independent working style, with clear documentation, reproducible methods, and ownership through delivery.
- Experience with retail, restaurants, loyalty programs, or other consumer businesses.
- Experience moving analytical prototypes into recurring workflows with engineers.
- Experience with cloud data warehouses and interactive analytical applications.
- You work independently. You can take an unclear goal, decide what to do first, find what you need, and carry the work through to a result. You bring people in early when a decision, risk, or dependency needs their input.
How we work
AI agents are core to how we get work done. You'll spend a substantial part of your day running multiple agents in parallel, building tools and workflows with them, and checking what they produce. You own the result. Verify the facts, calculations, code, and claims before they go into a decision, a customer conversation, or a release.
When working with clients, take initiative within the agreed goals, scope, access permissions, and review process. Bring options and recommendations, and involve the right people before changing a customer commitment or production workflow.
What success looks like
- Stakeholders understand the customer behavior that matters to their decision and the limits of the evidence.
- Another analyst can reproduce key results and run your evals to catch regressions before insights reach users.
- Recurring questions are handled through reusable workflows and apps.
- Agent outputs meet agreed quality thresholds, and failures can be traced to their source and routed for review.
Compensation
Annual base salary is $150,000 to $185,000 USD.
Benefits
Eligible employees can enroll in medical, dental, and vision coverage.
About Enlighten
At Enlighten, we believe AI should expand what people can take on. We build teams of AI agents alongside Fortune 500 companies so they can put their best thinking to work across the business. We want the people closest to the work to be able to ask hard questions and get answers they can trust. Our mission is to give every team the intelligence it needs to make decisions that shape the business.