Online Learning Scientist
Also called Adaptive ML Scientist
An Online Learning Scientist builds models that keep learning from arriving data under explicit feedback rules. It matters because products that stand still decay as users, markets and data sources change.
What they do
Designs and runs learners that update from a stream of observations, rather than from a fixed training set. Decides what feedback counts, how fast the model should move, and what it must never forget. Builds replay setups so changes can be tested on past data before they touch production. Sets up drift tests and alerts. Works with engineers on the data path, and with privacy colleagues where data stays with its owner. Writes down the update rules so others can audit them. Reviews failures, such as a model that chases noise or freezes too early, and fixes the cause.
What a strong hire delivers
Within the first months, a working online learner on one live problem, with the feedback rules written down and agreed. A replay evaluation that the team trusts and reruns. Drift tests with clear thresholds and a named response. A short report on regret, stability and how quickly the model recovers after a shift, so decisions about further investment rest on evidence.
How you can tell they are good
Ask them to walk through a learner they updated from live data and what went wrong. Strong people explain the feedback rule, the stability trade-off and how they tested offline before release. They can say how they would know the model was drifting. Be wary of anyone who talks only about retraining on a schedule or quotes offline accuracy alone.
Why it is hard to fill
The title is rarely used, so searches on it miss most of the people. The skills sit across research, optimisation and privacy engineering, and few have run a learner in production. Many strong candidates are known as continual learning researchers, bandit specialists or federated learning engineers. Candidates who can show both the theory and a live system are scarce, and they are often not looking.
Where to find them
Look at ML researchers with a sequential or streaming focus, distributed optimisation specialists, and privacy engineers who have worked on federated setups. Recommendation, ads, fraud and personalisation teams often hold people who have run live learners. Research groups at universities and frontier labs also produce them. Adjacent titles include applied scientist, bandit researcher and ML platform engineer.
Indicative pay
Not enough published evidence yet to give a fair range for this role, which is common for work this new. We benchmark it for you as part of a search.
Interview questions for an Online Learning Scientist
- Describe a model you updated from arriving data. What were the feedback rules and why?
Strong answers name the signal, its delay and its bias, and explain why the update rule suited it. They show awareness of feedback loops. Worry if feedback is treated as clean ground truth or the rules were never written down.
- How would you tell drift in the data from a fault in the pipeline?
Good answers check upstream data, schema and volume before blaming the world. They mention statistical drift tests, comparison against reference windows and a staged response. Worry if the answer is simply to retrain.
4 more questions, with what a strong answer covers, are in the Role Kit.
Job description you can post
We build products that learn from live data as it arrives. We need an Online Learning Scientist to design learners that adapt under clear feedback rules, and to prove they stay stable as conditions change. You will work with engineers, researchers and privacy colleagues.
What you will do
- Design and ship online learners that update from streaming observations
- Define and document feedback rules and update policies
- Build replay and production evaluations for regret, stability and drift response
- Set up drift tests, thresholds and response plans
- Investigate and fix failures in live learning systems
- Work with engineers on data paths and with privacy colleagues on distributed ownership
What you will bring
- Demonstrated work on streaming, online or continual learning systems
- Experience evaluating models on time-ordered data
- Working knowledge of distributed systems and optimisation
- Clear thinking about uncertainty and how to quantify it
- Ability to explain trade-offs to non-specialists
- Evidence of a learner that ran in production or a realistic replay
Nice to have
- Experience with federated learning frameworks
- Privacy engineering background
- Published or shared work on sequential benchmarks
Free to use and adapt. If it saves you time, a link back to this page is appreciated.
Skills that matter
- Continual learningAdvancedAdapt models while measuring retention and drift
- Privacy engineeringAdvancedLimit disclosure and unauthorised personal-data use
- Distributed systemsWorkingDesign reliable work across networked machines
- Uncertainty quantificationWorkingEstimate confidence, calibration and model uncertainty
Other roles in continual, adaptive and federated learning
Related roles in other families
How we wrote this
Role definitions are our own editorial work, checked against occupational classifications, standards, research and employer pages. Titles vary by company, and this is a description of the work, not a job advert.
- Computer and Information Research Scientists, 15-1221.00, O*NET / US Department of Labor
- Generative Artificial Intelligence Profile, NIST AI 600-1, NIST
- User Guide, scikit-learn contributors
← Continual, adaptive and federated learningAll new job families
Start a search
Hiring an Online Learning Scientist?
Tell us the work. We find the people already doing it, whatever their job title says, and you meet them already interviewed for your role.
Role Kit
Online Learning Scientist: the Role Kit
- What the role is and what a strong hire delivers
- Every interview question, with what a strong answer covers
- A ready-to-post job description
- Where to find the people, and the other titles they use
We email you a copy too. You are only added to Insights if you tick the box.
It is downloading now.
A copy is on its way to your inbox. If you are hiring for this, we would be glad to help.
Meet Beth
Tell Beth who you're hiring. She'll show you how we'd approach it.
Beth knows how we work inside out and keeps up with your market as it moves: who's raising, who's hiring, what roles pay. Ask her anything, right here. In a few minutes you'll know how we'd go about your hire, and you'll have a time in the diary to start it.
Hi, I'm Beth. Hiring an Online Learning Scientist? Tell me what you need them to do and I'll show you how we'd find the people already doing it.
- Answers day or night
- Knows your market this week
- No fee unless you hire
- Books your call there and then
- Type or talk, your choice