About NovifyAI
NovifyAI builds focused AI products that turn complex technology into clear, useful tools. We work across models, infrastructure, and product experiences with a strong bias toward quality, ownership, and real outcomes.
About the role
You will own the data infrastructure behind NovifyAI's next generation of foundational models: large-scale curation and filtering pipelines, the systems that determine what enters a training run, and the tools that make every data decision traceable.
This is engineering- and research-heavy work spanning deduplication, quality models, contamination detection, mixture design, curriculum, attribution, and debugging.
What you'll do
- Design large-scale pipelines for ingestion, parsing, normalisation, filtering, deduplication, tokenisation, and packing.
- Develop quality filtering systems, model-based classifiers, and contamination detection.
- Own data mixture, curriculum, and annealing strategies with the research team.
- Build tools for researchers to analyse, slice, attribute, and debug training data.
- Scale multilingual, code, maths, web, and licensed datasets with provenance tracked end to end.
- Partner with training-infrastructure engineers so data is never the bottleneck for a production run.
What we're looking for
- A strong computer-science or systems foundation, demonstrated through study or equivalent work.
- 3+ years building large distributed data systems; exceptional early-career systems candidates will also be considered.
- Hands-on experience curating and filtering data for model training.
- Deep familiarity with distributed processing tools such as Spark, Ray, Beam, or Dask.
- Strong Python and comfort with tokenisation, sharding, packing, IO, and performance tradeoffs.
- Meaningful work in data tooling, open datasets, deduplication, or filtering systems.
Bonus points
- Experience with large open pre-training corpora or multilingual data.
- Work on quality classifiers, contamination detection, data attribution, or tokenisation research.
- Published technical work or substantive open-source contributions in model-data systems.
Why NovifyAI?
Join a small, ambitious team working across AI research, engineering, design, and go-to-market. You will have meaningful ownership from day one, work closely with people who care about their craft, and help shape products that are built to be used—not simply demonstrated.
We care more about your ability to own the outcomes described here than matching every line. If the work excites you and you believe you can do it well, we want to hear from you.