People Scientist: AI-Psychometrics

Job summary
Permanent contract
Paris, London
A few days at home
Salary: Not specified
Starting date: January 01, 2026
Experience: > 2 years
Education: Master's Degree
Skills & expertise
Innovation
Diagnostic skills
Collaboration and teamwork
Bert
Basic
+4

MakiPeople
MakiPeople

Interested in this job?

Questions and answers about the job

The position

Job description

The People Scientist works at the intersection of psychometrics, AI, and research, ensuring that Maki’s automated scoring systems are scientifically robust, fair, and continuously improving.

1. Selection & Evaluation of AI & Psychometric Models

  • Assess the statistical accuracy and reliability of LLMs used for automated scoring (e.g., structured grid methods; job-specific skills; multi-lingual proficiency tests - written and spoken).

  • Compare and validate STT/TTS models and assess their downstream impact on candidate scores.

  • Continuously identify and evaluate emerging LLM, STT, and TTS models to optimise scoring precision and efficiency.

  • Evaluate and calibrate psychometric models (e.g., CTT, IRT, CFA) to ensure the scientific validity and comparability of AI-scored assessments across populations and test forms.

2. Human-AI Comparison & Hybrid Evaluation Models

  • Design research comparing AI-scored assessments with expert human judgments to ensure validity and alignment.

  • Benchmark semantic and embedding models (e.g., BERT, GPT-4, MPNet, DeepSeek) for diverse assessment types.

  • Develop hybrid scoring pipelines combining human oversight and AI-driven analytics.

3. Bias & Fairness Analysis

  • Detect and analyse potential biases in AI-generated or psychometric scores across demographic groups.

  • Apply fairness and bias-mitigation techniques (e.g., reweighting, calibration, subgroup analysis) while maintaining model performance integrity.

  • Contribute to internal fairness dashboards and compliance documentation, supporting transparent model governance.

  • Continuously evaluate model generalisability and fairness to ensure all predictive algorithms adhere to ethical and scientific standards.

4. Predictive Analytics & Performance Insights

  • Work with large-scale assessment and performance datasets to model relationships between candidate scores, job performance, and retention outcomes.

  • Develop and test predictive models that estimate success probabilities or identify key behavioural and linguistic predictors of performance.

  • Collaborate with data science, implementation and customer success teams to translate insights into actionable recommendations for clients and internal stakeholders.

5. Ongoing Model Monitoring & Issue Resolution

  • Investigate anomalies raised by clients or internal QA.

  • Conduct diagnostic analyses and recommend evidence-based improvements.

6. Technical Research Combining AI & Psychometrics

  • Explore fine-tuning, prompt-engineering, and evaluation methods to enhance model performance.

  • Translate technical findings into actionable insights for non-technical stakeholders.

  • Prepare and disseminate research through internal reports, publications, or conferences.


Eventually as one of the early employee of MakiPeople, you’ll be be able to shape the future of the team. We share as much ownership on the way we work and on the product itself as we can as we’re convinced our success is 99% due to our team.


Preferred experience

🧞 Our ideal candidate

  • Advanced degree (PhD/MSc) in Data Science, Machine Learning, Psychometrics, Computational Linguistics, or Psychology.

  • Proven expertise in AI model evaluation, psychometric validation, and statistical analysis.

  • Basic knowledge of psychometric modelling (e.g., IRT, CFA, CAT) and its application in assessment design and validation.

  • Familiarity with LLMs and NLP techniques used for automated assessment and scoring.

  • Experience applying fairness and bias testing methodologies in AI-driven decisions.

  • Skilled in validation research ensuring reliability, construct validity, and practical relevance of assessments.

  • Proficiency in Python or R and experience with statistical software (e.g., SPSS, Mplus, JASP) and cloud databases (e.g., BigQuery).

  • Strong grounding in ethical AI, data governance, and compliance.

  • Experienced in collaborating across teams (engineering, product, content) and communicating insights clearly to both scientific and business audiences.

  • Skilled in data visualisation and research writing, with a track record of publications or applied studies.

A note on diversity @MakiPeople

Don’t meet every single requirement? Studies have shown that women and people of colour are less likely to apply to jobs unless they meet every single qualification. We are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.

🌱  Your progression with us


  • Make a Real Impact: As part of our small, dynamic team, your contributions will have a direct and visible impact on the company’s success. Your work truly matters here.

  • Unlock Career Growth: With plenty of learning and development opportunities, this is your chance to grow your career in autonomy, problem-solving, process design, innovation, and client management.

  • Ambitious Futures Welcome: We value ambition and are excited to support your journey toward more senior roles as you grow and as new opportunities emerge within the company.

  • Shape Your Path: We are committed to supporting your career evolution, offering flexible “transversal” mobility opportunities tailored to your aspirations and goals within the organisation.

💝 Your benefits


  • 🤩 A competitive salary and generous equity packages

  • 📍  A complete flexible working policy (hybrid)

  • 🍽️ A lunch card with a dedicated monthly budget

  • 👨‍👩‍👧‍👧 Team socials (weekly lunch & drinks, quarterly MakiDays)

  • 🏠  WeWork offices located in Paris or London.

  • ⛑️  A delightful healthcare insurance, with 100% of the contribution covered for you

  • 👪  A supportive working environment

✨ Join us at MakiPeople


Our vision 🔭

Give human resources more-than-human powers.

Our mission 🎯

Build the conversational AI agent that liberates HR teams, advances organisations, and expands human potential.

Our values 🎨

We are still very young and our culture is evolving as we grow together. Nonetheless, below are values we identify ourselves with:

  • Play to Win - Our ambition is limitless. We relentlessly aim for the top, pushing forward to be number one.

  • Push the Boundaries - Innovation drives us. We adapt, evolve, and set new standards to redefine whatʼs possible.

  • Trust is Earned - Trust is our foundation. We hold ourselves to the highest standards of transparency, security, and responsibility.

  • Embrace Intensity - Speed and precision define our approach. We execute with urgency, focus, and purpose to create immediate, tangible impact.

  • Stronger together - We succeed as one. Collaboration, shared purpose, and collective ownership are at the heart of our progress.


Recruitment process

We want to offer the best candidate experience possible by letting everyone apply, ensuring that the process lasts ~3 weeks from the moment you get invited to the first step.

  • Step 1: A short assessment on Maki (~25mins) 📂

    This is the occasion for you to discover our product more in-depth and to demonstrate your fit, skills & motivation (~25mins)

  • Step 2: A call with your hiring manager (~1 hour) 🤝🏼

    If we believe you may be a good match, we’ll arrange a first call with your hiring manager to cover the basis: your experience, your vision of the role and your interest in joining us.

  • Step 3: A deeper exploration of who you are with our co-founders (45mins) 👀

    We’ll then arrange a call with Paul-Louis, our COO and one other co-founder.

    Those structured conversations aim at covering skills we have not covered in the assessment as well as your fit to our values & vision. At any point, you’ll have the opportunity to ask all your questions, including the tough ones.

  • Step 4: Informal meetup with your future team

    We’d also like for you to be able to meet your future colleagues! These meetings (online or in real life if and when possible) will be a chance for you to familiarise yourself with the team, our way of working, and again, to ask any questions you may have!

  • Step 5: Your offer 💌

    If we have a match, we will send you an offer asap.

  • Step 6: Your onboarding 🧑‍🚀

    We will help you through the contract details and make sure you have everything to make an impact. Come and celebrate your offer with the team 🤟

Want to know more?

These job openings might interest you!

These companies are also recruiting for the position of “Data / Business Intelligence”.

  • Doctolib

    Senior ML Ops Engineer (x/f/m)

    Doctolib
    Doctolib
    Permanent contract
    Paris
    A few days at home
    Mobile Apps, Software
    2,800 employees

  • EFFICIENT IP

    Data Scientist

    EFFICIENT IP
    EFFICIENT IP
    Permanent contract
    La Garenne-Colombes
    Occasional remote
    Software, SaaS / Cloud Services
    280 employees

  • Lenstra

    Senior Analytics Engineer

    Lenstra
    Lenstra
    Permanent contract
    Paris
    Occasional remote
    Software, Artificial Intelligence / Machine Learning
    30 employees

  • Alice & Bob

    Quantum HPC – Applications & FTQC Specialist

    Alice & Bob
    Alice & Bob
    Permanent contract
    Paris
    A few days at home
    Software, Electronics / Telecommunications
    140 employees

  • SkillCorner

    Director of AI – Predictions

    SkillCorner
    SkillCorner
    Permanent contract
    Paris
    A few days at home
    Software, Artificial Intelligence / Machine Learning
    100 employees

  • Million Victories

    Senior Data Scientist W/M/D

    Million Victories
    Million Victories
    Permanent contract
    Paris, Lyon
    Fully-remote
    Salary: €50K+
    Mobile Apps, Software
    35 employees

See all job openings