HPC/AI Infrastructure Architect

Job summary
Permanent contract
London
A few days at home
Salary: Not specified
Skills & expertise
Red hat
Kubernetes
Fabric
Docker
OpenShift
Apply

NTT DATA
NTT DATA

Interested in this job?

Apply
Questions and answers about the job

The position

Job description

Make an impact with NTT DATA
Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

Your day at NTT DATA

We are seeking a highly skilled and visionary HPC/AI Infrastructure Architect – Pre-Sales Specialist to lead the technical design and architecture of large-scale AI infrastructure solutions. This role is pivotal in shaping next-generation AI Factories, supporting customer engagements, and driving technical excellence across compute, interconnect, and software stack domains.

Key Responsibilities

1. AI Factory Architecture & Design (35%)

  • Design GPU cluster architectures tailored for AI and HPC workloads.
  • Define node configurations for diverse workload types including dense GPU nodes, cost-optimized nodes, and high-memory CPU nodes.
  • Specify and validate performance metrics including compute throughput, memory bandwidth, and power consumption.
  • Architect multi-tier interconnect networks using NVLink, InfiniBand, and high-speed Ethernet.
  • Develop topology designs and calculate bandwidth and latency targets.
  • Model performance for customer workloads and validate against industry benchmarks.

2. Pre-Sales Technical Leadership (30%)

  • Lead technical discussions with customer architects and stakeholders.
  • Conduct workload sizing and architectural presentations.
  • Develop technical content for proposals including BoMs, compliance matrices, and scoring alignment.
  • Analyze competitor solutions and articulate technical differentiators.

3. Demonstrator Lab Development (20%)

  • Design and expand lab infrastructure for AI workload testing and validation.
  • Build reference architectures across industries such as finance, manufacturing, healthcare, and research.
  • Support lab operations including cluster configuration, workload orchestration, and software stack maintenance.

4. Customer Demonstrations & PoCs (10%)

  • Deploy and showcase customer-specific AI workloads including LLM training, computer vision, and scientific simulations.
  • Manage proof-of-concept projects, define success criteria, and present outcomes to stakeholders.

5. Technical Expertise & Innovation (5%)

  • Maintain relationships with key technology vendors and participate in early access programs.
  • Evaluate emerging technologies and contribute to innovation roadmaps and adoption strategies.

Required Skills & Experience

Technical Competencies

  • GPU Architectures: NVIDIA (H100, H200, B100, B200), AMD (MI300X), Intel (Gaudi2/3)
  • Interconnects: InfiniBand (HDR/NDR/XDR), NVLink, RoCE, Infinity Fabric
  • Storage Systems:Lustre, GPFS, BeeGFS, NVMe-oF, S3-compatible object storage
  • Container Platforms: Kubernetes, Docker, Singularity/Apptainer
  • Performance Tools: NVIDIA Nsight, ROCm, Intel VTune

Certifications (Preferred)

  • NVIDIA Deep Learning Institute (DLI)
  • Red Hat Certified Specialist in OpenShift
  • InfiniBand Certified Professional

Experience

  • 8+ years in HPC/AI infrastructure design
  • 5+ years working with GPU-accelerated systems
  • Proven experience with large-scale GPU deployments (1000+ GPUs)
  • Successful track record in technical bid support and customer engagement

What We Offer

  • Opportunity to work on cutting-edge AI infrastructure projects
  • Collaborative and innovative work environment
  • Access to advanced lab infrastructure and vendor technologies
  • Career development through technical leadership and innovation

Workplace type:

Remote Working

About NTT DATA
NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.

Equal Opportunity Employer
NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

Third parties fraudulently posing as NTT DATA recruiters

NTT DATA recruiters will never ask job seekers or candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties who may attempt to impersonate NTT DATA recruiters—whether in writing or by phone—in order to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will come from an @nttdata.com email address. If you suspect any fraudulent activity, please contact us.

Want to know more?

These job openings might interest you!

These companies are also recruiting for the position of “Data / Business Intelligence”.

  • NTT DATA

    Data Architect

    NTT DATA
    NTT DATA
    Permanent contract
    London
    A few days at home
    IT / Digital, SaaS / Cloud Services
    190,000 employees

  • MARGO

    Algo KDB Developer - Fixed Income

    MARGO
    MARGO
    Permanent contract
    London
    A few days at home
    Software, IT / Digital
    350 employees

Apply