Discover your dream Career
For Recruiters

Senior Platform Engineer (AI Infra) / DevOps

Gravitas Recruitment Group Hong Kong
Posted 2 days ago Permanent Competitive

Senior Platform Engineer (AI Infra) / DevOps

Gravitas Recruitment Group Hong Kong
Senior Platform Engineer (AI Infrastructure)
Location: Hong Kong / Remote 

About the Role
We are building a highly secure, private AI ecosystem from the ground up. As a Senior AI Platform Engineer, you will design the foundation that allows our team to leverage AI safely and cost-effectively.

This role bridges the gap between classic cloud engineering and cutting-edge AI deployments. You will build a centralized secure gateway for all internal AI traffic and assist our infrastructure team in deploying and tuning open-source models on our own physical data center hardware (GPUs).

Core Requirements (Must-Haves)
  1. Production Container Orchestration: Deep, hands-on production experience with Kubernetes, Docker, and Linux environments. (Must have run this at scale, not just be "familiar" with it).
  2. Hardware or Local AI Exposure: Practical experience either running local LLM frameworks (like vLLM, TGI, or Triton) OR a rock-solid understanding of managing physical, on-premise servers and bare-metal data centers.
  3. Security & Access Mindset: A proven track record of caring about cost management, network security, access controls, and API throttling.
  4. 5+ Years in Infrastructure: Solid background as a Platform, DevOps, or Site Reliability Engineer managing live, production-grade environments.
  5. Programming & Pipelines: Strong scripting skills in Python alongside experience building automated deployment workflows (CI/CD via GitHub Actions, GitLab, etc.).

What You’ll Do
  1. Deploy Private AI: Work with our bare-metal infrastructure team to configure, optimize, and run large language models locally on our owned GPU hardware.
  2. Secure the Gateway: Build, scale, and maintain the central internal API gateway that handles, monitors, and audits all company AI traffic.
  3. Integrate Identity: Seamlessly connect our AI tools with corporate single sign-on (SSO) systems to automate access management.
  4. Manage Costs: Track usage metrics and implement strict guardrails to keep infrastructure spend optimized and highly efficient.
  5. Empower Teams: Create documentation and provide light internal guidance to help non-technical staff use these new tools productively.

Bonus Points If You Have (Nice-to-Haves):
  • Background working in highly regulated fields like Fintech, Banking, or Healthcare.
  • Experience deploying enterprise identity solutions (Okta, Azure AD / Entra ID, Keycloak)
Job ID  173582
More Jobs From Gravitas Recruitment Group
Gravitas Recruitment Group
AI Engineering
Gravitas Recruitment Group
Hong Kong
5 hours ago Full time Competitive
Gravitas Recruitment Group
Quantitative Developer (Product)
Gravitas Recruitment Group
Hong Kong
1 day ago Full time Competitive
Gravitas Recruitment Group
Java Developer eCommerce IT EQD Trading
Gravitas Recruitment Group
Hong Kong
5 hours ago Full time Competitive
Gravitas Recruitment Group
Python Trading Developer - Delta 1 x2
Gravitas Recruitment Group
Hong Kong
9 hours ago Full time Competitive
Gravitas Recruitment Group
Python Trading Developer - Delta One Trading
Gravitas Recruitment Group
Hong Kong
1 day ago Full time Competitive
Gravitas Recruitment Group
Project Manager - Global Markets Operations
Gravitas Recruitment Group
Hong Kong
1 day ago Full time Competitive
Gravitas Recruitment Group
Business Analyst
Gravitas Recruitment Group
Hong Kong
1 day ago Full time Competitive
Gravitas Recruitment Group
Project Manager
Gravitas Recruitment Group
Hong Kong
2 days ago Full time Competitive
Gravitas Recruitment Group
Senior Risk Engineer - Construction
Gravitas Recruitment Group
Hong Kong
2 days ago Full time Competitive
Gravitas Recruitment Group
Business Analyst - Operation
Gravitas Recruitment Group
Hong Kong
3 days ago Full time Competitive

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.
Recommended Jobs