Sr. Software Engineer, Machine Learning & Data Infrastructure
Okx
San Jose
Who We Are
About the Opportunity
What You’ll Be Doing
- Improve model inference latency, throughput, resource utilization, and cost. Profile the prediction path—from feature retrieval and preprocessing to model execution—and implement measurable improvements while preserving model quality.
- Build and maintain infrastructure for model packaging, versioning, deployment, serving, monitoring, and rollback across cloud platforms and regions.
- Develop and optimize offline data pipelines using Databricks, Apache Spark, and warehouse or lakehouse technologies. Address data modeling, partitioning, joins, shuffles, skew, incremental processing, and cost.
- Work on offline and online feature pipelines, supporting point-in-time correctness, consistent feature definitions, freshness, lineage, and reproducible backfills.
- Build and maintain reliable feature services and data integrations for risk models and decision systems.
- Take ownership of projects and operational issues, communicate progress and tradeoffs, and collaborate with ML, data engineering, cloud infrastructure, security, and product teams.
- Contribute to technical discussions, share knowledge, and help teammates through code reviews and collaboration.
What We Look For In You
- Experience building and operating distributed systems, ML infrastructure, or data platforms, with ownership of meaningful production components.
- Hands-on experience improving production model performance, such as latency, throughput, resource utilization, or cost.
- Strong experience with Databricks and Spark, or comparable offline data platforms, including execution plans, distributed query optimization, storage layouts, data correctness, and workload cost management.
- Experience with the model lifecycle, including training and serving integration, validation, deployment, observability, and rollback.
- Strong Python and SQL skills, plus proficiency in at least one backend or systems language such as Java, Scala, Go, or C++.
- Ability to work independently through loosely defined problems, make sound implementation decisions, and deliver maintainable systems with limited guidance.
Nice to Haves
- SageMaker, Alibaba Cloud PAI/EAS, or comparable ML platforms.
- Inference optimization using tools such as ONNX Runtime, TensorRT, or Triton.
- Delta Lake, MLflow, feature stores, Kafka, Flink, and low-latency data stores.
- Fraud detection or financial risk systems.
- Fluency in Mandarin
Perks & Benefits
- Competitive total compensation package
- L&D programs for employees' growth and development
- Various team building programs and company events
- Wellness and meal allowances
- Comprehensive healthcare schemes for employees and dependants
- More that we love to tell you along the process!
Similar jobs
Sr. Staff Supply Chain Operations Planner
AdditionalinformationAdditional InformationThe expected annual pay range for this position is $160-190K. This position is also eligible f...
Director / Sr. Director Of Product Management – Data Center Silicon Infrastructure
AdditionalinformationAdditional InformationCompensation and Benefits$200,000–$250,000 base salary plus equity, bonus, and benefits.Axiado...
Sr./Staff Compliance Engineer
Antora Energy delivers affordable, reliable energy to industry, data centers, and the grid. Our thermal batteries turn low-cost electrici...
Sr. / Staff Software Engineer, Infrastructure (Autonomy)
About the CompanyDiDi's autonomous driving unit was established in 2016 with the mission of developing Level 4 autonomous driving (AD) te...
Sr. Software Engineer - Manufacturing Data & Test Infrastructure
Astera Labs (NASDAQ: ALAB) provides rack-scale AI infrastructure through purpose-built connectivity solutions. By collaborating with hype...
Sr. Product Quality Engineer - Powertrain
Headquartered in Silicon Valley, California, Archer is a leader in the next-gen aerospace sector building an end-to-end advanced air mobi...