Skip to main content

Machine Learning Engineer - Distributed ML Systems

Expired
This role has expired and is no longer accepting applications. Browse similar roles →
Pluralis Research
Melbourne, VIC
hybrid
Full Time / Permanent

Apply for this job

Posted 3 months ago
This role is expired

These roles are hiring now

View all similar roles →

Senior AI Enablement Engineer

VicRoads
Melbourne, VIC
hybrid
  • Build scalable AI solutions with LLMs, RAG, Agentic AI and cloud platforms
  • 6+ years software engineering in Agile and DevOps environments
  • Python, TypeScript, AWS Bedrock, Azure OpenAI, CI/CD, cloud-native
Posted 3d ago

Senior AI Engineer

ROLLER
Melbourne, VIC
hybrid
  • Design AI-driven applications & backend systems with Python & LLM frameworks
  • Strong proficiency in Python, hands-on AI agents/LLM workflows experience
  • LangChain/LangGraph, GCP, RAG, vector databases, LLM APIs
Posted 5d ago

AI Engineer (Senior)

AMP
Melbourne, VIC
hybrid
  • Design and deliver enterprise-grade AI solutions across North platform
  • Deep experience delivering AI/ML solutions in enterprise environments
  • Python, AWS/Azure/Databricks, GenAI, NLP, RAG, Agentic AI
Posted 17d ago

Senior AI Engineer

RACV
Melbourne, VIC
hybrid
  • Lead AI solution design, delivery & operation on Azure platform
  • 5+ years software engineering, 3+ years AI engineering experience
  • TypeScript, Python, LLMs, RAG, agentic AI, Azure cloud
Posted 17d ago

Overview

Pluralis Research carries out foundational research on Protocol Learning: multi-participant training of foundation models where no single participant has, or can ever obtain, a full copy of the model. The purpose of Protocol Learning is to facilitate the creation of community-trained and community-owned frontier models with self-sustaining economics.

We're looking for Senior/Staff engineers with 5+ years of experience in distributed systems and ML large-scale training. You'll be implementing a novel substrate for training distributed ML models that work under consumer grade internet connection.

Responsibilities

Distributed Training Architecture & Optimization

  • Design and implement large-scale distributed training systems optimized for heterogeneous hardware operating under low-bandwidth, high-latency conditions.

  • Develop and optimize model-parallel training strategies (data, tensor, pipeline parallelism) with custom sharding techniques that minimize communication overhead.

  • Optimize GPU utilization, memory efficiency, and compute performance across distributed nodes.

  • Implement robust checkpointing, state synchronization, and recovery mechanisms for long-running, fault-prone training jobs.

  • Build monitoring and metrics systems to track training progress, model quality, and system bottlenecks.

Decentralized Networking & Resilience

  • Architect resilient training systems where nodes can fail, networks can partition, and participants can dynamically join or leave.

  • Design and optimize peer-to-peer topologies for decentralized coordination across non-co-located nodes.

  • Implement NAT traversal, peer discovery, dynamic routing, and connection lifecycle management.

  • Profile and optimize communication patterns to reduce latency and bandwidth overhead in multi-participant environments.

What You'll Bring

  • Strong experience building and operating distributed systems in production.

  • Hands-on expertise with distributed training frameworks (FSDP, DeepSpeed, Megatron, or similar).

  • Deep understanding of model parallelism (data, tensor, pipeline parallelism).

  • Expert-level Python with production experience (concurrency, error handling, retry logic, clean architecture).

  • Strong networking fundamentals: P2P systems, gRPC, routing, NAT traversal, distributed coordination.

  • Experience optimizing GPU workloads, memory management, and large-scale compute efficiency.

What We Offer

  • Competitive Compensation Package: High base salary and options packages for our core technical team members. Everyone should be rewarded now, and in the future for their hard work.

  • Visa sponsorship available for exceptional candidates

  • Remote-first with optional access to our Melbourne hub

  • World-class team — team mates were previously at at Google, Amazon, Microsoft, and leading startups

Backed by Union Square Ventures and other tier-1 investors, we're a world-class, deeply technical team of ML researchers and engineers. Pluralis is unapologetically ideological. We view the world as a better place if we are able to implement what we are attempting, and Protocol Learning as the only plausible approach to preventing a handful of massive corporations monopolising model development, access and release, and achieving massive economic capture. If this resonates, please apply.