Optiver Sydney is seeking an experienced Senior Software Engineer to support and advance the data needs of our local research team. You’ll work closely with researchers in Sydney and our Global Research and Data Platform teams to productionise workflows, optimise large-scale data processing, and manage infrastructure costs efficiently.
This role requires deep expertise in Software Engineering concepts and technologies – particularly in Data Engineering – along with a strong ability to work independently and deliver impactful results in a fast-paced environment. You will play a pivotal role in designing and implementing data solutions that enable efficient access to high-quality data, ensuring smooth operations of our data pipelines. Your work will directly support our research teams in deriving real-time insights and making data-driven decisions.
As a key hire into the data engineering team in our Sydney office, you will partner with cross-functional teams across regions to enhance and align our data strategy, helping drive Optiver’s data and analytics capabilities forward. Dependent on experience and seniority, your responsibilities will include:
Data Pipeline Design & Development: Architect, build, and manage scalable data pipelines using Spark, Databricks, and proprietary HPC tooling, ensuring high availability, scalability, and performance.
Platform and Tooling Development: Advance the state of the art of Optiver’s Research and Data platforms and tools.
Cost Optimisation: Monitor and optimise resource usage in partnership with the Data Platform team, balancing performance and cost-effectiveness.
Monitoring & Tuning: Implement monitoring tools and fine-tune systems for optimal throughput, latency, and reliability.
Cross-Functional Collaboration: Work closely with global Data Platform teams to maintain alignment on data strategy, tools, and best practices.
Documentation & Standards: Develop and maintain clear documentation of data pipeline architectures, processes, and best practices.
Mentorship & Guidance: Provide technical mentorship to junior engineers and support the growth of the data engineering function in Sydney.