DataOps Engineer

Purpose of the job

The DataOps Engineer will play a critical role in ensuring the reliability, security and operational excellence of Collinson's modern data platform. As a key member of the Data & Analytics team, you will be responsible for automating platform operations, maintaining cloud infrastructure, supporting CI/CD pipelines and ensuring the platform remains secure, scalable and highly available.

In this hands-on role, you will work closely with Data Engineers, Security, Infrastructure and Product teams to support enterprise-wide data initiatives through automation, observability and platform standardisation.

Key Responsibilities

· Manage and maintain Snowflake, Kafka, AWS, MongoDB and supporting data platform infrastructure.

· Build and maintain CI/CD pipelines and deployment automation.

· Develop and maintain Infrastructure as Code using Terraform.

· Manage AWS networking including VPCs, VPC Peering, PrivateLink and secure private networking.

· Work with the Central Network team to implement and support enterprise networking solutions.

· Support Confluent Kafka platform operations and event-driven data integration patterns.

· Perform platform patching, upgrades, and lifecycle management.

· Ensure timely remediation of security vulnerabilities and compliance with security standards.

· Implement monitoring, alerting and observability using Datadog and platform monitoring tools.

· Support production incidents, root cause analysis, and operational improvements.

· Maintain platform documentation, operational runbooks, and engineering standards.

· Optimize platform performance, reliability, and cloud costs.

· Support platform governance, access management, and disaster recovery activities.

· Evaluate emerging technologies and recommend improvements to platform engineering practices.

· Own operational excellence of the data platform.

· Define and improve platform reliability standards.

· Drive automation and reduce manual operational effort.

· Improve developer experience for data engineering teams.

· Develop and maintain operational metrics, SLAs and SLOs to improve platform reliability and availability.

Knowledge, skills and experience required

Mandatory Technical Skills

DataOps & Platform Engineering

• AWS fundamentals
• Snowflake Administration
• MongoDB
• Confluent Kafka Platform
• Python
• SQL
• Git
• CI/CD pipelines
• Infrastructure as Code (Terraform)
• Data Observability and Monitoring (Datadog)
• Incident Management
• Production Support
• Security Patching
• Vulnerability Management
• Performance optimisation
• Cost optimisation

AWS Networking

• VPC
• VPC Peering
• AWS PrivateLink
• Route 53
• Security Groups
• IAM
• Private networking
• Central Network integration

Preferred Skills

• AWS Transit Gateway
• AWS Direct Connect / VPN concepts
• Datadog dashboards and alerting
• Airflow
• Platform Engineering / SRE practices

Nice to Have

• Generative AI fundamentals
• LLM integration patterns
• AI Agent frameworks
• Machine Learning platform awareness
• Real-time analytics architectures

Person Specification

• Self-motivator with a desire to learn new skills and embrace new technologies in a constantly changing technology landscape

• Strong problem-solving and analytical skills.

• Passion for automation, reliability and secure platform operations.

• Self-motivated with a continuous learning mindset.

• Strong stakeholder management and communication skills.

• Ability to communicate technical concepts to non-technical audiences.

• Collaborative team player who thrives in agile environments.

• Quality-focused with strong attention to detail.

• Ability to balance business priorities with technical excellence.

• Proactive in identifying opportunities for improvement and innovation.

• Comfortable working across global teams and multiple business domains.