Senior Data Engineer - Middle Office Data Pipelines

About the role

DXC Luxoft is looking for an experienced Senior Data Engineer in Toronto to support the onboarding, integration and operationalization of datasets used by Middle Office functions. The role builds scalable, production-grade data pipelines and data products on AWS, delivering reliable data for analytics, reporting and downstream applications. The candidate owns the full lifecycle, from source analysis and solution design through implementation, deployment and operational support. The position is for subcontractors.

Key responsibilities

• Analyze source systems, onboard new datasets and design scalable ingestion and transformation pipelines for Middle Office needs
• Develop and maintain production-grade pipelines using AWS services (EMR, Glue, Athena, S3) and Spark/PySpark
• Build and manage orchestration workflows with Airflow or equivalent, including scheduling, monitoring, alerting and recovery
• Design data models, schema structures, partitioning strategies and data quality controls
• Implement CI/CD pipelines and infrastructure-as-code with Terraform and GitHub Actions
• Troubleshoot data quality, performance and operational issues and drive reliability improvements

Required profile

• Strong hands-on experience building and operating AWS-based data platforms and pipelines
• Ability to turn business requirements into production-ready data solutions
• Nice to have: experience in financial services, asset management, capital markets or investment management; Middle Office, investment operations, risk or trading data experience; knowledge of data governance, lineage, security and large-scale production support

Required skills

• Apache Spark, PySpark and distributed data processing
• Modern data lake technologies, especially Apache Hudi and Apache Iceberg
• Python, testing, code quality and Git workflows
• Airflow or similar orchestration platform
• Terraform, CI/CD pipelines and infrastructure automation