Senior Data Engineer - Middle Office Data Pipelines
DXC Luxoft · Toronto
Job description
About the role
DXC Luxoft is looking for an experienced Senior Data Engineer in Toronto to support the onboarding, integration and operationalization of datasets used by Middle Office functions. The role builds scalable, production-grade data pipelines and data products on AWS, delivering reliable data for analytics, reporting and downstream applications. The candidate owns the full lifecycle, from source analysis and solution design through implementation, deployment and operational support. The position is for subcontractors.
Key responsibilities
- Analyze source systems, onboard new datasets and design scalable ingestion and transformation pipelines for Middle Office needs
- Develop and maintain production-grade pipelines using AWS services (EMR, Glue, Athena, S3) and Spark/PySpark
- Build and manage orchestration workflows with Airflow or equivalent, including scheduling, monitoring, alerting and recovery
- Design data models, schema structures, partitioning strategies and data quality controls
- Implement CI/CD pipelines and infrastructure-as-code with Terraform and GitHub Actions
- Troubleshoot data quality, performance and operational issues and drive reliability improvements
Required profile
- Strong hands-on experience building and operating AWS-based data platforms and pipelines
- Ability to turn business requirements into production-ready data solutions
- Nice to have: experience in financial services, asset management, capital markets or investment management; Middle Office, investment operations, risk or trading data experience; knowledge of data governance, lineage, security and large-scale production support
Required skills
- Apache Spark, PySpark and distributed data processing
- Modern data lake technologies, especially Apache Hudi and Apache Iceberg
- Python, testing, code quality and Git workflows
- Airflow or similar orchestration platform
- Terraform, CI/CD pipelines and infrastructure automation
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Canada.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 3 days ago
Expires 1 month from now
13 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
DXC Luxoft
Toronto
Related job offers
-
Software Support Team Lead
The Adaptavist Group Toronto -
Application Engineering, AVP - Power Platform
mufgub Toronto -
Reporting and Data Manager - Enterprise
Turner & Townsend Toronto -
Senior Software Engineer, Production
Matter Labs -
Conseiller ou conseillère technique Atlassian
The Adaptavist Group Montreal