📢 New: get today's jobs on our WhatsApp Channel
Jobiglo

No results.

Senior Data Engineer - Middle Office Data Pipelines

DXC Luxoft · Toronto

New
Senior 🇬🇧 English
AWS EMR Glue Athena S3 Spark PySpark Airflow Hudi Iceberg Python Git Terraform GitHub Actions

Job description

About the role

DXC Luxoft is looking for an experienced Senior Data Engineer in Toronto to support the onboarding, integration and operationalization of datasets used by Middle Office functions. The role builds scalable, production-grade data pipelines and data products on AWS, delivering reliable data for analytics, reporting and downstream applications. The candidate owns the full lifecycle, from source analysis and solution design through implementation, deployment and operational support. The position is for subcontractors.

Key responsibilities

  • Analyze source systems, onboard new datasets and design scalable ingestion and transformation pipelines for Middle Office needs
  • Develop and maintain production-grade pipelines using AWS services (EMR, Glue, Athena, S3) and Spark/PySpark
  • Build and manage orchestration workflows with Airflow or equivalent, including scheduling, monitoring, alerting and recovery
  • Design data models, schema structures, partitioning strategies and data quality controls
  • Implement CI/CD pipelines and infrastructure-as-code with Terraform and GitHub Actions
  • Troubleshoot data quality, performance and operational issues and drive reliability improvements

Required profile

  • Strong hands-on experience building and operating AWS-based data platforms and pipelines
  • Ability to turn business requirements into production-ready data solutions
  • Nice to have: experience in financial services, asset management, capital markets or investment management; Middle Office, investment operations, risk or trading data experience; knowledge of data governance, lineage, security and large-scale production support

Required skills

  • Apache Spark, PySpark and distributed data processing
  • Modern data lake technologies, especially Apache Hudi and Apache Iceberg
  • Python, testing, code quality and Git workflows
  • Airflow or similar orchestration platform
  • Terraform, CI/CD pipelines and infrastructure automation

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec DXC Luxoft.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 3 days ago

Expires 1 month from now

13 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

DXC Luxoft

Toronto