Data Engineer
JLIConsulting · Vaughan
Description du poste
About the role
JLIConsulting is hiring a full-time permanent Data Engineer in the GTA, Ontario, within its eServices – Civil Infrastructure practice. The Data Engineer designs and sets up solutions that bring together information from many sources so that it can be analysed and used for decision-making, working in an on-premises environment and an enterprise AWS cloud solution.
Key responsibilities
- Work with stakeholders to understand data sources and the Data, Analytics and Reporting team strategy.
- Work with Data Management and Data Governance teams to meet industry standards and best practices.
- Capture metadata and data lineage compatible with enterprise metadata and data management tools.
- Run quality assurance and data integrity checks to ensure accurate reporting and records.
- Ensure ETL pipelines are high quality, with metadata and validation of completeness and accuracy.
- Develop and maintain scalable data pipelines and build new API integrations as data volume grows.
- Collaborate with analytics and business teams to improve data models feeding business intelligence tools.
- Implement monitoring of data quality so production data stays accurate and available.
- Write unit and integration tests, contribute to the engineering wiki and document work.
- Troubleshoot data issues through data analysis and support development and testing teams.
- Define data assets (data models), Spark and Spark SQL jobs, and design data integrations and a data quality framework.
- Evaluate open source and vendor tools for data lineage and help shape the long-term data platform architecture.
Required profile
- Experience applying database, storage, collection and aggregation models and techniques in business contexts.
- Structured problem solving, phenomenal communication and business awareness, and strong interpersonal skills.
Required skills
- Source code control tools such as Git.
- File formats (XML, CSV, JSON), databases (Redshift, Oracle) and connectivity.
- Data modelling, relational and dimensional modelling.
- ETL tools, query languages and data repositories.
- A plus: AWS, Google Cloud Platform and Azure.
Questions fréquentes
Pourquoi signalez-vous cette offre ?
Aller plus loin
Salaires, guides et recherches au Canada.
Salaires par métier
Postulez en 30 secondes
Entrez votre email pour postuler. Un compte sera cree automatiquement.
En continuant, vous acceptez nos conditions d'utilisation.
Deja un compte ? Connexion
Une question sur cette offre ?
Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.
Publie il y a 17 minutes
Expire dans 1 mois
1 vues · 0 interesses
Boostez vos chances
Importez votre CV : nous vous proposons les offres qui matchent votre profil.
Analyse de votre CV en cours...
JLIConsulting
Vaughan