Data Engineer
JLIConsulting · Vaughan
Job description
About the role
JLIConsulting is hiring a full-time permanent Data Engineer in the GTA, Ontario, within its eServices – Civil Infrastructure practice. The Data Engineer designs and sets up solutions that bring together information from many sources so that it can be analysed and used for decision-making, working in an on-premises environment and an enterprise AWS cloud solution.
Key responsibilities
- Work with stakeholders to understand data sources and the Data, Analytics and Reporting team strategy.
- Work with Data Management and Data Governance teams to meet industry standards and best practices.
- Capture metadata and data lineage compatible with enterprise metadata and data management tools.
- Run quality assurance and data integrity checks to ensure accurate reporting and records.
- Ensure ETL pipelines are high quality, with metadata and validation of completeness and accuracy.
- Develop and maintain scalable data pipelines and build new API integrations as data volume grows.
- Collaborate with analytics and business teams to improve data models feeding business intelligence tools.
- Implement monitoring of data quality so production data stays accurate and available.
- Write unit and integration tests, contribute to the engineering wiki and document work.
- Troubleshoot data issues through data analysis and support development and testing teams.
- Define data assets (data models), Spark and Spark SQL jobs, and design data integrations and a data quality framework.
- Evaluate open source and vendor tools for data lineage and help shape the long-term data platform architecture.
Required profile
- Experience applying database, storage, collection and aggregation models and techniques in business contexts.
- Structured problem solving, phenomenal communication and business awareness, and strong interpersonal skills.
Required skills
- Source code control tools such as Git.
- File formats (XML, CSV, JSON), databases (Redshift, Oracle) and connectivity.
- Data modelling, relational and dimensional modelling.
- ETL tools, query languages and data repositories.
- A plus: AWS, Google Cloud Platform and Azure.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Canada.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 25 minutes ago
Expires 1 month from now
2 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
JLIConsulting
Vaughan