Data Engineer

Scotiabank - Toronto, ON (24 days ago)

Apply Now

Requisition ID: 54568

Join the Global Community of Scotiabankers to help customers become better off.

Job purpose

Contributes to the overall success of standing up Data Governance Domains in the Bank including support for bank-wide data management initiatives to understand and document metadata definitions, data lineage and quality in Canada and other countries ensuring specific individual goals, plans, initiatives are executed / delivered in support of the team’s business strategies and objectives. The incumbent will play a key part in development of metadata, data linage, data quality monitoring, data sharing agreements and service level agreements. Ensures all activities conducted are in compliance with governing regulations, internal policies and procedures.

Key Accountabilities

Work with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spark, etc).
Profile and analyze source data to determine the best reporting structures to build.
Design and develop ETL pipelines using multiple sources of data in various formats according to business requirements.
Conduct ETL, SQL and DB performance tuning, troubleshooting, support, and capacity estimation to ensure highest data quality standards.
Conduct dimensional modelling, metadata management, data cleaning and conforming, and warehouse querying.
Use sound agile development practices (code reviews, testing, etc) to develop and deliver data products
Provide day-to-day support and technical expertise to both technical and non-technical teams
Work with other engineers to brainstorm solutions to problems and support others in their goals.
Exhibit sound judgement, keen eye for details and tenacity for solving difficult problems.
Use strong analytical skills and support use of data for sound decision making.
Help us build data expertise and data focused mindset throughout the enterprise
Translate business needs into technical requirements
Functional Competencies

Proficient in a variety of languages including: Scala, Python, Java, Javascript
API development experience
Data modelling and warehousing experience
Proficiency with relational databases (Oracle, DB2, Redshift, etc.)
Strong proficiency in SQL
Education/ Experience

Degree in Engineering, Computer Science or Mathematics/Statistics.
5+ years industry experience with big data technology (Hadoop, Hive, Spark, SQL, Kafka, etc.)
Industry experience as a Data Engineer
Experience working in an Agile team environment
Location(s): Canada : Ontario : Toronto

As Canada's International Bank, we are a diverse and global team. We speak more than 100 languages with backgrounds from more than 120 countries. We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.