Data Engineer

Manulife - Toronto, ON (30+ days ago)

Apply Now

Are you looking for unlimited opportunities to develop and succeed? With work that challenges and makes a difference, within a flexible and supportive environment, we can help our customers achieve their dreams and aspirations.

Job Description

Are you looking for unlimited opportunities to develop and succeed? With work that challenges and makes a difference and a flexible and supportive environment, we can help our customers achieve their dreams and aspirations.

We have a role open for a Data Engineer to join an organization where Data is a key component for success and is recognized as such, simply put: data is a big deal here!

Job Summary

Perform Hadoop Data Engineering
Design, build, integrate data from various resources
Manage and optimize solutions in the Big Data ecosystem

Responsibilities for this role include:
Provide and influence Big Data design and architecture
Manage data loading into the Hadoop ecosystem
Development of Big Data set processes for data modeling, mining and production
Perform Big Data modelling leveraging Hadoop database technologies
Exploratory data analysis; Query and process Big Data, provide reports, summarize and visualize the data
Consult, collaborate, and recommend solutions for batch and streaming use case patterns
Maintain security and data privacy in data flow designs
Influence and evolve Big Data security models
Capture, maintain and integrate technical metadata in a Big Data ecosystem and external metadata repositories
Assist and enable the integration of business metadata in a Big Data ecosystem and external metadata repositories
Participate in PoC/PoT efforts to integrate new Big Data management technologies, software engineering tools, and new patterns into existing structures
Research opportunities for data acquisition and new uses for existing data
Create custom software components (e.g. UDFs) and analytics applications
Create Big Data warehouses that can be used for reporting or analysis by data scientists
Influence/recommend ways to improve data reliability, efficiency and quality
Collaborate with other data management and IT team members on project goals
Document detailed Big Data design solutions conformant to enterprise standards, architecture and technologies
Oversee handover to operational teams
Monitor Big Data databases to ensure accurate and appropriate use of data and perform quality control of database activities
Troubleshoot and correct problems discovered in Big Data databases
Follow change management procedures and help to create policies and best practices for all Big Data environments
Maintain involvement in continuous improvement of Big Data solution processes, tools and templates
Create and publish design documents, usage patterns, and cookbooks for technical community

Experience required for this role is as follows:
Experience with the Hortonworks Data Platform (version 2.5) a plus
Experienced with the Hadoop ecosystem and toolset – Sqoop, Nifi, Pig, Spark, HDFS, Hive, HBase, etc.
Experience with Big Data streaming frameworks and tools (Spark Streaming, Storm, Kafka, etc.)
Experience developing Hadoop integrations (batch or streaming) for data ingestion, data mapping and data processing capabilities
Experience with Hadoop security frameworks: Knox, Ranger
Experience with Hadoop metadata frameworks and security policies: Ranger, Atlas
Experience automating data pipelines in a Big Data ecosystem
Experience programming in both compiled languages (Java, Scala) and scripting languages (Python or R)
Experience with SLDC methods (i.e. agile, iterative, waterfall, etc.)
Experience with DevOps or Continuous Delivery tools and processes a plus
Experience working in a cloud IaaS/PaaS environment a plus
Experience in designing solutions for Big Data warehouses
Experience in Big Data performance analysis, tuning and capacity planning
Experience using a source code management / version control system.
Experience in data profiling and analysis is a plus
Experience in designing business intelligence systems, dashboard reporting, and analytical reporting is a plus

What about Perks?

Manulife has lots of perks including, but not limited to:
Competitive compensation
Retirement Savings Accounts including a fully funded Pension Plan and a 401(k) plan with company match.
Manulife Share Ownership Program with company match.
Customizable Benefits Package including Health, Dental and Vision.
Generous time off policy.
Financial support for ongoing training, learning, and education
DressSmart flexible work attire policy.
An abundance of career paths and opportunities to advance
A flexible work environment with flex hours, work from home arrangements, distributed teams, and condensed work week arrangements.
This is a full time permanent role that can be worked from Waterloo or Toronto, Ontario. (Occasional travel to Waterloo will be required.)

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

About Manulife

Manulife Financial Corporation is a leading international financial services group that helps people achieve their dreams and aspirations by putting customers' needs first and providing the right advice and solutions. We operate primarily as John Hancock in the United States and Manulife elsewhere. We provide financial advice, insurance, as well as wealth and asset management solutions for individuals, groups and institutions. At the end of 2017, we had approximately 34,000 employees, 73,000 agents, and thousands of distribution partners, serving more than 26 million customers. As of December 31, 2017, we had over $1.04 trillion (US$829.4 billion) in assets under management and administration, and in the previous 12 months we made $26.7 billion in payments to our customers. Our principal operations are in Asia, Canada and the United States where we have served customers for more than 100 years. With our global headquarters in Toronto, Canada, we trade as 'MFC' on the Toronto, New York, and the Philippine stock exchanges and under '945' in Hong Kong.

If you are ready to unleash your potential it’s time to start your career with Manulife/John Hancock.

About Manulife
Manulife Financial Corporation is a leading international financial services group that helps people achieve their dreams and aspirations by putting customers' needs first and providing the right advice and solutions. We operate as John Hancock in the United States and Manulife elsewhere. We provide financial advice, insurance, as well as wealth and asset management solutions for individuals, groups and institutions. At the end of 2016, we had approximately 35,000 employees, 70,000 agents, and thousands of distribution partners, serving more than 22 million customers. At the end of 2016, we had $977 billion (US$728 billion) in assets under management and administration, and in the previous 12 months we made almost $26 billion in payments to our customers.

Our principal operations are in Asia, Canada and the United States where we have served customers for more than 100 years. With our global headquarters in Toronto, Canada, we trade as 'MFC' on the Toronto, New York, and the Philippine stock exchanges and under '945' in Hong Kong.

Manulife is committed to supporting a culture of diversity and accessibility across the organization. It is our priority to remove barriers to provide equal access to employment. A Human Resources representative will consult with applicants contacted to participate at any stage of the recruitment process who request an accommodation. Information received regarding the accommodation needs of applicants will be addressed confidentially.