Big Data Engineer

SDK - Montréal, QC (30+ days ago)

Apply Now

Overview

SDK is an innovative Canadian based Data Analytics company. We are Calgary proud but will become world renowned in helping our customers leverage their data assets. We have numerous opportunities for individuals who get excited about the possibilities of data to help organizations who leverage the latest cloud technology on the Microsoft stack.

SDK is looking for Big Data Engineers that will work on the collecting, storing, processing, and analyzing of huge sets of data. The Data Engineer must also have exceptional analytical skills, showing fluency in the use of tools such as MySQL and strong Python, Shell, Java, PHP, and T-SQL programming skills. He must also be technologically adept, demonstrating strong computer skills. The candidate must additionally be capable of developing databases using SSIS packages, T-SQL, MSSQL, and MySQL scripts.

The candidate will also have an ability to design, build, and maintain the business’s ETL pipeline and data warehouse. The candidate will also demonstrate expertise in data modeling and query performance tuning on SQL Server, MySQL, Redshift, Postgres or similar platforms.

Base Qualifications

  • 3+ years of demonstrated data engineering experience or development experience
  • 3+ years of experience with Big Data Technologies like Hadoop or Hive
  • 3+ years' experience in custom ETL design, implementation and maintenance
  • Proficient designing and implementing data models and data integration
  • Experienced deploying Azure SQL Database, Azure Data Factory and well-acquainted with other Azure services including Azure Data Lake and Azure ML
  • Experience implementing REST API calls and authentication
  • Experienced working with agile project management methodologies

Preferred Qualifications

  • Spark Programming (Azure Databricks preferable)
  • Python, Java & SQL
  • Knowledge of Azure Cloud (Data Platform Technologies)
  • Manage high volume, high traffic GDPR solutions build
  • SCALA a nice to have

At SDK we believe “perfection” is a process. We hire for fit and invest in training, so our people continue to be the best for themselves, SDK, and SDK's customers.

Experience:

  • ETL: 2 years (Preferred)
  • Software Development: 3 years (Preferred)
  • Data Integration: 1 year (Preferred)

Education:

  • Bachelor's Degree (Preferred)

Job Type: Full-time

Salary: $90,000.00 to $140,000.00 /year

Location:

  • Montréal, QC (Required)