Senior ETL Consultant

IT Services
  • IT Services
  • Toronto

Maarut Inc


4 days ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.


Direct message the job poster from Maarut Inc

Responsibilities

  • Participate in the review of project, work request and maintenance release artefacts – Use Case, System Requirement Specification, etc.
  • Deliver detailed system design documents and any other supporting documentation conforming to Ministry standards.
  • Design logical and physical data models using Sybase Power Designer.
  • Implement data pipelines using Azure Data Factory (ADF), stored procedure, and Informatica PowerCenter performing extraction, transformation, and loading activities.
  • Implement solutions using Logic App and Function App.
  • Generate structured JSON file using ADF/ SQL.
  • Develop Azure CI/CD pipeline to automate ADF release.
  • Develop complex Oracle PL/SQL program to fulfill project requirements.
  • Implement complex data conversion, e.g., binary to character, EBCDIC to UTF.
  • Implement complex data transformation(s) for derived and calculated values.
  • Integrate data sets from diverse source systems.
  • Implement ADF for initial data load and incremental load.
  • Promote ADF and Informatica ETL/ELT through all Ministry environments including Development, Integration Testing, QA, UAT, Production.
  • Resolve and troubleshoot ADF pipeline, stored procedure, and Informatica workflow technical problems.
  • Monitor and analyze incident, provide timely resolution.
  • Collaborate with IT Professionals throughout the Software Development Life Cycle.
  • Document information from diverse business area stakeholders and subject matter experts.
  • Optimize performance of ADF pipeline, Azure SQL and Synapse databases, and Informatica workflow.
  • Monitor application functionality and performance on daily basis.
  • Provide effective knowledge transfer to Ministry staff at all stages of this assignment.

Requirements

ETL Development-Data Integration

  • Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
  • Extensive experience in design, development, and implementation with Azure Data Factory, Databricks, including:
    • Self-Hosted Integration Runtime
    • Performance tuning on large data volumes
    • Complex data transformations
    • ADF Debugger to validate data transformation.

  • Experience with Informatica, including:
    • Workflow Manager
    • Repository Manager
    • Designer
    • Workflow Monitor

  • Experience with developing solutions using Logic App and Function App.
  • Experience in rapid application development (RAD) methodologies.
  • Experience in maintaining and improving existing ETL processes.
  • Experience in investigating data to identify potential issues within ETL pipelines.
  • Experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.
  • Experience with CI/CD (DevOps) pipelines and concepts, including:
    • Branching, pull requests, build, release, multiple parallel development repositories merge.

  • Experience with Azure DevOps.

Oracle PL/SQL Development

  • Extensive experience in designing and developing SQL Server Stored Procedure, Oracle PL/SQL programs.

Database Technologies

  • Experience with Oracle, Microsoft SQL Server database and tools.
  • Experience with relational and hierarchical database technologies.
  • Extensive knowledge of Azure SQL DB and Synapse platforms, including:
    • Performance tuning on large data volume.


Must haves:

  • Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.

Seniority level

Mid-Senior level


Employment type


Contract

Job function

Information Technology


Industries

IT Services and IT Consulting


#J-18808-Ljbffr

Source

To apply, please visit the following URL: