Discover jobs
Job Search
data scientist
Title posted on CareerBeacon - Lead Data Engineer
Posted on November 12, 2024 by Employer details Scotiabank
Job details
Requisition ID: 208957Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. Data Engineer role will be responsible for designing, building, monitoring, tuning, and troubleshooting data pipelines for Global Finance & Risk Technology. Is this role right for you? In this role, you will: Develop and maintain robust data pipelines for the ingestion, transformation, and distribution of large datasets. Utilize services and tools to automate data workflows and streamline the data engineering process. Collaborate with other stakeholders to support data analysis, data mapping and reporting needs. Monitor application performance, identifying bottlenecks, and implementing improvements to enhance efficiency. Conduct data quality checks and implementing measures to ensure data accuracy and integrity. Stay current with emerging technologies and data engineering practices to recommend and adopt innovations that improve data systems. Provide technical expertise and support for data-related issues, including troubleshooting and resolving data pipeline failures. Document data engineering processes, creating data flow diagrams, and maintaining metadata for data lineage and cataloging.Do you have the skills that will enable you to succeed in this role? We'd love to work with you if you have experience with: Experience using Streaming Architecture (Kafka) and Big Data Platform (Hadoop) is required. Strong SQL knowledge is needed. Experience in NiFi is desired. General Understanding of continuous integration/continuous deployment (CI/CD) pipelines Experience building CI/CD pipelines using GitHub, Artifactory etc. to reduce cycle times and ensure quality. Strong scripting skills (i. e. shell scripting for automation. Working experience with source control systems like Git. Exposure to working on cloud platforms like Azure/GCP/AWS Experience with Agile/Scrum development methodologies Team player with effective communication skills (verbal and written) Able to see tasks through to completion without significant guidance. Self-managed and results-oriented with sense of ownership is required. A university degree in Mathematics, Science, Engineering, Management or relevant.What's in it for you? We have an inclusive and collaborative working environment that encourages creativity, curiosity, and celebrates success! We provide you with the tools and technology needed to create beautiful customer experiences. You'll get to work with and learn from diverse industry leaders, who have hailed from top technology companies around the world. Onsite cafeteria. Dress codes don't apply here, being comfortable does. We offer a competitive total rewards package that includes a base salary, a performance bonus, company matching programs (pension & profit sharing), generous vacation, personal & sick days, personal development funding, maternity leave top-up, parental leave and much more.Location(s): Canada : Ontario : Toronto Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets. At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiaba- LocationToronto, ON
- Workplace information On site
- SalaryNot available
- Terms of employment Permanent employmentFull time
- Starts as soon as possible
- vacancies 1 vacancy
- Source CareerBeacon #2117585
Important notice: This job posting has been provided by a partner site. Job Bank is not responsible for this content.
Report a problem with this job posting
- Date modified: