Senior Data Engineer

Job title: Senior Data Engineer in Iselin, NJ at Brains Workgroup

Company: Brains Workgroup

Job description: Our client, a major bank in Central, NJ, is looking for Senior Data Engineer.
Hybrid commute, 2 days on-site in Central NJ Locations and 3 day remote per week.This is a permanent FT career opportunity, with base salary range 170 - 190K DOE, plus around 20% bonus and great benefits package.Looking for Senior Data Engineer in banking/financial industry.Major Responsibilities:

• Building and maintaining data pipelines to ingest data from source systems into Databricks
• Designing, Building and maintaining generic frameworks to ingest data through the medallion layers
• Working with the core data platform team to integrate the framework with reference architecture
• Assisting the data mesh teams with best practices and on-boarding to the new framework

Requirements:

• 10+ years of data engineering experience in building OLTP and OLAP databases, both on-prem and in the cloud
• 5+ years of experience with large scale data processing using SQL, Python, Pandas and Pyspark
• 5+ years of experience building robust and scalable data pipelines in Databricks Lakehouse platform on any key cloud platform provider, preferably Azure cloud
• Experience with implementing Medallion architecture for data processing
• Experience with implementing Streaming data ingestion using Kafka
• Test driven development experience
• Proven experience in solution design and applying best design practices
• Data modeling and ER/UML diagram skills
• Experience with orchestration/enterprise scheduler platforms like Airflow, Tidal etc..
• Experience with implementing API based data integration pipelines
• Experience with source control and DevOps for CI/CD
• Experience working in Agile/scrum methodologies
• Experience with Jira, confluence for project work and documentation
• Experience with Service now for incident management
• Finance domain knowledge in Investment Banking (Securities, Capital markets) and Security reference data knowledge
• Nice to have ADF and SSIS experience
• College degree required.

Please email your resume or use this link to apply directly:Or email:
Check ALL our Jobs:Keywords: sql oracle python databricks etl data warehousing ssis ETL snow numpy pandas pyspark oltp olap

Expected salary:

Location: Iselin, NJ

Apply for the job now!

[ad_2]

Apply for this job