Loading...
Loading...
Shell
The Sr. Data Engineer will design, build, and maintain scalable data infrastructure and high-performance pipelines for streaming and batch data. They will collaborate with stakeholders to define data models, ensure data quality, and integrate solutions across the enterprise.
Candidates must have over 10 years of relevant data engineering experience and a degree in Software Engineering or equivalent capability. Proficiency in Azure cloud services, Apache Spark, Python, and experience in the Energy Trading domain are required.
Job Family Group:
Worker Type:
Posting Start Date:
Business Unit:
Experience Level:
Job Description:
What’s the role
We are looking for a highly skilled Sr. Data Engineer to join our team and help design, build and maintain the infrastructure required for optimal extraction , transformation and loading of data from various sources (which include streaming and batch data). The candidate is expected to work closely with multiple business stakeholders and teams to support data initiatives and ensure business value generation.
Accountabilities:
Closely working with product / project team and stakeholders to understand the requirement
Solution consultation and development in accordance with the enterprise technology principles, methods, standards, and practices.
Estimation, solution & detailed technical design, implementation of high performance data pipelines which is secure and scalable
To define data models and schemas to support data analytics
Integrate different kind of data sources(database, API, streams) into unified data platform
Implement solutions for near-real-time data access.
Maintain and improve data quality, consistency and data governance throughout the ETL/ELT process
application technical deliverables including code, associated tests, and documentation
To automate the data workflows and reduce manual intervention.
To collaborate with multiple teams to integrate data solutions into other applications
To build the reusable solutions which can be reused across multiple projects
To identify areas, for improving efficiency in data operations
To innovate solutions for complex data and to ensure scalability and performance
What you bring
Must have legal authorization to work in the US on a full-time basis for anyone other than current employer
Degree in Software Engineer or demonstrated capability, applied experience, and role-relevant skills
10 + Years of relevant data engineering experience which include solutioning, design, planning and implementing end-to-end data solutions. Have in-depth hands-on experience in multiple complex implementations which include different tools and technologies
Good understanding of Energy Trading Business Domain and experience in transformation, orchestration of data in Energy Trading area
Proficient in Azure Cloud Technologies: Hands-on experience with a wide range of Azure services including Azure Data Factory (ADF), Azure Databricks (ADB), Azure Active Directory, Azure Storage, Azure Data Lake Services (ADLS), Azure Key Vault, Azure SQL Database, Azure Logic Apps and Azure DevOps
Data Engineering Expertise: Implemented several end-to-end data solutions using Azure Databricks Delta Lake for optimized storage, processing, and analytics over Azure Data Lake Storage (ADLS)
Azure Data Integration & Orchestration: Extensive experience in using Azure Data Factory (ADF) to orchestrate complex ETL/ELT pipelines, integrating with various data sources and destinations across Azure ecosystem
Advanced Knowledge in Data Processing & Analytics: Strong skills in Apache Spark and PySpark, leveraging Databricks for large-scale data processing and transformation
Azure Functions & Event-Driven Architectures: Experience developing serverless solutions using Azure Functions for data integration, real-time message consumption, and event-driven architectures
Python Programming: Expertise in developing data engineering pipelines, automation scripts, and data transformations using Python.
Data Storage Solutions: Hands-on experience with Azure SQL Database, SQL Warehouse, and Blob Storage/ADLS for structured, semi-structured data storage
DevOps, GitHub & CI/CD Pipelines: Skilled in Azure DevOps/GitHub for implementing continuous integration and continuous deployment (CI/CD) pipelines and managing source control and project workflows
Note: This role is a virtual position based in the US
What we offer
The base salary range for this position is $124,000 - $186,000 per year. Individual pay will be based on various factors, such as relevant work experience, education, certifications, skill level, seniority, and internal equity.
For regular full-time or regular part-time employees of the Company (participating companies as listed in the Summary Plan Description), insurance coverage options include medical, dental, vision coverage, life Insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs. Employees also participate in a company pension plan and a 401(k) plan. Paid leave includes up to 6 weeks of paid vacation time, up to 11 paid holidays, and parental leave offering 16 weeks of paid leave for birthing parents, and 8 weeks of paid leave for non-birthing parents.
Additionally, employees are eligible for short-term disability leave for up to 26 weeks at 100% or 50% of base pay as well as Long-Term Disability insurance. Shell also offers other compensation such financial reimbursement for adoption, wellness, education, and personal learning expenses, and some roles are eligible for discretionary long-term incentives. For interns, eligible benefits include medical, dental, and vision coverage, life insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs; participation in a 401(k) plan; and paid leave for up to 11 paid holidays. Additional information on Shell’s US benefit programs can be found at https://www.shell.us/careers/about-careers-at-shell/rewards-and-benefits.html.
You bring your skills and experience to Shell and in return you work with talented, committed people on one of the most important challenges facing our planet. You’ll have the opportunity to develop the skills you need to grow in an environment where we value honesty, integrity, and respect for one another. You’ll be able to balance your priorities as you become the best version of yourself.
Progress as a person as we work on the energy transition together
Continuously grow the transferable skills you need to get ahead
Work at the forefront of technology, trends, and practices
Collaborate with experienced colleagues with unique expertise
Achieve your balance in a values-led culture that encourages you to be the best version of yourself
Benefit from flexible working hours, and the possibility of remote/mobile working
Perform at your best with a competitive starting salary and annual performance related salary increase – our pay and benefits packages are considered to be among the best in the world.
Take advantage of paid parental leave, including for non-birthing parents
Join an organization working to become one of the most diverse and inclusive in the world. We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientation, and life experiences to apply
Grow as you progress through diverse career opportunities in national and international teams
Gain access to a wide range of training and development programs
We'd like you to know that Shell has a bold goal: to become one of the world’s most diverse and inclusive companies. You can get to know more about how we're working towards that goal, click here.
Shell in The United States
Shell has been in the US for more than 100 years, leading the sector in energy, petrochemicals and refined products. Today, we provide millions of Americans with the energy needed to heat and cool their homes and power the economy.
We operate in all 50 states, from our Deepwater platforms in the Gulf of America to the Pennsylvania Chemicals complex and our miles of pipelines throughout the US.
We reach our customers through our 13,000 branded retail stations, and we are number 1 in gasoline sales. We also own the #1 brand of motor oil in the U.S. – Pennzoil® – made from natural gas.
We are excited to play a key role in the move to net carbon emissions while providing the oil and gas needed by society for many decades to come.
-
DISCLAIMER:
Generate a resume tailored to this job's requirements based on your uploaded resume.
Base Salary (from JD)
$124,000 – $186,000
AI Est. Total Comp
$200,000
Location
Houston
Work Type
Remote OK
Seniority
senior level
Experience
10+ years
Category
data eng
Quality Score
7.3