Full Job Description
Amazon's Price Perception and Evaluation team is seeking a driven Data Engineer to work on exciting price evaluation projects. As a Data Engineer, you will design, implement and support scalable data infrastructure solutions to integrate with multi heterogeneous data sources, aggregate and retrieve data in a fast and safe mode, curate data that can be used in machine learning models and ad-hoc data requests. You will be exposed to AWS big data technologies. You should have excellent business and communication skills to be able to work with business owners and applied scientists to gather infrastructure requirements, design data infrastructure, build up data pipelines and datasets to meet business needs. You stay abreast of emerging technologies, investigating and implementing where appropriate.
Key job responsibilities
- Design, implement, and support data warehouse/ data lake infrastructure using AWS bigdata stack, Python, Redshift, QuickSight, Glue/lake formation, EMR/Spark, Athena etc.
- Develop and manage ETLs to source data from various systems and create unified data model for machine learning models.
- Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.
- Working closely with a team of scientists to drive price evaluation model research.
- Manage numerous requests concurrently and strategically, prioritizing when necessary