Job Posting Date 04/July/2021
Responsibilities:
• You will implement, own and develop highly scalable and customizable
packages for data ingestion, data processing and data cleansing.
• You will develop automated pipelines to run and build a common data model
for the data platform.
• You will ensure writing high quality code, writing unit and integration tests
building and packaging your code.
• You will optimize existing solutions with tremendous flexibility in technical
Choices.
• You will work with team of data engineers, data solution architects and
DevOps experts to develop and deliver cloud native data solutions.
Skills/Experience
• 5+ years of industry experience with software engineering using Python or
Scala.
• An intuition on what makes great software, and the ability to explain it.
• Good Experience in event-driven architecture and domain-driven design
• Experience mentoring and educating other team members
• Ability to work with a high level of autonomy and effectively self-manage during independent
projects.
• MUST have Experience with Spark, PySpark, Hive, Databricks and Data lake storage on Azure.
• Solid Experience with big data formats: parquet, Delta Lake.
• Experience with scripting languages (Bash, Python, …)
• Experience with data modelling and data engineering practices.
• Experience with modern DevOps practices and building CI/CD pipelines.
• Experience with cloud services, Azure cloud automation tools such as (ARM, terraform,
ansible, vault, …) and systems engineering
• Experience with monitoring tools for highly distributed cloud infrastructures
• Outstanding documentation and systems debugging skills
• Strong oral and written communication skills in English
• Can-do attitude is a must
• Technical Stack: Azure, Databricks, Key Vault, ADLS Gen2, SQL DB, Data Factory.
• 4+ years experience
Location: The Netherlands
Send your CV to [email protected].