Data Engineer with Snowflake @ VirtusLab (práce v Polsku)

Data Engineer with Snowflake @ VirtusLab

• Strong SQL skills
• Strong engineering skills
• Polyglot engineer with experience in traditional Data Engineering and a knowledge of current trends like Modern Data Stack
• Demonstrated ability of design, build and implementation of software solutions in Snowflake and dbt with an unwavering focus on quality
• Ability to work in an agile environment, partnering with team members and peers to find solutions to challenging problems with transparency
• Experience of working using CI / CD and DevSecOps approach
• Dimensional modelling (Kimball)
• Experience in using a cloud environment, with preference of AWS
• Hands-on experience with Python or an equivalent programming language

Don’t worry if you don’t meet all the requirements. What matters most is your passion and willingness to develop. Moreover, B2B does not have to be the only form of cooperation. Apply and find out!

We are #VLteam – tech enthusiasts constantly striving for growth. The team is our foundation, that’s why we care the most about the friendly atmosphere, a lot of self-development opportunities and good working conditions. Trust and autonomy are two essential qualities that drive our performance. We simply believe in the idea of ​​“measuring outcomes, not hours”. Join us & see for yourself!

Project scope

Our main goal is to develop a Data Lake platform for a new, highly funded UK-based specialty insurance company. We work across two teams: one responsible for ingesting and curating hundreds of datasets from various providers, and the second one creating Data Marts used by analysts, business users, and Data Science teams. There are many greenfield areas and opportunities to make a significant impact on the entire company.

Tech stack

AWS, Snowflake, dbt, SQL, Terraform, Prefect

Challenges

• Delivering high-quality code for data processing and transformation using Snowflake and dbt,
• Automating and optimising day-to-day work while making sure the process remains reliable,
• Working closely with Data Architects and Business Analysts to create Data Marts using Kimball Dimensional Modelling,
• Connecting to multiple data sources and sinks to support complex business processes.

Team

The Data Engineering team consists of around 20 engineers of which about a half is Snowflake and the other half are Scala/Spark engineers. Many of them are from well-known consultancies. Apart from that teams consist of Data Architects, Business Analysts, Product Owner and Delivery Lead.

Kategorie

data

• z domu

Zajímavé nabídky práce v okolí: