Data Engineer (Mid / Regular)
Sunscrapers Sp. z o.o., Poland
Job Description
Are you ready to take on the challenge?
We're looking for a Data Engineer to join our team in Warsaw or remotely.
Sunscrapers is an elite Python development company that helps clients set up dedicated development teams in Poland we've made of the most talented, experienced, and motivated software engineers.
Since 2010, we’ve been working with ambitious US and European Scaleups, SMBs, and enterprises on delivering digital products and extending in-house development teams.
We've earned our reputation by combining a passion for technology, the highest quality standards, and our unique 'Product-Developer Fit' hiring process.
The project:
We are currently in search of an accomplished and dynamic Data Engineer to become an integral part of the team. This is a continuous role where the key objective is to lead the charge in sustaining and expanding sophisticated data stack. The role involves architecting data pipelines on advanced Dagster instances and crafting meticulous data models and tests using DBT for foundational datasets. As an essential member of the collaborative team, the chosen candidate will be at the forefront of cultivating innovative capabilities through active involvement in extensive, long-running projects.
Responsibilities:
- Contribute to maintaining and expanding the data stack.
- Build data pipelines on the Dagster instance, using the existing framework or proposing new solutions.
- Develop and maintain data models and tests in DBT for foundational datasets.
- Lead long-running projects, including constructing an alerting framework for event-based notifications.
- Improve data input processes and suggest enhancements for the model supporting the investment sourcing tool.
- Develop internal tools for efficient entity resolution.
Requirements
- Proficiency in building data pipelines using Dagster.
- Proficiency in Python and SQL
- Knowledge of tools: Snowflake, PostgresSQL, Prisma, DBT (and DBT cloud), Dagster, Sentry, AWS
- Experience in data modeling and testing using dbt.
- Capability to propose and implement new frameworks when required.
- Previous engagement in long-running projects, particularly in alerting frameworks and data improvement initiatives.
- Strong collaborative skills and the ability to work both independently and as part of a team.
- Decision-making skills to balance speed, best practices, and system maintainability.
- Basic interest in investing for an intuitive understanding of investment-related datasets.
Benefits
What do we offer?
- Culture of teamwork, professional development, and knowledge sharing (https://www.youtube.com/user/sunscraperscom)
- Flexible working hours and remote work possibility
- Multisport card
- Private medical care
- Culture of good feedback: code reviews, evaluation meetings, mentoring.
- Comfortable office in central Warsaw equipped with all the necessary tools for comfortable work (Macbook Pro, external screen, ergonomic chairs) - if working on-site