Kto szuka:
HAYS
Stanowisko:
Data Engineer
Lokalizacja:
Polska
mazowieckie
Opis stanowiska podany przez pracodawcę:
Data Engineer
Polska
NR REF.: 1192333
Hays IT Contracting is a cooperation based on B2B principles. We connect IT specialists with the most interesting, technological projects on the market.
- Python/ PySpark
- ETL
- Cloud migration experience (mostly AWS but other clouds are also acceptable)
- Databricks : very nice to have
- Database Experience (Oracle, MSSQLServer preferably)
- Architecture Design: be familiar with the design and implementation of scalable and efficient data architectures for large-scale systems.
- Data Integration: Design, develop, and maintain data pipelines for integrating diverse data sources into a unified format embedding best practices and standards.
- Data Management: Manage and optimize data to ensure efficient data storage, retrieval, and processing.
- ETL Processes: Develop and implement ETL (Extract, Transform, Load) processes to facilitate data migration and transformation.
- Data Quality Assurance: Implement data quality checks and ensure data integrity throughout the migration process.
- Collaboration: Work closely with cross-functional teams, including data migration delivery lead, data analysts, business analysts, stakeholders and clients to support data-related needs. Participate in agile ceremonies, providing regular updates on technical progress and addressing potential risks
- Documentation: Create and maintain comprehensive documentation for data processes, ensuring knowledge transfer and system transparency as well as contribute to development of the data migration playbook.
- Performance Monitoring: Monitor and optimize data performance to meet defined service-level agreements.
- Troubleshooting: Identify and resolve data-related issues in a timely manner, collaborating with relevant teams.
- Experience: Proven experience (7+ years) as a Senior Data Engineer or similar role in data migration projects
- Advanced Technical Skills: In-depth knowledge in programming languages such as Python or Scala.
- Experience with ETL tools and frameworks (DataBricks, Apache SparkSql).
- Strong SQL skills for data manipulation and querying.
- Hands on experience with agile practices, source versioning and agile project management tools (GitLab, Jira, Confluence, other similar)
- Database Knowledge: Familiarity with relational and non-relational databases (Oracle, MSSQLServer).
- Problem-Solving: Proven ability to solve complex data engineering challenges and optimize system performance.
- Good communication and interpersonal skills to collaborate effectively with team members and stakeholders
- English C1; German nice to have.
- Education: Bachelor’s or higher degree in Computer Science, Information Technology, or a related field.
Kontakt do pracodawcy:
Kliknij tutaj, aby skontaktować się z pracodawcą lub wysłać swoje CV »