Senior Data Engineer

Головна Вакансії компанії Intellias Senior Data Engineer

Project Overview:

As a Data Engineer in the Platform team, you will be closely working with our backend engineers on finding solutions for how we store data, build pipelines, and lay the foundation for models that the data science team can work with. We are trying to explore and make use of Azure services (e.g. Data Factory, Event Hub, Stream Analytics) in order to have a solid compatible solution that serves the business needs of our clients. In addition, you will be cooperating with the DevOps team on deploying those implemented solutions and rolling them out across the platform.

The team is composed of backend and QA engineers who are responsible for the availability, scalability, and maintenance of our cloud platform. You will be working in a cross-functional team comprising of diverse talents and different international backgrounds.

Рекрутерка

Ольга Якуба

Responsibilities:

Supporting the Platform team in developing solutions for data storage and retrieval;
Researching and diving deep into what Microsoft Azure has to offer in terms of data ingestion, streaming, analytics and processing;
Building data pipelines and integrating data from different sources;
Designing and building data service APIs;
Implementing potential findings into workable solutions;
Supporting the team in maintaining and enhancing the Platform Microservices;
Working within the team in an agile and adaptive manner according to the roadmap priorities;

Requirements:

2+ years experience working as a Big Data Engineer or similar role;
Advanced knowledge of SQL, NoSQL, data structures, and data modelling;
Practical experience with ETL;
Good knowledge of distributed system design;
Big Data Management and processing tools (e.g. Hadoop ecosystem, Spark, Flink);
Good knowledge of at least one backend technology (e.g. Scala, Python, or NodeJS is preferable).

Nice to have: