Company Description
We are seeking a Data Engineer with strong Scala expertise to support and enhance the company’s data infrastructure and machine learning models. The ideal candidate is passionate about building scalable, resilient pipelines and is eager to innovate using cutting-edge technology in a high-impact environment.
You will contribute to the core systems and data services by applying state-of-the-art solutions to solve complex and large-scale engineering challenges.
СUSTOMER
Our client is a fast-growing technology company focused on solving real-world challenges. Since day one, they have been committed to building highly resilient and scalable systems that allow for experimentation and innovation. Their data platform is designed to be both powerful and flexible, offering engineers the freedom to introduce new ideas and experiment with the latest technologies.
PROJECT
The project involves enhancing the client’s large-scale data processing systems and supporting machine learning infrastructure. You’ll be working with a team of experienced engineers to design, build, and maintain core data pipelines and services using Scala and other advanced technologies. Your work will directly impact the efficiency and intelligence of the platform powering.
Job Description
Work with Apache Spark batch and real-time streaming to process data at scale
Work with Scala microservices hosted on K8s (GKE) to support our products
Work with MLlib and TensorFlow on Vertex AI to solve forecasting and simulations in addition to a variety of machine learning challenges
Deploy new models and engines for new ideas and analysis
Qualifications
At least 5 years of commercial experience with Big Data
Advanced knowledge of different non-relational schema models (Column Family, Graph, Document, Object)
Experience with advanced topologies and architecture design such as Kappa and Lambda architecture
Experience with GCP Dataflow
Experience with Scala
Experience with Python
Experience with high-throughput systems
Experience with LLM
At least Advanced level of English
Additional Information
PERSONAL PROFILE
Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders
Strong problem-solving and decision-making skills, with a focus on driving results and meeting deadlines
Self-motivated, adaptable, and eager to learn new technologies and frameworks