Hire
Data Systems Scala Developers in Germany

Architected large-scale data pipelines using Apache Spark and Scala, optimizing for real-time analytics in the e-commerce domain. Spearheaded the migration of data infrastructure to Databricks, enhancing processing speed and reliability. Developed a custom data validation framework in Python, ensuring data integrity across distributed systems.

• Implemented Rust-based data transformation tools for performance gains
• Designed SQL-based ETL workflows for complex data models
• Automated data quality checks using custom-built Python scripts

Contributes upstream to etcd and Kubernetes while delivering distributed storage and backup capabilities for cloud-native platforms. Designed Go-based operators and infrastructure integrations spanning database backups, CSI storage migration, Prometheus-to-Kafka export, and AI data-processing systems.

• Developed InfluxDB backups to remote object storage
• Implemented selectable etcd database sizing
• Delivered automated etcd backups without configuration
• Built rail IoT forecasting and arrival-time models

Specialized in building real-time data pipelines using Kafka and Scala for analytics platforms. Implemented Kubernetes orchestration to streamline deployment of microservices for backend systems.

• Built real-time data pipelines with Kafka
• Implemented Kubernetes orchestration
• Streamlined microservices deployment

Contributes upstream to etcd and Kubernetes while delivering storage, backup, and recovery capabilities for container platforms, including a Kubernetes operator for InfluxDB backups to cloud object storage. Architected an AWS IoT data platform for time-series analytics and rail-operations forecasting.

• Delivered selectable etcd database sizing for OpenShift
• Implemented Azure Disk CSI migration and upstream KEP
• Exported Prometheus data to Kafka from OpenShift
• Developed pipelines with Spark and Apache Flink

Developed comprehensive front-end and back-end solutions using Scala and TypeScript. Led JavaScript frameworks integration to streamline user interface development.

• Developed front-end and back-end solutions
• Integrated JavaScript frameworks
• Streamlined user interface development

Designed an ad-event ingestion platform with Kafka storage and ClickHouse-backed analytics, then consolidated approximately 30 data sources for 50 customers through a medallion-architecture reporting service. Built Airflow pipelines with retry and back-off handling that reduced manual interventions from several weekly occurrences to approximately one monthly occurrence.

• Dask jobs for analytical data loading
• Production LLM feature using OpenAI API
• Self-service ad-configuration tooling
• End-to-end AdTech sales systems

Developed a custom distributed database engine optimized for low-latency transactions using Rust and Haskell. Led the design of a high-performance storage layer handling petabyte-scale data across multiple clusters. Spearheaded the implementation of a consensus protocol in Erlang to enhance fault tolerance in distributed systems.

• Architected a real-time data replication system using Go.
• Designed a transaction logging mechanism with C for durability.
• Optimized query execution paths for complex analytical workloads.
• Implemented a custom memory allocator in Rust for database internals.

Specializes in designing scalable distributed systems for real-time data processing. Led the development of a microservices architecture handling millions of transactions per second. Expert in optimizing JVM performance for latency-sensitive applications.

• Architected event-driven systems for financial services
• Implemented high-throughput APIs with Scala
• Optimized JVM for sub-millisecond response times

Developed a high-performance distributed data processing system using Scala and Rust, optimizing for low-latency operations in financial analytics. Engineered a real-time streaming platform integrating React and Python for dynamic data visualization in IoT applications.

• Implemented microservices architecture with Java for scalable web applications
• Built a custom data serialization protocol for cross-platform data exchange
• Enhanced a legacy JavaScript codebase to improve load times by 40%

Led the development of a high-frequency trading platform with sub-millisecond latency requirements, optimizing Scala-based components for performance. Architected a microservices-based infrastructure for a large-scale e-commerce platform, ensuring seamless integration with existing systems. Spearheaded the design and implementation of a distributed data processing pipeline handling terabytes of data daily.

• Developed a custom consensus protocol for distributed systems
• Implemented real-time analytics for IoT sensor data
• Optimized SQL queries for a 10x performance boost
• Built a serverless architecture using Go and TypeScript

Engineered a scalable event-driven architecture for an e-commerce application using Akka and ZIO, enhancing system resilience and fault tolerance. Developed backend services in Scala to support high-volume transaction processing, ensuring data consistency and reliability. Contributed to the design of a domain-specific language for internal tools, improving developer productivity.

• Integrated NoSQL databases with existing Java applications
• Built reactive systems using Play Framework and WebSockets
• Enhanced performance of JVM-based applications with Kotlin
• Conducted load testing, achieving 99.9% uptime during peak

Decomposed a high-traffic monolith into five standalone services using purely functional Scala, improving deployment frequency while maintaining resilience and test coverage. Delivers backend systems through production operations, including releases, on-call ownership, and postmortem-driven reliability work.

• Reduced incident recovery time from 1.4 hours to 15 minutes
• HTTP APIs built with http4s, Tapir, Circe, and protobuf
• Database access using doobie across PostgreSQL and Cassandra
• Kafka-based event-driven integrations with Redis caching

Specialized in building high-performance systems using Rust and Go for cloud-native applications. Developed low-latency network services with C and Python for real-time data processing. Optimized JVM-based applications in Scala for maximum throughput.

• Implemented concurrency models to enhance system parallelism
• Led adoption of Rust for memory-safe system programming
• Architected distributed systems for large-scale data analytics

Developed and maintained Scala, Akka, ZIO, and Spring Boot services within distributed systems across commerce, communications, and enterprise platforms. Delivered a CMS supporting online-shop and retail-branch information about orders, invoices, and deliveries.

• Implemented messaging integrations across distributed service architectures
• Used Kubernetes and Docker for service deployment
• Applied SQL and NoSQL persistence strategies
• Built CI/CD pipelines with Jenkins and Maven