Hire Freelance
Data Systems Scala Developers in Spain

Designed and optimized large-scale distributed data processing systems using Apache Spark, focusing on performance enhancements for data-intensive applications. Developed custom Spark transformations and actions, significantly reducing execution time for ETL pipelines in the financial analytics domain. Integrated Rust components with Scala to improve computational efficiency in real-time data processing.

• Implemented advanced caching strategies for Spark job optimization.
• Contributed to open-source Apache DataFusion project with Rust.
• Developed PySpark solutions for streaming data pipelines.
• Led migration of legacy data systems to cloud-based infrastructure.

Engineered large-scale data processing workflows with Apache Spark, optimizing ETL operations. Developed data warehousing solutions using Hive for efficient querying and reporting. Managed Hadoop clusters, ensuring high availability and fault tolerance.

• Implemented real-time analytics using Spark Streaming
• Enhanced SQL query performance with custom indexing
• Automated data pipeline monitoring and alerts

Built scalable microservices architectures deployed on Kubernetes, optimizing for high availability and fault tolerance. Developed distributed systems for real-time data processing in the IoT domain, leveraging Go and Scala. Spearheaded efforts in implementing CI/CD pipelines for seamless deployment and integration.

• Implemented event-driven architecture using Kafka and RabbitMQ
• Enhanced application performance through advanced caching strategies
• Designed RESTful APIs with comprehensive testing frameworks

Designed microservices-based architectures using Scala and Akka. Extensive experience in building scalable backend solutions with Spring Boot.

• Designed microservices-based architectures
• Experienced with Spring Boot
• Built scalable backend solutions

Pioneered distributed systems architecture, focusing on Kubernetes orchestration and Rust for high-performance computing. Led initiatives in developing and scaling cloud-native applications with extensive use of Scala and Python.

• Developed custom Kubernetes operators
• Optimized JVM performance for large-scale applications
• Engineered real-time analytics platforms using JavaScript

Designed and implemented a large-scale event-driven architecture for IoT data ingestion using Scala and Akka. Specialized in building concurrency models with Rust to support multi-threaded processing in high-load environments. Spearheaded the development of a real-time monitoring system for SQL databases, enhancing query performance by 30%.

• Developed a distributed logging system using Actix and Rust.
• Integrated TypeScript-based UI with backend services for seamless data flow.
• Led migration of legacy systems to cloud infrastructure, improving resilience.