Hire Freelance
Data Systems Scala Developers in Spain

Designed and optimized large-scale distributed data processing systems using Apache Spark, focusing on performance enhancements for data-intensive applications. Developed custom Spark transformations and actions, significantly reducing execution time for ETL pipelines in the financial analytics domain. Integrated Rust components with Scala to improve computational efficiency in real-time data processing.

• Implemented advanced caching strategies for Spark job optimization.
• Contributed to open-source Apache DataFusion project with Rust.
• Developed PySpark solutions for streaming data pipelines.
• Led migration of legacy data systems to cloud-based infrastructure.

Engineered data pipelines for processing terabytes of e-commerce transaction data, enhancing data accessibility and insights. Built ETL processes for a healthcare analytics platform, improving data quality and processing efficiency. Developed a recommendation engine for a retail platform using collaborative filtering techniques.

• Automated data validation processes using Scala and Apache Spark
• Implemented data warehousing solutions with optimized query performance
• Created a scalable data ingestion framework using Kafka and Flink
• Streamlined data visualization dashboards with real-time analytics

Engineered large-scale data processing workflows with Apache Spark, optimizing ETL operations. Developed data warehousing solutions using Hive for efficient querying and reporting. Managed Hadoop clusters, ensuring high availability and fault tolerance.

• Implemented real-time analytics using Spark Streaming
• Enhanced SQL query performance with custom indexing
• Automated data pipeline monitoring and alerts

Pioneered distributed systems architecture, focusing on Kubernetes orchestration and Rust for high-performance computing. Led initiatives in developing and scaling cloud-native applications with extensive use of Scala and Python.

• Developed custom Kubernetes operators
• Optimized JVM performance for large-scale applications
• Engineered real-time analytics platforms using JavaScript

Designed microservices-based architectures using Scala and Akka. Extensive experience in building scalable backend solutions with Spring Boot.

• Designed microservices-based architectures
• Experienced with Spring Boot
• Built scalable backend solutions

Built scalable microservices architectures deployed on Kubernetes, optimizing for high availability and fault tolerance. Developed distributed systems for real-time data processing in the IoT domain, leveraging Go and Scala. Spearheaded efforts in implementing CI/CD pipelines for seamless deployment and integration.

• Implemented event-driven architecture using Kafka and RabbitMQ
• Enhanced application performance through advanced caching strategies
• Designed RESTful APIs with comprehensive testing frameworks

Built a full-stack web application using Scala and TypeScript, focusing on seamless user experience. Developed a real-time notification system using Rust for high-frequency trading platforms. Created a data visualization dashboard with Haskell for complex datasets.

• Integrated microservices with message brokers for asynchronous processing
• Utilized Python for backend data processing tasks
• Implemented end-to-end testing frameworks for web applications