Big Data Engineer - Remote

XONAI is building a unique technology to seamlessly connect large-scale data processing and machine learning pipelines to accelerator hardware. As announced in our most recent blog post, we are enabling our technology first for Apache Spark™. Preliminary TPC-H derived benchmarks show that our engine already delivers more than 2x faster and instant Spark execution with zero code changes on the latest AWS Graviton processors.

Our software stack is built on top of novel compiler technology such as MLIR and LLVM and goes all the way up to integrations with open-source software powering data pipelines. Our platform is highly modular by design, allowing engineers to work at specific layers without needing to dig into the details of other layers. The predominant programming languages in use are C++ (for low-level parts of the stack), as well as Scala and Java for our integration with Spark and for most of the new projects we are bootstrapping.

We are hiring for a variety of roles as we ramp up the delivery of our first SQL analytics platform, combining open-source solutions for building modern Data Lakehouses, rich data visualization tools and our accelerated Spark SQL engine.

Desirable skills

• Experience in developing large scale software with Scala
• Experience building query processing engines
• Knowledge of the internals of columnar file formats (e.g. Parquet, Delta)
• Solving challenging problems in the context of distributed and high-performance computing
• Experience with C++ desirable but not required
• Experience with cloud computing desired but not required
• Ability to quickly navigate through the requirements of a fast paced startup

What is it like to work at XONAI?

Flexible, remote work

Since our inception, we have been a fully remote company and we plan to remain that way. You will be offered access to coworking office space at any location of your preference or you can just work from home if you prefer. While our team is based in Europe, we encourage anyone around the world to get in touch with us.

Bleeding-edge open-source technologies

We are highly committed to create new transformative technologies that deliver unique benefits to our customers. Whether you are tweaking with compiler optimizations, powering data processing or delivering amazing frontend apps for our customers, you will be working and contributing to the latest open-source technologies and tools available and stay ahead in the world of Big Data analytics and AI.

Career and benefits

We believe at XONAI you will benefit from unique learning opportunities as you work in a fast-paced growing environment. You have the flexibility to pick up on the projects you are most passionate about and choose your working hours, as well benefit from our unlimited vacation policy. Joining a startup this early also gives you access to a unique equity package.

Learn more at our careers page.