Welcome Rubicon to Databricks: The Way forward for AI Storage and Serving Methods


We’re extremely excited to announce that the crew behind Rubicon is becoming a member of Databricks. Based by massive scale infrastructure builders, Akhil Gupta and Sergei Tsarev, Rubicon is a startup engaged on constructing storage methods for AI.

We began Databricks as an organization over 10 years in the past with the aim to make information and AI purposes dramatically simpler to construct. We quickly realized that conventional storage methods equivalent to enterprise information warehouses weren’t enough to course of information wanted for AI purposes. That’s why we constructed Delta Lake, a core storage basis for the Lakehouse that mixes the most effective of information warehousing and information lake storage.

With latest improvements in AI like LLMs, there may be an excellent higher want for storage options that allow processing various sorts of information and seamlessly integrating each the net stack (for serving) and the offline stack (for coaching and experimentation). That is mirrored in our conversations with clients who’ve been asking for a easy simple to make use of platform that permits them to leverage these new thrilling applied sciences. 

Akhil and Sergei are two well-known figures within the storage infrastructure area. Akhil started his profession at Google nearly twenty years in the past, the place he was answerable for the adverts infrastructure, which is among the largest scale use instances of AI on the planet up to now. Sergei cofounded Clustrix, one of many first scale-out OLTP database methods for top worth, high-transaction purposes. The 2 met at Dropbox, the place they helped construct, amongst different issues, one of many world’s largest, most effective, and safe storage methods which served trillions of recordsdata and exabytes of information. This included processing immense volumes of unstructured information, e.g. paperwork, photographs, and movies, exactly the kind of information that clients depend on for AI purposes. It’s no shock that given their previous experiences, Akhil and Sergei noticed the immense potential of AI, in addition to the gaps in storage and serving infrastructure wanted to help these workloads. This led them to founding an organization targeted on fixing the issue.

“We launched Rubicon.io with the aim of enabling the following era of storage infrastructure for the AI age. An amazing developer expertise with world class efficiency at scale is on the core of our mission. We discover our imaginative and prescient aligns completely with Databricks and we’re thrilled that our crew will likely be becoming a member of Databricks to ship a unprecedented expertise for builders on the Lakehouse.” – Rubicon.io co-founders Akhil Gupta and Sergei Tsarev

After we first met Akhil and Sergei, we shortly realized our shared outlook and the potential for the applied sciences they’ve been growing to speed up our AI infrastructure work.

We’re thrilled to deliver crew Rubicon’s pioneering imaginative and prescient into the Databricks Lakehouse Platform. On the upcoming Knowledge + AI Summit, we are going to unveil how we are going to combine Rubicon’s technical strategy to dramatically simplify constructing AI purposes. You possibly can nonetheless register to hitch us right here.

Leave a Reply

Your email address will not be published. Required fields are marked *