Voltron Data, the company that accelerates the building of modular and composable data analytics systems, today announced the release of Ibis 8.0. Ibis allows developers to easily execute code across multiple data platforms – enabling the right query for the job.

The new release has its first dedicated streaming backends for Apache Flink and RisingWave, offering different engines for batch and now stream execution, unified with a single API for Python data frames.

“Finally developers can write code once and use it across local, batch, CPU, GPU and now real-time query engines. Ibis is leading the charge to break down the barriers between batch and stream processing execution engines. This is a big step toward a modular and composable data ecosystem across all paradigms,” said Josh Patterson, co-founder and CEO of Voltron Data.

Ibis is an independently governed open source project backed by Voltron Data and contributors across data platforms including Google, Starburst Data and RisingWave.

“As the Ibis API improves and adds new functionality like ML preprocessing, every backend it supports improves with it. Users can learn a single familiar dataframe API without being locked into any backend. The open source community can add Ibis ecosystem integrations to make working with data in Python better on any data platform Ibis supports,” said Zhenzhong “Z” Xu, vice president of engineering at Voltron Data.

With today’s release, users can run Ibis on 20 different query engines — ranging from DuckDB for smaller queries to BigQuery, Spark, Theseus and others for big distributed preprocessing/ETL jobs. With no code change, they can also run on two streaming engines – Apache Flink and RisingWave.

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , ,
Editor @ DevStyleR