Apache Gluten and Polaris Graduate to Top-Level Projects, Driving Innovation in Data Infrastructure

The Apache Software Foundation (ASF) has announced the graduation of two significant open-source projects, Apache Gluten and Apache Polaris, to Top-Level Project (TLP) status. This milestone signifies the maturity, strong community governance, and sustainable development of both projects within the Apache ecosystem.

Accelerating Data Processing with Apache Gluten

Apache Gluten is an open-source middle-layer plugin designed to dramatically accelerate Apache Spark SQL and DataFrame workloads. It functions as a bridge, offloading compute-intensive tasks from the Java Virtual Machine (JVM)-based Spark to high-performance native engines like Velox or ClickHouse. Apache Software Foundation. Its extensible architecture allows for future integration with other ASF projects, including Apache DataFusion. opensourceforu.com. This results in faster analytics processing and reduced costs for big data workloads.

“Graduating to an Apache Top-Level Project represents an important step forward for Gluten,” said Weiting Chen, PMC Chair. opensourceforu.com

Enhancing Data Interoperability with Apache Polaris

Apache Polaris is a fully-featured, open-source catalog for Apache Iceberg. It implements Iceberg’s REST API, enabling seamless interoperability across a wide range of data platforms, including Apache Doris, Apache Flink, Apache Spark, Dremio OSS, StarRocks, and Trino. Apache Software Foundation. This allows for a more flexible and integrated data ecosystem.

“This promotion to Top-Level Project status highlights the maturity of the Polaris community and its technology,” said Jean-Baptiste Onofré, PMC Chair. Apache Software Foundation

Other Real-Time Analytics News

Several other companies have recently announced advancements in data and AI technologies:

• IBM launched Db2 Genius Hub, an AI-powered data management console introducing autonomous capabilities for Db2 operations.
• Coforge announced Coforge Data Cosmos, an AI-enabled, cloud-native data engineering and advanced analytics platform.
• Huawei unveiled its AI Data Platform, designed to strengthen the data foundation for enterprise digital and intelligent transformation.
• insightsoftware launched Simba Intelligence, an AI Semantic Platform delivering verifiable answers from live enterprise data.
• Postman introduced AI-native, git-based API workflows and API Catalog to accelerate API development.
• Prismatic announced an AI Copilot for its Embedded Workflow Builder, enabling natural-language automation.
• RecordPoint released its Model Context Protocol (MCP) Server, allowing AI systems safe access to governed data.
• Teramind announced Teramind AI Governance, a platform for extending behavioral oversight to AI tools and agents.

Partnerships and Collaborations

• Red Hat and Telenor are collaborating to power Telenor’s sovereign AI factory using Red Hat’s cloud-native and AI platforms and NVIDIA hardware.
• CoreWeave has partnered with Perplexity to support its inference workloads on CoreWeave Cloud.
• Geo Orchestration AI is piloting with Skymantics to operationalize privacy-first intelligence on the Anna orchestration platform.
• MinIO announced AIStor Table Sharing, enabling secure data sharing with the Databricks platform.
• Mirantis validated Supermicro’s modular server architecture with Mirantis k0rdent for sovereign AI and hybrid GPU cloud environments.
• Seekr launched a geospatial reasoning engine with a licensing agreement with Wyvern for hyperspectral imaging.

These developments demonstrate the continued innovation and investment in the real-time analytics and AI landscape.