What is CelerData Cloud Serverless?

CelerData Cloud Serverless is a fully managed, blazingly fast data lake analytics platform built on top of StarRocks.

By taking advantage of an architecture that features separation of storage and compute, CelerData brings users cost-effective compute resources for their analytical SQL workloads.

With its out-of-the-box data analytics infrastructure, CelerData provides timely insights to all stakeholders. CelerData has brought many engineering breakthroughs to the market, delivering over 3x performance gains in standard benchmarks and up to an 80% reduction in operating costs. A number of significant customers worldwide choose CelerData as their analytics platform.

CelerData Cloud Serverless supports a wide range of use cases within one platform

Data lake analytics

Directly query the data on your own data lake without data migration. CelerData Cloud Serverless supports all mainstream open data lake formats including Apache Hive™, Apache Hudi, Apache Iceberg, and Apache Delta Lake.

Query acceleration

Accelerate the analytics workloads on your data lake using asynchronous materialized views.

Data warehousing

Ingest data from external data sources into CelerData Cloud Serverless to support many more low-latency and high-concurrency data analysis scenarios.

The following figure shows the architecture of CelerData.

Architecture

Software editions in CelerData Cloud Serverless

CelerData Cloud Serverless offers two software editions to choose from, ensuring that your usage fits your organization’s specific requirements:

  • CelerData Cloud Serverless Standard Edition
  • CelerData Cloud Serverless Premium Edition

Premium Edition builds on Standard Edition through the addition of edition-specific features and/or higher levels of service. As your organization’s needs to change and grow, changing editions is easy.

When you create an account in CelerData, you need to define the software edition of the account.

Standard Edition

Customer benefits:

  • Provides the compute engine for your data lake at minimum cost
  • Stores in open standard formats
  • Easy to query directly against AWS S3 or AWS Glue
  • One-click migration from Trino, Presto, or Athena
  • Provides a unified query layer to build reports based on multiple data sources

In Standard Edition, CelerData will not provide managed storage volumes for customers, which means that CelerData can be used as a query engine to conduct low-latency interactive analysis of your data lake, but not store data locally within CelerData.

Premium Edition

Customer benefits:

  • Everything included in Standard Edition
  • Higher performance queries for low-latency customer-facing workloads
  • Pipeline-free query acceleration using materialized views for simplified architecture/maintenance
  • Real-time low-latency workloads

In Premium Edition, CelerData provides managed storage for customers, which means data can be stored persistently within CelerData instead of, or in addition to, data in your data lake. So, in this edition, CelerData can be used as a query engine, and also as an analytical database. Import from your data lake into CelerData further accelerates analysis and supports business scenarios with more stringent latency and concurrency requirements.

Feature comparison

FeatureStandard EditionPremium Edition
Integrate with external metastore (AWS Glue or Hive metastore) and query data in external data system (Apache Hudi, Apache Iceberg, Apache Hive, or Deltalake)
Table creation and data processing in external data system (Apache Hudi, Apache Iceberg, Apache Hive, or Deltalake)
Query load isolation based on multi-warehousing
Warehouse compute node scale-in and scale-out
Warehouse auto-suspend
Use local-disk cache to speed up queries
Table creation in CelerData managed storage volumes
Batch data ingestion from cloud storage (customer managed AWS S3) into CelerData managed tables
Integrate with Confluent cloud and routinely load data into CelerData managed tables
Use HTTP Streaming API to push data from local sources into CelerData managed tables
Incrementally load Parquet or ORC files from customer-managed AWS S3 buckets into CelerData managed tables
Accelerate queries and build models with materialized views
Integration with BI tools
Role-based access control
Audit log
Private link
IP address whitelist

Choosing between Standard and Premium Editions

Standard Edition

If you already have a data lake storage tier, for example you have built a data lake based on Iceberg, Hudi, Hive, or Deltalake on your own AWS S3 bucket and you are looking for a fully-managed query engine that can be compatible with them and deliver great query performance, you may want to consider going with Standard Edition. You just need to create warehouses (collections of compute resources) to execute the various SQL queries. In CelerData Cloud Serverless, the warehouses are responsible for the execution of SQL computations, not storage. The underlying compute nodes do not persistently store data, they are responsible for hot data caching and computation. Computation can be scaled horizontally according to your needs by adding and removing warehouses. Users only need to choose the appropriate warehouse size according to the trade-off about price and performance. When you use Standard Edition, you are only charged for the amount of time to run the warehouse. You can save unnecessary costs by resuming and suspending warehouses on demand.

Premium Edition

If you have not built a storage tier yet and are looking for a fully managed data analytics platform that can persist data and provide high-performance analytics, you can go for Premium Edition. Or, if you have already built a storage tier, and you want to be able to export to another system with lower query latency to accelerate your data analytics, whether you are persisting data in a streaming store (for example, Kafka), a data lake store (for example, AWS S3 or Apache Hive), or a database (for example, MySQL or PostgreSQL), you can go for Premium Edition. In summary, Premium Edition provides data import and persistent storage capabilities, as well as the ability to query both CelerData managed and external systems. CelerData managed data provides users with lower analysis latency.

It is worth mentioning that Premium Edition is built on the shared-data architecture of StarRocks, which provides separate storage and compute resources. Premium Edition utilizes object storage for data persistence, and almost unlimited storage. With Premium Edition, you pay for both the storage resources and the compute consumption of the warehouse, the hourly price will be slightly higher than Standard Edition.

Pricing concern

In CelerData Cloud Serverless, the hourly warehouse price for different software editions varies. We provide a free trial to help you to test without focusing on the cost. If you are satisfied with the features and performance of the product and would like to get a clearer price list, please feel free to contact our sales team.

Upgrading

When you are testing with Standard Edition and want to upgrade to Premium Edition, you can contact our technical support team to help you with the upgrade. Automatic upgrades are not yet supported, so it will take about a day to do so. One-way software edition upgrades are allowed. However, currently CelerData Cloud Serverless cannot support rollbacks for software editions, so choose carefully when you create an account and select the edition.