Stream from Servers (Kafka), Browsers (HTTP/2), or any DuckDB client (FlightRPC) to a horizontally scalable Rust DuckDB cluster.
Query in realtime via PostgreSQL interface.
Built on DuckLake with PostgreSQL catalog and data inlining. Horizontally scalable instances with Object Store based shared state and locking. Multi-tenant architecture with full isolation per user. On-demand cold tier hydration via CLI or API triggers. The boilstream extension automatically and seamlessly configures ducklake with temporary credentials for secure access.
INSTALL boilstream FROM community; LOAD boilstream; -- Login with email, password, and MFA code PRAGMA boilstream_login('https://your-server.com/user@example.com', 'password', '123456'); -- List and use your ducklakes FROM boilstream_ducklakes(); USE my_catalog; SELECT * FROM events;
A complete real-time data lakehouse platform.
The boilstream extension manages DuckLake for you, vends temporary credentials for seamless hot + cold tier access. Secure OPAQUE PAKE authentication with MFA support.
Confluent Schema Registry compatible Avro with JIT-compiled decoder – 3-5x faster than Apache Arrow's Rust decoder published Oct 2025. Use standard Kafka clients to stream data.
Automatic S3 Parquet snapshots with DuckLake catalog registration. Remote DuckDB clients with DuckLake extension work seamlessly.
SSO with Entra ID (upload/download XML files) with automated user provisioning (SCIM), RBAC access control, audit trails, and user/admin dashboards. Built-in registration as an alternative. Prometheus monitoring. Configure multiple cloud backends and assign BoilStream roles for users.
Envelope recycling and zero-copy Arrow processing eliminate memory allocations. 2.5+ GB/s throughput (16 vCPU) with 10,000 concurrent sessions.
DuckLake VIEWs are materialized with never-ending DuckDB queries that transform data in real-time. Standard SQL syntax, continuous execution, BoilStream innovation.
Deploy multiple BoilStream instances behind a load balancer. Shared state via Object Store enables seamless scaling. Each instance is a single binary with zero external dependencies. BoilStream downloads embedded Rust postgres server on launch.
Promote cold tier data to hot tier via CLI or API triggers. Flexible hydration control for tables and topics with priority queuing.
Full tenant isolation within a single deployment. Separate DuckLakes, encrypted secrets, chrooted filesystems, and isolated sessions per user. RBAC with BoilStream roles.
Deploy a single instance or scale horizontally with multiple nodes. Point to your S3 bucket and start ingesting.