Pyroclast Blog

Metamorphic: real-time complex event processing for Clojure

September 17, 2017

Distributed Masonry is pleased to open source Metamorphic, a Clojure(Script) complex event processing library. Complex event processing (CEP) is a technique for analyzing an input stream for sequences of events that match patterns. Patterns are expressed as a series of rules with properties denoting their relative positional attributes. In this post, we’ll explore why we built Metamorphic, what’s special about it, and what’s coming closely behind it in the next 4 weeks. (Impatient? Skip to...

Read more...


Patterns of Event Stream Processing: An Interactive Exploration of Session Windows

July 25, 2017

Patterns of Event Stream Processing is a series of articles surveying concepts that underpin streaming systems. In this post, we’ll study a technique called session windowing that’s used for grouping related data over a period of time. We’re going to look at what they are, what they’re used for, and why they’re hard to build from scratch. We’ll finish with our suggested design pattern for building session windows in a scalable manner. A primer on...

Read more...


Pyroclast Roaming & Clojure SDK Open Availability

July 11, 2017

I’m pleased to announce the open availability of Pyroclast Roaming, along with its complete Clojure SDK. Roaming is a container for the Pyroclast event streaming platform. Outfitted with our internal streaming engine, Roaming is able to interpret streaming programs written by its SDKs and execute them as Pyroclast would in a fully distributed, production-grade environment. Roaming’s Clojure SDK is data-driven - meaning idiomatic Clojure comes naturally. In this post, we’ll walk through how to get...

Read more...


Connect realtime event streaming to any toolset

July 3, 2017

It’s our mission to deliver a platform that combines powerful streaming primitives with a truly great product experience. Realizing the future of event stream processing’s full potential means delighting customers – and keeping them extremely productive. Today, I’m pleased to announce the latest addition to Pyroclast: Roaming. Pyroclast Roaming lets teams wield the full power of our platform from the comfort of their favorite programming language and development workflow. Pyroclast is a Platform as a...

Read more...


Challenges of Record Replay in Event Streaming Architectures

June 7, 2017

In our last post, The Future of Event Stream Processing, we introduced the idea of a log-based architecture. Logs are a superior approach to database-centric architectures for processing event data for analytics, materialized views, auditing, speculative queries, and more. In this post, we’re going to zero in on one of the most challenging components of implementing log designs: record replay. Record replay rewinds the clock The central idea behind log-oriented architectures are that all events...

Read more...


The Future of Event Stream Processing

May 17, 2017

Applications based on event streams have more demanding architectural qualities than ever, and traditional approaches to storing, querying and reacting to patterns are tearing at the seams. Business requirements mandate that our systems both record everything that’s ever happened, yet also summarize the entirety of that history with increasingly low latency. Reconciling these attributes and others into a new, unified architecture benefits from a change in perception of the problem. Event streaming is a natural...

Read more...