Jet

Hazelcast Jet is a distributed stream and batch processing engine built on the Hazelcast In-Memory Data Grid (IMDG), designed for applications that require ultra-low latency and high throughput in real-time data processing.

Reviewed by 7wData

On this page

Publisher review

Hazelcast Jet is a distributed stream and batch processing engine built on the Hazelcast In-Memory Data Grid (IMDG), designed for applications that require ultra-low latency and high throughput in real-time data processing. Originally released as an independent product in 2010 by Hazelcast, Inc. (headquartered in Palo Alto, United States), Jet targets developers and architects building data-intensive systems such as real-time analytics, fraud detection, IoT data pipelines, and microservices-based event processing. It is particularly suited for use cases where processing speed under 10 milliseconds and handling millions of events per second are critical, and where the operational simplicity of an embedded deployment model is preferred over separate clusters. Jet's programming interface closely mirrors the Java Stream API, making it accessible to Java developers familiar with functional-style data transformations.

Jet achieves its performance through a combination of in-memory computing, cooperative multi-threading (green threads), and a Directed Acyclic Graph (DAG) execution model. In benchmarks published by Hazelcast, Jet processed over 2 GB per second in a word count batch job (640 GB dataset, 1 million distinct keys), outperforming Apache Spark and Apache Flink on the same hardware. For streaming workloads, Jet can sustain 10 million events per second with a latency of 10 milliseconds, as measured in trade monitor benchmarks involving windowed aggregations and event-time processing. The engine runs embedded within the application JVM, eliminating network hops for data access, and uses the Hazelcast IMDG for distributed state management, caching, and storage. Jet also provides a Management Center for monitoring job execution, cluster health, and performance metrics.

In the stream processing market, Jet competes directly with Apache Spark, Apache Flink, and Amazon Kinesis Data Analytics. Compared to Spark, Jet offers lower latency due to its in-memory, micro-batch-free architecture, but Spark has a larger ecosystem and broader adoption for batch ETL. Against Flink, Jet provides comparable streaming performance with a simpler deployment model (embedded vs. standalone), but Flink offers more mature event-time semantics and state management features. Amazon Kinesis Data Analytics is a fully managed service that abstracts cluster management, whereas Jet requires self-hosting or cloud VM provisioning. Jet's integration into Hazelcast Platform 5.0 in 2023 marked the end of Jet as a standalone product, consolidating its capabilities into a unified platform that also includes distributed caching, computation, and storage.

Key trade-offs include the product's end-of-life as an independent release—users now must adopt the broader Hazelcast Platform, which may introduce additional features and costs not needed for pure stream processing. The embedded deployment model, while low-latency, can complicate service testing and resource isolation compared to standalone frameworks. Documentation for feature implementation compliance is reported as poorly documented, and the codebase's heavy use of proxy patterns can reduce readability. The Management Center, while useful for monitoring, has experienced version compatibility issues. Pricing is subscription-based with annual or multi-year terms, varying by deployment environment and data scale, but no public tier pricing is disclosed.

Get the AI & data signal, daily.

48k+ subscribers read this every morning. One email, both newsletters. Unsubscribe anytime.

How it works

  1. Ultra-low latency

    Processes data with latency under 10 milliseconds, enabling real-time analytics and event-driven applications.

  2. In-memory computing

    Operates entirely in memory using Hazelcast IMDG, eliminating disk I/O bottlenecks for fast data access.

  3. Distributed stream and batch processing

    Unified engine for both streaming and batch workloads, supporting windowed aggregations and large-scale batch jobs.

  4. High throughput (10M events/sec)

    Achieves 10 million events per second with 10ms latency in streaming benchmarks, suitable for high-velocity data pipelines.

  5. Built on Hazelcast IMDG

    Integrates with Hazelcast In-Memory Data Grid for distributed caching, state management, and cluster coordination.

  6. Embedded deployment

    Runs inside the application JVM, reducing network overhead and simplifying cluster setup compared to standalone frameworks.

  7. Java Stream API-like interface

    Provides a programming model similar to Java Streams, allowing developers to write pipelines using familiar functional operations.

Strengths and trade-offs

Strengths

  • Ultra-low latency of under 10 milliseconds for streaming workloads, meeting real-time processing requirements for fraud detection and live dashboards.
  • In-memory computing eliminates disk I/O, enabling throughput of 10 million events per second in benchmark tests.
  • Easy to use for Java developers due to its Stream API-like interface, reducing the learning curve for building data pipelines.
  • Management Center provides visual monitoring of job execution, cluster health, and performance metrics, simplifying operational oversight.

Trade-offs

  • The product was integrated into Hazelcast Platform 5.0 and is no longer released independently, forcing users to adopt the broader platform.
  • Documentation for feature implementation compliance is poorly documented, making it difficult to verify support for specific stream processing semantics.
  • Heavy use of the proxy pattern in the codebase results in poorly readable code, complicating debugging and custom extensions.
  • Testing services, including Hazelcast itself, is difficult due to the embedded deployment model and lack of lightweight test harnesses.

Pricing context

Subscription-based licensing with annual or multi-year terms; pricing varies by deployment environment (on-premises or cloud), data scale, and feature set. No public tier pricing is disclosed; custom quotes are provided through Hazelcast sales.

Getting started with Jet

  1. Download Hazelcast Platform

    Go to the Hazelcast website and download the Hazelcast Platform 5.0 or later, which includes Jet capabilities. Choose the distribution for your operating system and extract the archive to a directory on your machine.

  2. Connect to a data source

    Configure a data source connection by editing the Hazelcast configuration file (hazelcast.xml) to define a source connector, such as Apache Kafka or a file system. Set the bootstrap servers or file path, and specify serialization formats like JSON or Avro.

  3. Write a processing pipeline

    Create a Java class that uses the Pipeline API to define your stream or batch processing logic. Use methods like drawFrom(), map(), filter(), and aggregate() to transform data, mirroring the Java Stream API for familiarity.

  4. Run the pipeline

    Start a Hazelcast Jet instance by executing the provided startup script (e.g., bin/jet.sh start). Submit your pipeline using the Jet client or command-line tool with the command jet submit <pipeline-jar>. Monitor the output in the console or log files.

  5. Monitor job execution

    Open the Hazelcast Management Center in a web browser by navigating to http://localhost:8081. Use the dashboard to view running jobs, check cluster health, and inspect performance metrics like throughput and latency for your pipeline.

Frequently Asked Questions

What is Hazelcast Jet used for?

Hazelcast Jet is a distributed stream and batch processing engine for real-time analytics, fraud detection, IoT data pipelines, and microservices event processing. It processes data with ultra-low latency under 10 milliseconds and handles millions of events per second.

How does Hazelcast Jet achieve low latency?

Jet achieves low latency through in-memory computing using Hazelcast IMDG, cooperative multi-threading with green threads, and a Directed Acyclic Graph execution model. It runs embedded in the application JVM, eliminating network hops for data access and reducing processing delays.

What are Hazelcast Jet's performance benchmarks?

In benchmarks, Jet processed over 2 GB per second in a word count batch job on a 640 GB dataset. For streaming, it sustains 10 million events per second with 10 milliseconds latency in trade monitor benchmarks involving windowed aggregations and event-time processing.

How does Hazelcast Jet compare to Apache Flink?

Jet offers comparable streaming performance to Flink with a simpler embedded deployment model, but Flink provides more mature event-time semantics and state management. Jet's integration into Hazelcast Platform 5.0 ended standalone releases, while Flink remains independently available.

Is Hazelcast Jet still available as a standalone product?

No, Hazelcast Jet was integrated into Hazelcast Platform 5.0 in 2023 and is no longer released independently. Users must now adopt the broader Hazelcast Platform, which includes distributed caching, computation, and storage, potentially adding features and costs not needed for pure stream processing.

What are the weaknesses of Hazelcast Jet?

Weaknesses include poor documentation for feature implementation compliance, heavy use of proxy patterns reducing code readability, and difficulty testing due to the embedded deployment model. The Management Center has version compatibility issues, and pricing is subscription-based with no public tiers disclosed.

Alternatives

How Jet compares

Direct head-to-head against 3 competitors. Picked by 7wData.

This tool

Jet

Pricing
Subscription-based licensing with annual or multi-year terms; pricing varies by deployment environment (on-premises or cloud), data scale, and feature set. No public tier pricing is disclosed; custom quotes are provided through Hazelcast sales.
Target
Hazelcast Jet is a distributed stream and batch processing engine built on the Hazelcast In-Memory Data Grid (IMDG), designed for applications that require ultra-low latency
Strength
Ultra-low latency of under 10 milliseconds for streaming workloads, meeting real-time processing requirements for fraud detection and live dashboards.
Watch for
The product was integrated into Hazelcast Platform 5.0 and is no longer released independently, forcing users to adopt the broader platform.

Private Jet Card Comparisons

Pricing
Membership-based; exact cost not public
Target
Buyers of jet cards and fractional programs
Deployment
Web-based comparison tool
Strength
Side-by-side comparison of 500+ programs by 65 variables
Watch for
Requires paid membership for full access

BlackJet

Pricing
From $10,000/hour for large cabin jet cards
Target
High-net-worth individuals seeking flexible jet cards
Deployment
Web-based booking and membership
Strength
Non-expiring hours and automatic carbon-neutral flights
Watch for
Fuel surcharges and taxi-time fees add 15-40% to base rate

Jettly

Pricing
Custom/Contact sales for fractional shares
Target
Businesses and individuals evaluating fractional ownership
Deployment
Web-based provider reviews and booking
Strength
Detailed reviews of NetJets, Flexjet, PlaneSense, Airshare
Watch for
Fractional contracts require 3-5 year commitments

User reviews

No user reviews yet. Be the first to write one.

Sources

Reporting on this tool draws on these publicly available sources.

  1. hazelcast.com
  2. github.com
  3. hazelcast.com
  4. taogang.medium.com
  5. www.gartner.com