ATOM
ATOM is a neural processing unit (NPU) from Rebellions, a South Korean AI chip company founded in 2020 and valued at roughly $1.4 billion as of late 2025.
Publisher review
ATOM is a neural processing unit (NPU) from Rebellions, a South Korean AI chip company founded in 2020 and valued at roughly $1.4 billion as of late 2025. It is purpose-built for large-scale AI inference, targeting developers and enterprises that need high throughput and low latency for serving large language models (LLMs) and small-to-medium enterprise applications. The hardware delivers 128 TFLOPS FP16 and up to 1024 TOPS INT4, with 64GB of ultra-low latency memory, making it suitable for high-concurrency, latency-sensitive environments. ATOM is designed for data scientists, ML engineers, and DevOps teams who want a GPU-like software experience but with the efficiency and cost benefits of a specialized accelerator. It is particularly relevant for organizations deploying LLMs at scale, such as chatbots, code assistants, and enterprise search, where performance-per-dollar is a key metric.
The core of ATOM's software stack is the RBLN SDK, which provides native integration with PyTorch, vLLM, and Triton. Developers can use standard PyTorch APIs, with graph-mode optimization for hardware-accelerated execution and eager mode for flexible experimentation. The SDK supports intelligent precision control across FP32, FP16, FP8, FP6, and FP4, allowing users to balance accuracy and performance. Distributed inference is handled via the Collective Communication Library, which manages tensor parallelism across multiple devices. The RBLN Compiler automates model compilation and distribution, while built-in profiling and debugging tools help identify bottlenecks. For LLM serving, vLLM-RBLN provides a high-throughput, low-latency backend that is production-proven. The system also integrates with Hugging Face for fast model onboarding and supports custom kernel programming via the Triton backend.
ATOM competes directly with GPU-based inference solutions from NVIDIA (e.g., H100, B200) and other NPU/ASIC offerings from companies like Groq and Cerebras. However, its primary differentiator is performance-per-dollar, especially for small language model (SLM) applications. Rebellions claims that ATOM delivers an unbeatable performance-per-dollar ratio, validated by MLPerf benchmark results, and is engineered for low power usage. The company is South Korea's first AI chip unicorn, having raised over $540 million in funding. While it does not directly compete with text editors like Atom (which is discontinued) or diagramming tools like Miro and Creately, those were listed as competitors in the source data, likely due to a naming collision. In the AI accelerator space, its main rivals are NVIDIA GPUs and other inference-focused chips.
ATOM's main trade-offs involve its software maturity and ecosystem depth. While the SDK is designed for a GPU-like experience, some features require technical knowledge, and documentation has been noted as a pain point by early users. Customer support response times vary, and the mobile app (if applicable) has limited functionality. The current usage flow of the RBLN SDK has constraints, such as requiring explicit model compilation steps, though the team is shifting toward a more PyTorch-native UX with torch.compile integration. Additionally, ATOM is optimized for inference, not training, so it cannot replace GPUs for model development. Finally, as a relatively new entrant, its long-term support and community ecosystem are less established than NVIDIA's CUDA ecosystem.
How it works
-
128 TFLOPS FP16
Delivers 128 teraflops of half-precision floating-point performance for high-throughput AI inference workloads.
-
Up to 1024 TOPS INT4
Provides up to 1024 trillion operations per second at INT4 precision, enabling efficient quantized model execution.
-
64GB ultra-low latency memory
Integrates 64GB of high-bandwidth, low-latency memory to handle large models and reduce data movement overhead.
-
Native PyTorch, vLLM, Triton integration
Supports standard PyTorch APIs, vLLM for LLM serving, and Triton for custom kernel programming without vendor lock-in.
-
Graph-mode and eager mode
Offers graph-mode optimization for hardware-accelerated execution and eager mode for flexible prototyping and debugging.
-
Intelligent precision control
Allows per-layer precision selection across FP32, FP16, FP8, FP6, and FP4 to optimize performance and accuracy.
-
Distributed inference via CCL
Uses the Collective Communication Library to manage tensor parallelism across multiple NPUs for scalable deployment.
Strengths and trade-offs
Strengths
- Delivers up to 1024 TOPS INT4 and 128 TFLOPS FP16, outperforming many GPUs on inference-specific metrics.
- Provides 64GB of ultra-low latency memory, enabling deployment of large language models without memory bottlenecks.
- Integrates natively with PyTorch, vLLM, and Triton, allowing developers to use familiar tools and workflows.
- Offers intelligent precision control across FP32, FP16, FP8, FP6, and FP4, giving fine-grained control over performance and accuracy.
Trade-offs
- Documentation is still maturing, with early users reporting gaps in guides and examples for advanced features.
- Customer support response times vary, which can be problematic for production-critical deployments.
- The current RBLN SDK requires explicit model compilation steps, adding friction compared to plug-and-play GPU workflows.
- ATOM is optimized for inference only, so teams that need training capabilities must maintain separate GPU infrastructure.
Pricing context
Contact for pricing; no public tiers or per-unit costs are disclosed.
Getting started with ATOM
-
Request access to ATOM
Contact Rebellions sales through their website to request access to ATOM hardware. Provide your organization details and use case for inference workloads. The team will respond with pricing and onboarding instructions.
-
Install RBLN SDK
Download and install the RBLN SDK from the Rebellions developer portal. Follow the installation guide for your operating system. Ensure your system meets the prerequisites, including Python and PyTorch versions.
-
Load a model from Hugging Face
Use the RBLN SDK to load a pre-trained model from Hugging Face. Run the provided command to pull a model like Llama or BERT. The SDK handles model conversion and compilation for ATOM hardware.
-
Compile and run inference
Compile the loaded model using the RBLN Compiler with your chosen precision (e.g., FP16 or INT4). Execute a sample inference script to verify the output. Monitor performance using the built-in profiling tools.
-
Deploy with vLLM backend
Configure the vLLM-RBLN backend for production serving. Set up an API endpoint using the provided configuration files. Test with a sample request to ensure low-latency responses. Schedule regular model updates as needed.
Frequently Asked Questions
What is the ATOM NPU from Rebellions?
ATOM is a neural processing unit from Rebellions, a South Korean AI chip company founded in 2020. It is designed for large-scale AI inference, delivering high throughput and low latency for serving large language models and enterprise applications.
What are the key specifications of the ATOM NPU?
ATOM delivers 128 TFLOPS FP16 and up to 1024 TOPS INT4 performance. It includes 64GB of ultra-low latency memory, making it suitable for high-concurrency, latency-sensitive AI inference workloads in production environments.
What software does the ATOM NPU support?
ATOM integrates with PyTorch, vLLM, and Triton via the RBLN SDK. It supports graph-mode and eager mode, intelligent precision control across FP32 to INT4, and distributed inference through the Collective Communication Library for scalable deployment.
How does the ATOM NPU compare to NVIDIA GPUs for inference?
ATOM competes with NVIDIA GPUs like H100 and B200, focusing on performance-per-dollar for inference. It claims superior efficiency for small language models and lower power usage, but lacks training capabilities and has a less mature ecosystem than CUDA.
What are the main trade-offs of using the ATOM NPU?
ATOM is optimized for inference only, not training. Its software requires explicit model compilation steps, and documentation is still maturing. Customer support response times vary, and the ecosystem is less established than NVIDIA's CUDA platform.
How much does the ATOM NPU cost?
Pricing for the ATOM NPU is not publicly disclosed. Interested buyers must contact Rebellions directly for quotes. There are no published tiers or per-unit costs available at this time.
Alternatives
How ATOM compares
Direct head-to-head against 3 competitors. Picked by 7wData.
ATOM
- Pricing
- Contact for pricing; no public tiers or per-unit costs are disclosed.
- Target
- ATOM is a neural processing unit (NPU) from Rebellions, a South Korean AI chip company founded in 2020 and valued at roughly $1.4 billion as
- Strength
- Delivers up to 1024 TOPS INT4 and 128 TFLOPS FP16, outperforming many GPUs on inference-specific metrics.
- Watch for
- Documentation is still maturing, with early users reporting gaps in guides and examples for advanced features.
UChat
- Pricing
- Starting at $10.00 per month
- Target
- Businesses needing live chat solutions
- Deployment
- Cloud
- Strength
- High customer support ratings
- Watch for
- Limited advanced features
Fathom
- Pricing
- Starting at $15.00 per month
- Target
- Teams needing analytics
- Deployment
- Cloud
- Strength
- Excellent ease of use
- Watch for
- Basic reporting capabilities
Glassix
- Pricing
- Custom/Contact sales
- Target
- Customer communication management
- Deployment
- Cloud
- Strength
- Strong integration options
- Watch for
- Higher pricing tiers
User reviews
No user reviews yet. Be the first to write one.
Sources
Reporting on this tool draws on these publicly available sources.