Dragonfly Cloud announces new enterprise security features - learn more

engineering posts

Avoiding Common Mistakes & Pitfalls When Scaling Redis

Avoiding Common Mistakes & Pitfalls When Scaling Redis

Learn more about the four most common mistakes developers make when scaling Redis and how to avoid them.

Managed Offerings of Data Infrastructure

Managed Offerings of Data Infrastructure

Let's discuss various managed offerings for data infrastructure, including dedicated, multi-tenancy, BYOC, and serverless, and learn why Dragonfly chose the dedicated model as our first offering.

Bitmaps in Dragonfly: Compact Data with Powerful Analytics

Bitmaps in Dragonfly: Compact Data with Powerful Analytics

Learn how to use Bitmaps for efficient data handling in Dragonfly. Explore key commands, master bit-level operations, and dive into real-world use cases like user retention and feature flags.

How We Use Control Loops to Manage Dragonfly Cloud Datastores

How We Use Control Loops to Manage Dragonfly Cloud Datastores

Learn how we build control loops to simplify datastore management across multi-cloud environments.

Cluster Scalability: Redis Gossip vs. Dragonfly Orchestration

Cluster Scalability: Redis Gossip vs. Dragonfly Orchestration

Explore the architectural differences between Redis Cluster and Dragonfly Cluster, comparing gossip-based and control plane orchestrated designs to understand how each scales in distributed systems.

Why Does Dragonfly Require Only Half the Infrastructure of Redis?

Why Does Dragonfly Require Only Half the Infrastructure of Redis?

Dragonfly's innovative architecture, data structures, and advanced features can significantly reduce infrastructure needs, delivering substantial cost savings.

Multi-Tenancy in Dragonfly: Isolated Data, Unified Performance

Multi-Tenancy in Dragonfly: Isolated Data, Unified Performance

The multi-tenancy feature enables isolated data stores for multiple applications, ensuring the same performance without key collisions.

Dragonfly SSD Data Tiering: Caching All the Way Down

Dragonfly SSD Data Tiering: Caching All the Way Down

Dragonfly SSD tiering offers a new level of efficiency for managing data by intelligently moving less-used data to SSD storage while keeping hot data in memory.

Scaling Heavy BullMQ Workloads with Dragonfly Cloud

Scaling Heavy BullMQ Workloads with Dragonfly Cloud

Learn how to efficiently scale BullMQ workloads using Dragonfly Cloud's managed services. Discover setup tips, optimization configuration options, and real-world performance insights.

Dragonfly Cloud is Enterprise Ready

Dragonfly Cloud is Enterprise Ready

Dragonfly Cloud is now enterprise-ready with SOC 2 compliance, RBAC, and ACL features, ensuring top-notch security and scalability for modern cloud workloads.

Top 10 Modern Data Infrastructure Companies in 2024 - Part 2

Top 10 Modern Data Infrastructure Companies in 2024 - Part 2

Uncover the second half of our top 10 modern data infrastructure companies for 2024, highlighting groundbreaking technologies in real-time processing, analytics, and search solutions.

A Preview of Dragonfly Cluster

A Preview of Dragonfly Cluster

Dragonfly pushes vertical scalability to its limits. But when that's not enough for your workloads, discover the powerful horizontal scalability of Dragonfly Cluster!

Top 10 Modern Data Infrastructure Companies in 2024 - Part 1

Top 10 Modern Data Infrastructure Companies in 2024 - Part 1

Unveil the first half of top 10 modern data infrastructure companies for 2024, showcasing cutting-edge advancements in scalability, speed, caching, and real-time analytics.

Win Tickets to AWS re:Invent and KubeCon North America

Win Tickets to AWS re:Invent and KubeCon North America

Don't miss your chance to be where the tech world converges. Join our community today and stand a chance to win!

Principles of Modern Data Infrastructure

Principles of Modern Data Infrastructure

Discover the key principles of modern data infrastructure—what we believe are necessary to handle today's demanding data requirements.

Dragonfly: The Future-Proof Alternative to Redis

Dragonfly: The Future-Proof Alternative to Redis

Dragonfly is the future-proof alternative to Redis, offering superior performance, cost efficiency, and a forward-thinking licensing strategy.

Migrating to Dragonfly Cloud using RedisShake

Migrating to Dragonfly Cloud using RedisShake

Learn how to migrate to Dragonfly Cloud using RedisShake, a versatile tool for seamless and efficient in-memory data migration.

Introducing: Dragonfly Cloud

Introducing: Dragonfly Cloud

Dragonfly Cloud is now available! Get the most performant and cost-efficient in-memory data store in the world up and running in minutes.

Building an Interactive Terminal Application with Go & Dragonfly

Building an Interactive Terminal Application with Go & Dragonfly

Learn to build an interactive terminal UI application using Go, BubbleTea, and Dragonfly. Check out our first guest author blog post!

Best Practices for Managing In-Memory Data Stores

Best Practices for Managing In-Memory Data Stores

Let's talk about best practices for snapshots, backups, high availability, scalability, and security to ensure reliable in-memory data infrastructure.

Dragonfly Cloud vs. AWS ElastiCache: Product Breakdown

Dragonfly Cloud vs. AWS ElastiCache: Product Breakdown

Compare the differences between Dragonfly Cloud and AWS ElastiCache, focusing on pricing, performance, scalability, and unique features to optimize your in-memory data store needs.

Rueidis with Dragonfly: Auto-Pipelining & Client-Side Caching

Rueidis with Dragonfly: Auto-Pipelining & Client-Side Caching

Explore how our new integration with Rueidis enables auto-pipelining, client-side caching, and distributed locking for Go applications.

Batch Operations in Dragonfly: Pipelining, Transactions, and Lua Scripting

Batch Operations in Dragonfly: Pipelining, Transactions, and Lua Scripting

Explore advanced batch operations in Dragonfly, including pipelining, transactions, and Lua scripting, to enhance performance and data handling in high-throughput applications.

Running DocsGPT with Dragonfly: Adding AI to Your Documentation

Running DocsGPT with Dragonfly: Adding AI to Your Documentation

Learn how to integrate DocsGPT with Dragonfly for efficient documentation queries, and see how AI enhances your project documentation.

Mastering In-Memory Data Costs

Mastering In-Memory Data Costs

Discover how to optimize costs for in-memory data stores like Redis and Dragonfly, focusing on best practices for cloud cost management and FinOps strategies. Learn practical tips for cost efficiency.

Redis Interview Questions for DevOps and Platform Engineers

Redis Interview Questions for DevOps and Platform Engineers

Prepare for your next DevOps or Platform engineering interview. Let's learn and discuss best practices for managing high-performance, reliable Redis systems.

Dragonfly and Celery: Powering Financial Transactions

Dragonfly and Celery: Powering Financial Transactions

Learn how Dragonfly and Celery seamlessly integrate to build a financial transaction system based on Ethereum, providing a robust solution for efficient, high-volume data processing.

Efficient Context Management in LangChain Chatbots with Dragonfly

Efficient Context Management in LangChain Chatbots with Dragonfly

Explore efficient context management for LangChain OpenAI chatbots with Dragonfly, enhancing performance and user experience through caching techniques.

Using Bloom Filters with Dragonfly

Using Bloom Filters with Dragonfly

Discover Dragonfly’s new native Bloom filter support, providing yet another powerful tool to enhance caching, data management, and system efficiency.

Ensuring Atomicity: A Tale of Dragonfly Transactions

Ensuring Atomicity: A Tale of Dragonfly Transactions

Dive into Dragonfly's transactional framework through a metaphorical journey, uncovering how it maintains atomicity and serializability in a kingdom of data.

Redis and Dragonfly Architecture Comparison

Redis and Dragonfly Architecture Comparison

This blog post provides a comparison of Redis and Dragonfly architectures, highlighting Dragonfly's advanced solutions for overcoming Redis's limitations in performance, scalability, and memory efficiency.

Dragonfly's New Sorted Set Implementation

Dragonfly's New Sorted Set Implementation

This blog post dives into Dragonfly's innovative approach to enhancing the sorted set data type, showcasing a new B+ tree implementation that significantly reduces memory usage by up to 40% and improves performance.

Using Dragonfly as a Table Engine for ClickHouse

Using Dragonfly as a Table Engine for ClickHouse

In this blog post, we evaluate using Dragonfly as a ClickHouse table engine, highlighting the seamless integration and exploring both benefits and practical considerations.

Relay with Dragonfly: Towards the Next-Gen Caching Infrastructure

Relay with Dragonfly: Towards the Next-Gen Caching Infrastructure

Integrating Dragonfly with Relay enhances PHP applications by significantly boosting caching performance, showcasing scalability, high throughput, and reduced latency for efficient next-gen caching infrastructure.

Measuring Cardinality in the Millions and Billions with Dragonfly

Measuring Cardinality in the Millions and Billions with Dragonfly

This blog post explores using Dragonfly for measuring cardinality with precision at massive scales. Focusing on `Set` for exact counts and `HyperLogLog` for accurate estimations.

Scaling Redis without Clustering

Scaling Redis without Clustering

This blog explores scaling Redis, highlighting the complexities of Redis Cluster and presenting Dragonfly as a simpler, efficient alternative. It offers insights into vertical scaling, operational ease, and Dragonfly's ability to handle large-scale workloads on a single node.

Running and Optimizing Sidekiq Workloads with Dragonfly

Running and Optimizing Sidekiq Workloads with Dragonfly

In this blog post, we dive into the journey of running and optimizing Sidekiq workloads with Dragonfly, demonstrating Dragonfly's compatibility and efficiency. This initiative also illustrates our dedication to growing and adapting Dragonfly within the open-source community.

2024 New Year, New Number: New Benchmarks Show Dragonfly Achieves 6.43 Million Ops/Sec on an AWS Graviton3E Instance

2024 New Year, New Number: New Benchmarks Show Dragonfly Achieves 6.43 Million Ops/Sec on an AWS Graviton3E Instance

With the advancements of cutting-edge hardware, Dragonfly reaches 6.43 million ops/sec on a single `c7gn.16xlarge` instance.

Scaling Real-Time Leaderboards with Dragonfly

Scaling Real-Time Leaderboards with Dragonfly

Explore how to build dynamic, real-time leaderboards using Dragonfly and PostgreSQL. Learn to effectively manage user scores and data for high-performance, scalable leaderboard systems for gamification features.

Using Laravel with Dragonfly

Using Laravel with Dragonfly

Explore the integration of Dragonfly with Laravel for enhanced performance. This blog post dives into using Dragonfly as a cache and queue driver, highlighting its compatibility, low memory usage, efficient snapshotting, and advanced queue management features.

What You Need to Know About ElastiCache Serverless

What You Need to Know About ElastiCache Serverless

In the blog post, the emerging trend of serverless solutions is discussed, focusing on AWS ElastiCache Serverless. While acknowledging its innovative approach, our calculation suggests that the pricing model may not be practical for medium to large workloads.

Announcing Dragonfly Search

Announcing Dragonfly Search

We are thrilled to announce Dragonfly Search, enabling both vector search and faceted search in our robust and performant in-memory data store.

How We Optimized Dragonfly to Get 30x Throughput with BullMQ

How We Optimized Dragonfly to Get 30x Throughput with BullMQ

In this blog post, we navigate the journey of optimizing Dragonfly for BullMQ, achieving an exceptional 30x throughput increase. This endeavor highlights our deep commitment to the community and demonstrates our dedication to expanding and adapting Dragonfly to the open-source ecosystem.

Building E-Commerce Applications with Dragonfly

Building E-Commerce Applications with Dragonfly

In this blog post, we discover how Dragonfly boosts e-commerce platforms with efficient caching, personalized content, and managing high-traffic events. Learn about Dragonfly's capabilities for ensuring smooth operations during peak times.

Announcing Dragonfly Kubernetes Operator General Availability

Announcing Dragonfly Kubernetes Operator General Availability

We are thrilled to announce the general availability of the Dragonfly Kubernetes Operator.

Building a Real-Time Ad Server with Dragonfly

Building a Real-Time Ad Server with Dragonfly

In this blog post, we build a real-time ad server application using Bun, ElysiaJS, and Dragonfly, showcasing seamless integration and exceptional developer experience. Dive into hands-on examples and enhance your understanding of these cutting-edge technologies.

Running BullMQ with Dragonfly

Running BullMQ with Dragonfly

In this post, we explore the seamless integration of Dragonfly as a drop-in replacement for Redis as the backing in-memory store of BullMQ, a robust background job processing library for Node.js.

Developing with Dragonfly: Solve Caching Problems

Developing with Dragonfly: Solve Caching Problems

In the Developing with Dragonfly series of blog posts, we will explore different techniques and best practices for developing applications with Dragonfly. In this blog post, we explore the 3 common caching problems and best practices to mitigate them.

Developing with Dragonfly: Cache-Aside

Developing with Dragonfly: Cache-Aside

In the Developing with Dragonfly series of blog posts, we will explore different techniques and best practices for developing applications with Dragonfly. We start with one of the most common usages: Cache-Aside.

Fearlessly Handling BigKeys with Dragonfly

Fearlessly Handling BigKeys with Dragonfly

Wrestling with BigKeys is hardly an issue when using Dragonfly, the groundbreaking in-memory data store. You can use BigKeys in Dragonfly if they are necessary to your server applications, fearlessly.

Running the Feast Feature Store with Dragonfly

Running the Feast Feature Store with Dragonfly

In this blog post, we explore the seamless integration of Dragonfly as a drop-in replacement for Redis in Feast—an acclaimed feature storage and server project widely recognized in the machine learning domain. With just some simple steps, we unveil the outstanding compatibility of Dragonfly as an online store solution for Feast, ensuring a smooth transition without compromising existing functionalities.

The Unbearable Lightness of Horizontal Scaling

The Unbearable Lightness of Horizontal Scaling

This post explores the limitations of horizontal scaling in terms of cluster reliability, load distribution, and cloud over-commitment. It also outlines design decisions that were made to allow Dragonfly, a drop-in Redis replacement, to scale vertically in order to handle heavy workloads and large data volumes on a single instance. By adopting Dragonfly's vertical scaling capabilities, organizations can achieve improved performance, cost savings, and operational efficiency in their distributed systems.

Zero Downtime Migration from Redis to Dragonfly using Redis Sentinel

Zero Downtime Migration from Redis to Dragonfly using Redis Sentinel

This blog post discusses zero-downtime migration from Redis to Dragonfly using Redis Sentinel. It covers the benefits of Dragonfly, migration techniques, and the role of Redis Sentinel in ensuring seamless migration without service interruption. The post provides steps to configure Dragonfly as a replica and promote it using Sentinel.

Monitoring In-memory datastores

Monitoring In-memory datastores

This blog post covers monitoring in-memory datastores, focusing on Dragonfly. Learn how to use Prometheus and Grafana to monitor Dragonfly metrics and visualize them on a dashboard. Explore memory consumption, client-side metrics, server metrics and more.

Leveraging the power of Lua scripting with Dragonfly

Leveraging the power of Lua scripting with Dragonfly

This blog post discusses the limitations of Lua scripting in Redis and introduces Dragonfly as a drop-in replacement for Redis. Dragonfly addresses the challenges of long-running scripts and scalability, offering a vertically scalable, multi-threaded, and asynchronous architecture that improves performance and efficiency for Lua scripting in Redis.

We’re Ready for You Now: Dragonfly In-Memory DB Now Supports Replication for High Availability

We’re Ready for You Now: Dragonfly In-Memory DB Now Supports Replication for High Availability

Dragonfly, an in-memory database that can be a drop-in Redis replacement, now supports replication for high availability in its version 1.0 release.

Migrating from a Redis Cluster to Dragonfly on a single node

Migrating from a Redis Cluster to Dragonfly on a single node

In this blog post, you will learn how to migrate data from a Redis Cluster to a single-node Dragonfly instance. We will use a sample application to demonstrate the migration process and cover everything step by step.

Rate Limiting with Dragonfly

Rate Limiting with Dragonfly

Dragonfly offers a rate limiting API via the CL.THROTTLE command. This post outlines the rate limit algorithm background and how you can use it in your application.

Building a Background Processing Pipeline with Dragonfly

Building a Background Processing Pipeline with Dragonfly

In this blog post, you will learn how to use Redis Lists to build a background processing pipeline with Dragonfly.

Top 5 Reasons Why Your Redis Instance Might Fail

Top 5 Reasons Why Your Redis Instance Might Fail

In this article, we will explain the main reasons why your Redis instance might fail, and provide advice to avoid this.

Redis vs. Dragonfly Scalability and Performance

Redis vs. Dragonfly Scalability and Performance

A thorough benchmark comparison of throughput, latency, and memory utilization between Redis and Dragonfly.

Balanced vs Unbalanced

Balanced vs Unbalanced

Balance is essential in life. When our focus is limited to improving a single aspect of our life, we weaken the whole system.

Dragonfly Cache Design

Dragonfly Cache Design

I talked in my previous post about Redis eviction policies. In this post, I would like to describe the design behind Dragonfly cache.

Redis Analysis - Part 2: Simplicity

Redis Analysis - Part 2: Simplicity

Let’s talk about the simplicity of Redis. Redis was initially designed as a simple store, and it seems that its APIs achieved this goal.

Redis Analysis - Part 1: Threading model

Redis Analysis - Part 1: Threading model

Following my previous post, we are going start with the “hottest potato” - single-threaded vs multi-threaded argument.

A prelude to analysis of Redis memory-store

A prelude to analysis of Redis memory-store

During the last 13 years, Redis has become a truly ubiquitous memory store that has won the hearts of numerous dev-ops and software engineers.

Switch & save up to 80% 

Dragonfly is fully compatible with the Redis ecosystem and requires no code changes to implement. Instantly experience up to a 25X boost in performance and 80% reduction in cost