- GigaElixir Gazette
- Posts
- Stop Using Redis for Background Jobs
Stop Using Redis for Background Jobs
Your database beats external queues every time
Welcome to GigaElixir Gazette, your 5-minute digest of Elixir ecosystem news that actually matters 👋.
Coming This Week to Gigalixir: New Go-Based CLI Fixes Python Pain
If our CLI ever broke on your machine because of Python version conflicts, this one’s for you.
We rewrote the entire thing in Go.
Now you get a single binary. No dependencies. No pip. No conflicts.
Even your old scripts will still work with a compatibility flag. Download it, run it, deploy with no drama.
. WEEKLY PICKS .
💼 Why Finding Elixir Talent Isn't Actually Hard:
Fresh analysis from the Reddit community reveals that companies struggling to find Elixir developers are looking in the wrong places. ElixirForum, Slack channels, and consultancies like DockYard, LaunchScout, and Test Double consistently deliver quality talent. Multiple experienced developers immediately responded to hiring posts, contradicting the "talent shortage" narrative.
The breakthrough most teams miss: Elixir developers gravitate toward community-driven platforms rather than traditional job boards. Smart companies post detailed requirements with clear rates, while others waste time on generic freelance platforms that Elixir experts avoid.
🌐 WebAssembly Breakthrough Brings Elixir to Every Browser:
Software Mansion just launched Popcorn, enabling Elixir code execution directly in browsers via WebAssembly. Built on AtomVM instead of full BEAM, it provides JavaScript interop, process spawning, and client-side compilation. Early demos show functional REPL and interactive guides running entirely in-browser.
This changes everything about Elixir education and prototyping. Browser-based Livebook, local-first applications, and LiveView hooks written in Elixir become possible. The key insight: AtomVM's microcontroller design makes it WebAssembly-compatible where full BEAM isn't.
⚡ LiveVue 0.6.0 Eliminates the Props Update Wasteland:
A major release just dropped for LiveVue, the Phoenix LiveView + Vue integration, featuring automated JSON Patch diffs that slash WebSocket payload by 90%+ for complex data structures. Instead of sending entire objects, only changed properties cross the wire. New utilities include usePhxNavigation, useLiveEvent, and enhanced testing support.
What matters here: this solves the performance penalty that hybrid approaches typically suffer. Smart teams can now combine LiveView's server-side benefits with Vue's client-side sophistication without the bandwidth explosion that usually kills such integrations.
🎯 Distributed Cache Built with Pure Elixir Dominates Redis:
New evidence suggests building distributed caches with Elixir's native capabilities outperforms traditional Redis setups. Using rendezvous hashing and distributed Erlang, developers can create multi-node caches with automatic failover and zero external dependencies. The approach eliminates network serialization overhead while delivering sub-millisecond access times.
The hidden advantage: when nodes join or leave, only affected keys need redistribution rather than full reshuffling. Combined with GenServer + ETS storage, this creates caches that scale seamlessly without the operational complexity Redis introduces.
🤖 Computer Vision in Elixir Rivals Python (87% Accuracy Proof):
A comprehensive tutorial demonstrates fine-tuning YOLO models for soccer detection using Elixir's YOLO library, achieving 87% mAP50 accuracy on player, referee, goalkeeper, and ball detection. The process shows converting PyTorch models to ONNX for Elixir consumption, then running inference in LiveBook with real-time visualization.
This explains why ML teams are choosing Elixir over Python: unified stack benefits without separate services. Teams can now prototype AI features in Elixir rather than building separate Python services, maintaining competitive accuracy while reducing operational complexity.
. PRO TIPS .

Your Database Beats Redis for Background Jobs Every Time
Paweł Świątkowski just mapped out why the Elixir ecosystem abandoned Redis-backed job queues like Exq in favor of database-backed solutions like Oban. While everyone else copies Ruby's Sidekiq pattern with external Redis, smart Elixir teams discovered their existing database provides superior guarantees with less infrastructure complexity.
The breakthrough insight: transactionality solves the nightmare scenario where jobs get scheduled but transactions roll back. With Redis-backed systems, you schedule a welcome email, the user creation fails, but the email still sends because it lives in a separate database. Oban eliminates this by making job scheduling part of your database transaction - if the transaction fails, the job disappears too.
Here's the technical advantage that changes everything: Oban.insert!/1
looks just like Repo.insert!/1
because it literally is a database insert. Jobs remain invisible to workers until transactions commit, and rollbacks automatically cancel scheduled work. This isn't just cleaner code - it's fundamentally more reliable than external queue coordination.
The performance angle most teams miss: eliminating Redis removes serialization overhead, reduces infrastructure costs, and leverages your existing database connection pool. While Ruby developers accept Redis as infrastructure tax, Elixir teams realized their database already provides everything needed for robust job processing with ACID guarantees that external queues can't match.
Remember, for background job architecture:
Use database transactions to prevent orphaned jobs from failed operations
Eliminate Redis infrastructure complexity unless you specifically need Sidekiq compatibility
Leverage Oban's transactional guarantees for reliable job scheduling
Choose Task for simple fire-and-forget work that doesn't need durability
. TIRED OF DEVOPS HEADACHES? .
Deploy your next Elixir app hassle-free with Gigalixir and focus more on coding, less on ops.
We're specifically designed to support all the features that make Elixir special, so you can keep building amazing things without becoming a DevOps expert.
See you next week,
Michael
P.S. Forward this to a friend who loves Elixir as much as you do 💜