Solana’s promise of 50,000+ transactions per second and sub-cent fees came with a significant vulnerability in its early years: the network suffered repeated complete outages and severe performance degradations from 2021 to 2022, totaling more than 30 hours of downtime in that period. These incidents damaged Solana’s reputation as an “Ethereum killer,” raised fundamental questions about its architectural tradeoffs, and became a central competitive argument by Ethereum advocates. The network’s reliability improved significantly through 2023–2024 as validator client diversity, fee markets, and QUIC networking upgrades addressed the systemic weaknesses.
Incident Timeline
The development phases are outlined below.
September 14, 2021 — 17-Hour Outage
Duration: ~17 hours. The network was restored only by coordinating a cluster restart — validators manually coordinating to restart from the last confirmed checkpoint. This restart required significant human coordination among the validator set.
Impact: SOL dropped ~10% following the incident. Major trading platforms briefly halted SOL deposits/withdrawals.
Multiple Incidents Q1 2022
| Date | Duration | Primary Cause |
|---|---|---|
| January 21, 2022 | ~30 minutes | Consensus instability |
| February 1, 2022 | ~4 hours | High traffic from NFT minting bots (Candy Machine v1) |
| April 30, 2022 | ~7 hours | Bot traffic from NFT mints overwhelmed compute units |
| June 1, 2022 | ~4.5 hours | Bug in durable nonce transactions triggered validator hang |
The NFT minting bot problem was particularly embarrassing: speculative bots spamming NFT mints could single-handedly degrade the entire network.
May 2022 Instability (Longest Period)
Following the Terra/LUNA collapse in May 2022, Solana’s DeFi protocols saw extraordinary activity. The network experienced intermittent block production slowdowns over multiple days, though without complete consensus failure.
Root Cause Analysis
Solana’s architecture makes it vulnerable to specific failure modes:
- No mempool / no fee market: Solana uses a “Gulf Stream” mechanism (no mempool; validators push transactions forward directly to upcoming block leaders). With no fee market, there’s no spam deterrent — flooding costs virtually nothing
- Memory exhaustion from spam: Validator nodes have fixed memory; excessive transaction ingestion causes OOM (out-of-memory) crashes
- Single-client risk: Until 2023, essentially all validators ran Solana Labs’ original client (Solana Validator). A single bug could take down the entire network
Fixes Implemented (2022–2024)
- QUIC transport protocol (2022): Replaced UDP with QUIC for transaction ingestion, enabling validators to detect and rate-limit spam sources at the transport layer
- Priority fees / fee markets (2022–2023): EIP-1559-style priority fees on Solana, allowing users to pay more to have transactions processed first — creating a spam deterrent
- Validator client diversity: Firedancer (Jump Trading, launched 2024) became the second independent validator client — reducing single-client risk dramatically. Jump’s Firedancer claims to have bench-tested 1M+ TPS
- Stake-weighted QoS: Transactions submitted directly by validators with large stake get priority, reducing effectiveness of anonymous spam
Current Reliability (2023–2024)
Following the upgrades, Solana had no complete outages in 2023. Network performance during the January 2024 BONK memecoin frenzy and the record-breaking February 2024 trading volumes showed significantly improved resilience compared to 2021–2022. The February 2024 network degradation (not a full outage) that affected Jupiter aggregator was resolved with a patch within hours — a marked improvement in incident response.
Related Terms
Sources
- Solana Foundation Status Page (2021–2022). Solana.com/news/.
- Meylan, V. (2022). “Analyzing Solana’s Reliability Problems.” Jump Crypto Blog.
- Spilka, N. (2022). “How Solana Deals with Outages: A Post-Mortem Analysis.” Alchemy Blog.
- Solana Improvement Documents (SIMD-0096): Priority Fee Market Specification (2023).
- Anatoly Yakovenko (2024). “Firedancer Launch and Solana Reliability Improvements.” Twitter/X.