Allium Outage History
Allium is up right nowPingoru has recorded 56 incidents for Allium: 52 in the last 12 months and 9 in the last 90 days.
Show as a table
| Month | Incidents | Hours with an open incident |
|---|---|---|
| April 2026 | 5 | 110 of 720 (15%) |
| May 2026 | 5 | 69 of 744 (9%) |
| June 2026 | 3 | 47 of 720 (6%) |
| July 2026 | 5 | 232 of 744 (31%) |
| August 2026 | 1 | 15 of 744 (2%) |
| September 2026 | 8 | 266 of 720 (37%) |
| October 2026 | 0 | 0 of 558 (0%) |
Incidents, newest first
Notice September 22, 2026 Cosmos Chain stalled 2d 4h
Started Sep 22, 2026, 03:49 PM UTC· resolved Sep 24, 2026, 07:55 PM UTC
- monitoring Sep 22, 2026, 03:49 PM UTC
We are currently having ingestion issues with Cosmos as the chain seems to have stalled. Will monitor the situation and ingestion will resume once the chain is back online.
- monitoring Sep 23, 2026, 06:38 PM UTC
The chain seems to have resumes, ingestion is in steady state but we will still be monitoring the situation.
- resolved Sep 24, 2026, 07:55 PM UTC
This incident has been resolved.
Major September 21, 2026 Hyperliquid API degradation 1h 40m Hyperliquid Endpoints
Started Sep 21, 2026, 07:56 AM UTC· resolved Sep 21, 2026, 09:37 AM UTC
- investigating Sep 21, 2026, 07:56 AM UTC
We are currently experiencing degraded ingestion in one of our Hyperliquid orders ingestion flows, which may result in incomplete data for affected users of the hyperliquid API. Our team is actively investigating the issue and working to restore normal ingestion as quickly as possible. We will provide an update here as soon as we have more information.
- monitoring Sep 21, 2026, 08:40 AM UTC
We have identified the cause of the issue and implemented a fix. Hyperliquid order ingestion has returned to normal, and new data flowing into the Postgres tables is complete and accurate.
- resolved Sep 21, 2026, 09:37 AM UTC
We have investigated the root cause and found that a new upstream feature, Trailing Stops, introduced a longer trigger_condition value than our Postgres schema accounted for, causing writes to fail. We widened the column to accommodate it, and the pipeline was fully recovered by 08:30 UTC.
Minor September 11, 2026 Delayed data ingestion on several chains 15m Batch Ingestion System
Started Sep 11, 2026, 04:50 PM UTC· resolved Sep 11, 2026, 05:05 PM UTC
- investigating Sep 11, 2026, 04:50 PM UTC
We are currently investigating an issue with several chains. At this time, users may experience data delays, elevated latency, or intermittent timeouts when querying recent data for these networks. All other supported chains, historical data, and other endpoints are not affected and continue to operate normally. We'll continue to share updates as we have them.
- monitoring Sep 11, 2026, 05:01 PM UTC
Update: The situation is largely recovered and services are returning to normal. - All other chains are fully back to normal. - Beacon chain is currently the only chain still recovering/catching up, and our team is closely monitoring it. We'll provide a final confirmation once Beacon Chain is completely back to baseline.
- monitoring Sep 11, 2026, 05:01 PM UTC
We are continuing to monitor for any further issues.
- resolved Sep 11, 2026, 05:05 PM UTC
This incident has been resolved.
Notice September 8, 2026 Solana Testnet Chain stalled 7d 17h
Started Sep 08, 2026, 08:59 PM UTC· resolved Sep 16, 2026, 02:08 PM UTC
- monitoring Sep 08, 2026, 08:59 PM UTC
We are currently having ingestion issues with Solana Testnet as the chain seems to have stalled. Will monitor the situation and ingestion will resume once the chain is back online.
- resolved Sep 16, 2026, 02:08 PM UTC
This incident has been resolved.
Minor September 4, 2026 Robinhood Ingestion Degradation 6h 18m Batch Ingestion System
Started Sep 04, 2026, 01:22 PM UTC· resolved Sep 04, 2026, 07:41 PM UTC
- identified Sep 04, 2026, 01:22 PM UTC
We are investigating increased latency from our RPC providers on RobinHood Mainnet.,
- monitoring Sep 04, 2026, 01:34 PM UTC
The Robinhood endpoints are recovering and we are actively monitoring the system.
- monitoring Sep 04, 2026, 07:41 PM UTC
We are continuing to monitor for any further issues.
- resolved Sep 04, 2026, 07:41 PM UTC
This incident has been resolved.
Notice September 3, 2026 Monad Ingestion Degradation 11h 45m Batch Ingestion System
Started Sep 03, 2026, 03:03 AM UTC· resolved Sep 03, 2026, 02:48 PM UTC
- monitoring Sep 03, 2026, 03:03 AM UTC
Due to an increase in Monad load, our ingestion system has been degraded. We have scaled up the systems and are actively monitoring the situation.
- monitoring Sep 03, 2026, 03:03 AM UTC
We are continuing to monitor for any further issues.
- resolved Sep 03, 2026, 02:48 PM UTC
All affected data has now been patched and incident is resolved.
Notice August 30, 2026 Incomplete token prices for batch data 15h 9m Solana, Hyperliquid, Ethereum, Beacon and 10 more
Started Aug 30, 2026, 06:53 PM UTC· resolved Aug 31, 2026, 10:03 AM UTC
- identified Aug 30, 2026, 06:53 PM UTC
We had an issue with our token prices data provider, causing missing token prices from 30 Aug 01:30 to 05:11 UTC. The immediate issue was resolved at 05:11 UTC and prices since then are complete. We are currently backfilling token prices during the affected time range.
- identified Aug 30, 2026, 06:54 PM UTC
We are continuing to work on a fix for this issue.
- resolved Aug 31, 2026, 10:03 AM UTC
Batch data has been patched and incident has since been resolved
Minor July 22, 2026 Solana testnet ingestion halted 4d 23h Batch Ingestion System
Started Jul 22, 2026, 03:02 AM UTC· resolved Jul 27, 2026, 02:47 AM UTC
- identified Jul 22, 2026, 03:02 AM UTC
Our team has identified the cause of a Solana testnet ingestion issue, and is working toward a resolution. The issue is the result of upstream network and RPC instability on Solana testnet. A fix is pending upstream, and we are monitoring for recovery. At this time, customers consuming Solana testnet data may experience missing, incomplete, or delayed data. Solana mainnet is unaffected, and all other chains are unaffected. We'll continue to share updates as we have them.
- resolved Jul 27, 2026, 02:47 AM UTC
This incident has been resolved.
Minor July 15, 2026 Canton chain data ingestion experiencing delays 4d Batch Ingestion System, Other Ecosystems, Other Ecosystems
Started Jul 15, 2026, 11:40 PM UTC· resolved Jul 20, 2026, 12:39 AM UTC
- investigating Jul 15, 2026, 11:40 PM UTC
We are investigating delayed data for Canton chain due to upstream provider issues. Canton tables have incomplete data for blocks starting 15 July 21:00 UTC.
- resolved Jul 20, 2026, 12:39 AM UTC
All affected data has now been patched and the incident is resolved.
Minor July 8, 2026 Robinhood chain data ingestion experiencing degraded performance 6h 12m Prices Endpoints, Realtime Ingestion System, Batch Ingestion System, EVM
Started Jul 08, 2026, 08:54 PM UTC· resolved Jul 09, 2026, 03:06 AM UTC
- investigating Jul 08, 2026, 08:54 PM UTC
Our robinhood chain data is currently experiencing degraded performance due to issues with RPC performance. We are currently isolating the issue and working on mitigations.
- investigating Jul 08, 2026, 09:10 PM UTC
We have made configuration changes to our RPCs and we are seeing some signs of recovery. We are continuing our mitigation efforts and will keep you posted.
- identified Jul 08, 2026, 10:26 PM UTC
We have mitigated the steady state data ingestion, and are working to patch any missing data caused due to the incident.
- identified Jul 09, 2026, 01:37 AM UTC
We are continuing to work on a fix for this issue.
- identified Jul 09, 2026, 02:18 AM UTC
All affected data has now been patched and incident is resolved.
- resolved Jul 09, 2026, 03:06 AM UTC
This incident has been resolved.
Major July 7, 2026 Optimism Mainnet Network Stalled at Block 153924191 5h 36m Realtime Ingestion System, Batch Ingestion System
Started Jul 07, 2026, 06:23 PM UTC· resolved Jul 08, 2026, 12:00 AM UTC
- investigating Jul 07, 2026, 06:23 PM UTC
Optimism Mainnet appears to have stalled at block 153924191. The Allium team is investigating and will update this page as more information becomes available.
- monitoring Jul 07, 2026, 06:34 PM UTC
Optimism Mainnet block height is advancing again. Continuing to monitor the situation.
- resolved Jul 08, 2026, 12:00 AM UTC
The Optimism Mainnet network stall at block 153924191 has been resolved. The network is advancing normally. We will continue to monitor for stability.
Minor July 6, 2026 Delayed batch data 3h 50m Beacon, Base
Started Jul 06, 2026, 09:29 AM UTC· resolved Jul 06, 2026, 01:19 PM UTC
- investigating Jul 06, 2026, 09:29 AM UTC
We are currently investigating this issue.
- identified Jul 06, 2026, 09:34 AM UTC
We've identified the issue and are currently rolling out a fix in our ingestion pipeline. Affected chains: - base - beacon - bsc - lighter - polygon
- resolved Jul 06, 2026, 01:19 PM UTC
This incident has been resolved.
Minor June 26, 2026 Apechain Halted 3h 3m Explorer UI, Prices Endpoints, Explorer Queries, Wallets Endpoints and 2 more
Started Jun 26, 2026, 02:02 AM UTC· resolved Jun 26, 2026, 05:05 AM UTC
- monitoring Jun 26, 2026, 02:02 AM UTC
Apechain is currently halted. We are currently monitoring and will keep you informed on the situation.
- monitoring Jun 26, 2026, 02:05 AM UTC
We are continuing to monitor for any further issues.
- resolved Jun 26, 2026, 05:05 AM UTC
This incident has been resolved.
Major June 25, 2026 Base Chain Halted 2h 25m Explorer UI, Prices Endpoints, Explorer Queries, Wallets Endpoints and 2 more
Started Jun 25, 2026, 04:22 PM UTC· resolved Jun 25, 2026, 06:47 PM UTC
- monitoring Jun 25, 2026, 04:22 PM UTC
The Base chain is currently halted. We are currently monitoring and will keep you informed on the situation
- monitoring Jun 25, 2026, 04:25 PM UTC
We are continuing to monitor for any further issues. Current status can be viewed here: https://status.base.org/incidents/5c4gm1wzbjs4
- monitoring Jun 25, 2026, 04:28 PM UTC
We are continuing to monitor for any further issues.
- resolved Jun 25, 2026, 06:47 PM UTC
This incident has been resolved.
Minor June 11, 2026 Degraded performance on replicated regions 1d 16h Solana, Hyperliquid, Ethereum, Beacon and 9 more
Started Jun 11, 2026, 01:21 AM UTC· resolved Jun 12, 2026, 06:20 PM UTC
- investigating Jun 11, 2026, 01:21 AM UTC
Our team is investigating degraded performance on replicated regions for Datashares. At this time, customers consuming Allium data via Snowflake shares in replicated (non-GCP-us-central-1) regions may experience delayed data freshness and slower-than-usual replication.
- monitoring Jun 11, 2026, 01:57 AM UTC
Our team has implemented a fix to resolve the degraded performance on replicated regions, and is monitoring the situation. Replication throughput on Datashares is recovering and freshness is catching up to the primary region.
- monitoring Jun 12, 2026, 07:16 AM UTC
Replication throughput on Datashares has recovered for all chains except Solana, which remains degraded. Ethereum, Arbitrum, BSC, Base, Bitcoin, Hyperliquid, Beacon, and the EVM / UTXO / Cosmos / Move / Other ecosystem shares are back to normal freshness. The Solana replication delay is the result of an issue with an upstream vendor. We are actively engaged with the vendor to unblock replication and will continue to monitor until Solana is fully caught up.
- resolved Jun 12, 2026, 06:20 PM UTC
This incident has been resolved.
Notice May 29, 2026 Sui No Data -- Network is down 2d Realtime Ingestion System, Batch Ingestion System
Started May 29, 2026, 01:46 PM UTC· resolved May 31, 2026, 01:48 PM UTC
- monitoring May 29, 2026, 01:46 PM UTC
No data for sui, as the network is currently stalled at block 280,912,461. We are monitoring.
- monitoring May 29, 2026, 04:52 PM UTC
A fix has been implemented on the upstream Sui network, and Sui ingestion on Allium has resumed as of 15:50 UTC. We are continuing to monitor the recovery.
- monitoring May 30, 2026, 02:42 PM UTC
Sui experienced a second network stall starting ~21:35 UTC on 2026-05-29 during an epoch transition. Allium ingestion fully recovered by 02:21 UTC on 2026-05-30 and has been stable since. We are continuing to monitor through the next epoch boundary before resolving.
- resolved May 31, 2026, 01:48 PM UTC
This incident has been resolved.
Minor May 28, 2026 Sui ingestion halted - upstream network issue 10h 52m Move Ecosystem, Move Ecosystem
Started May 28, 2026, 02:34 PM UTC· resolved May 29, 2026, 01:26 AM UTC
- identified May 28, 2026, 02:34 PM UTC
Our team is investigating a freshness degradation on Sui data. At this time, customers consuming Sui realtime data, datastreams or datashares may experience delayed or stalled data. The cause appears to be an upstream Sui network issue, not an Allium pipeline issue. Our ingestion will resume automatically once the Sui network resumes producing checkpoints. Historical Sui data is unaffected. Other chains and ecosystems are unaffected.
- monitoring May 28, 2026, 10:24 PM UTC
A fix has been implemented on the upstream Sui network, and Sui ingestion on Allium has resumed as of 21:00 UTC. We are continuing to monitor the recovery.
- resolved May 29, 2026, 01:26 AM UTC
This incident has been resolved. Sui data ingestion has been restored and is stable since 21:00 UTC.
Major May 20, 2026 Solana token transfers data quality degradation 1h 40m Solana, Solana
Started May 20, 2026, 01:53 AM UTC· resolved May 20, 2026, 03:34 AM UTC
- identified May 20, 2026, 01:53 AM UTC
Our team has identified the cause of a data quality degradation in Solana token transfers, and is actively rolling out a fix. At this time, users querying Solana token transfers data may experience incorrect or incomplete values within the affected window. Other Solana datasets (blocks, transactions, instructions, DEX trades) and other chains are unaffected. The fix is rolling out now. Once deployed, we will backfill the affected window and verify before marking the incident resolved. We'll continue to share updates as we have them.
- monitoring May 20, 2026, 02:45 AM UTC
Our team has identified the cause of the Solana token transfers data quality degradation and the fix has been rolled out. Going-forward ingestion is healthy, and recent data from the past month is clean. We are now in the process of pruning ingested data affected by the prior defect (2026-05-19). We'll continue to update you here as the cleanup progresses.
- resolved May 20, 2026, 03:34 AM UTC
Our team has resolved the Solana token transfers data quality degradation, and Solana token transfers should now be fully operational for all users. The historical cleanup is complete and the affected data has been pruned and reconciled. If you continue to experience an issue, please open a ticket with our support team. Thanks for your patience with us!
Major May 19, 2026 Explorer queries returning no data 47m Explorer UI, Explorer Queries
Started May 19, 2026, 08:26 PM UTC· resolved May 19, 2026, 09:13 PM UTC
- investigating May 19, 2026, 08:26 PM UTC
Our team is investigating an issue with Explorer Queries where queries are not returning data. At this time, users running queries in Explorer may see empty result sets or failed queries. Underlying data is intact. Realtime APIs, Datastreams, and Datashares are unaffected.
- monitoring May 19, 2026, 08:27 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved May 19, 2026, 09:13 PM UTC
Our Explorer query result fetching and storage pipeline experienced a temporary disruption that delayed or failed some queries between 19:37-20:19 UTC. The issue has been resolved, and we are implementing enhanced monitoring and automatic remediation to detect and resolve similar issues faster in the future.
Minor May 4, 2026 Degraded Chain State: Polygon 6h 20m Realtime Ingestion System, Other Ecosystems
Started May 04, 2026, 11:27 AM UTC· resolved May 04, 2026, 05:47 PM UTC
- investigating May 04, 2026, 11:27 AM UTC
We are currently investigating issues with the polygon chain ingestion pipeline.
- monitoring May 04, 2026, 05:17 PM UTC
We have addressed the issue in our ingestion pipeline and resolved it. Data gaps in the affected window have been patched.
- resolved May 04, 2026, 05:47 PM UTC
This incident has been resolved.
Major April 30, 2026 API prices and balances suffering from a high error rate 9h 28m Prices Endpoints, Hyperliquid Endpoints
Started Apr 30, 2026, 03:35 PM UTC· resolved May 01, 2026, 01:04 AM UTC
- investigating Apr 30, 2026, 03:35 PM UTC
We are currently investigating the issue.
- monitoring Apr 30, 2026, 03:50 PM UTC
We have deployed a fix.
- resolved May 01, 2026, 01:04 AM UTC
This incident has been resolved.
Notice April 26, 2026 HyperEVM Freshness Degraded 26m
Started Apr 26, 2026, 10:48 PM UTC· resolved Apr 26, 2026, 11:15 PM UTC
- investigating Apr 26, 2026, 10:48 PM UTC
We are currently investigating this issue.
- resolved Apr 26, 2026, 11:15 PM UTC
This incident has been resolved.
Minor April 24, 2026 BSC Freshness Degraded 3h 2m BSC, BSC
Started Apr 24, 2026, 05:13 PM UTC· resolved Apr 24, 2026, 08:16 PM UTC
- investigating Apr 24, 2026, 05:13 PM UTC
We are currently investigating this issue.
- identified Apr 24, 2026, 05:41 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring Apr 24, 2026, 05:45 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Apr 24, 2026, 08:16 PM UTC
This incident has been resolved.
Minor April 16, 2026 Snowflake freshness is delayed 4d 1h Explorer UI, Snowflake Snowflake Data Warehouse (Database), Explorer Queries
Started Apr 16, 2026, 04:07 AM UTC· resolved Apr 20, 2026, 06:00 AM UTC
- investigating Apr 16, 2026, 04:07 AM UTC
Our data provider is facing compute execution errors and data is failing to be refreshed. We've escalated the issue and waiting for updates.
- investigating Apr 16, 2026, 08:47 AM UTC
Our data provider is still investigating and we will provide an update as soon as they have definitive findings.
- monitoring Apr 17, 2026, 06:28 AM UTC
Our data provider has identified the issue and systems are stable now. We're currently verifying the data in Snowflake.
- monitoring Apr 20, 2026, 05:34 AM UTC
The incident is resolved, and gaps of data in the affected window 16/04/2026 to 17/04/2026 (UTC) have been patched.
- resolved Apr 30, 2026, 07:27 AM UTC
This incident has been resolved.
Minor April 6, 2026 Wallet balances and Prices developer APIs experiencing issues 14m Prices Endpoints, Wallets Endpoints, Holdings Endpoints
Started Apr 06, 2026, 03:54 PM UTC· resolved Apr 06, 2026, 04:08 PM UTC
- investigating Apr 06, 2026, 03:54 PM UTC
Wallet balances and Prices developer APIs experiencing higher error rates
- investigating Apr 06, 2026, 03:59 PM UTC
We are continuing to investigate this issue.
- resolved Apr 06, 2026, 04:08 PM UTC
The issue has been identified and remediated. All APIs are healthy since 16:01 UTC.