Census Outage History
Census is up right nowPingoru has recorded 50 incidents for Census: 13 in the last 12 months and 5 in the last 90 days.
Show as a table
| Month | Incidents | Hours with an open incident |
|---|---|---|
| April 2026 | 0 | 0 of 720 (0%) |
| May 2026 | 1 | 6 of 744 (1%) |
| June 2026 | 0 | 0 of 720 (0%) |
| July 2026 | 1 | 3 of 744 (0%) |
| August 2026 | 1 | 1 of 744 (0%) |
| September 2026 | 3 | 7 of 720 (1%) |
| October 2026 | 1 | 3 of 526 (1%) |
Incidents, newest first
Major October 1, 2026 Sync Outage in azure-eastus region 3h 16m Sync Engine
Started Oct 01, 2026, 02:20 PM UTC· resolved Oct 01, 2026, 05:36 PM UTC
- identified Oct 01, 2026, 02:20 PM UTC
Syncs running in our azure-eastus region are currently not succeeding due to a partial service outage
- identified Oct 01, 2026, 02:53 PM UTC
Connectivity to Azure Redis continues to be spotty in azure-eastus. Some syncs may see recovery, at least intermittently.
- monitoring Oct 01, 2026, 03:14 PM UTC
Connectivity to Redis in azure-eastus too has been restored. Syncs are now completing successfully. We are continuing to monitor the situation.
- resolved Oct 01, 2026, 05:36 PM UTC
This incident has been resolved.
Major September 16, 2026 LinkedIn Sync Failures - server responding with status 426 3h 50m Census Sync Management UI
Started Sep 16, 2026, 11:42 AM UTC· resolved Sep 16, 2026, 03:33 PM UTC
- identified Sep 16, 2026, 12:42 PM UTC
Some customers are encountering an issue on LinkedIn syncs causing them to fail with the error message "server responded with status 426". Customers may also see new and existing LinkedIn Destination tests fail when testing them. The issue has been identified and the engineering team is working on a fix.
- resolved Sep 16, 2026, 03:33 PM UTC
This incident has now been resolved. You should see impacted syncs recover on the next scheduled run or when triggering it manually. Connecting new LinkedIn destination or testing existing ones should now return the correct response.
Critical September 9, 2026 App failing to load 52m Census Sync Management UI
Started Sep 09, 2026, 04:41 PM UTC· resolved Sep 09, 2026, 05:33 PM UTC
- investigating Sep 09, 2026, 04:41 PM UTC
We are currently investigating the issue where the app is failing to load.
- identified Sep 09, 2026, 04:47 PM UTC
The issue has been identified and the engineering team is working on safely rolling back the change.
- identified Sep 09, 2026, 05:07 PM UTC
We are continuing to work on a fix for this issue.
- monitoring Sep 09, 2026, 05:10 PM UTC
The change has been rolled back and the app is now loading.
- resolved Sep 09, 2026, 05:33 PM UTC
A backend change caused Activation workspaces to fail to load. We rolled back the change which allowed the app to load successfully. Only UI components were impacted, sync runs were unaffected.
Major September 8, 2026 Degraded UI performance 2h 1m Census Sync Management UI
Started Sep 08, 2026, 08:04 PM UTC· resolved Sep 08, 2026, 10:06 PM UTC
- investigating Sep 08, 2026, 08:04 PM UTC
Some organizations are currently experiencing increased latency when running connection tests and loading source and destination objects within the sync editor. Investigation is still ongoing.
- monitoring Sep 08, 2026, 09:02 PM UTC
A fix has been implemented and we are monitoring results.
- resolved Sep 08, 2026, 10:06 PM UTC
This incident has been resolved. A recent change prevented some UI jobs from being processed, causing some notifications to be delayed and dataset previews, sync configuration fields, and connection tests to fail to load successfully
Major August 26, 2026 Facebook (Meta) Sync Failures - API access disrupted 1h 2m Census Sync Management UI, Sync Engine
Started Aug 26, 2026, 01:09 PM UTC· resolved Aug 26, 2026, 02:11 PM UTC
- identified Aug 26, 2026, 01:09 PM UTC
Facebook (Meta) syncs are experiencing failures with the error message - API access disrupted. Go to the App Dashboard and complete Data Use Checkup. An issue related to the Activations Meta app has been identified and a fix is being implemented.
- resolved Aug 26, 2026, 02:11 PM UTC
The incident has now been resolved. All Facebook (Meta) syncs will recover on their next triggered or scheduled run.
Critical July 7, 2026 Service incident impacting app and sync execution 2h 36m Census Sync Management UI, Sync Engine
Started Jul 07, 2026, 03:45 PM UTC· resolved Jul 07, 2026, 06:22 PM UTC
- investigating Jul 07, 2026, 03:45 PM UTC
The engineering team is currently investigating a production issue.
- investigating Jul 07, 2026, 03:45 PM UTC
We are continuing to investigate this issue.
- identified Jul 07, 2026, 03:47 PM UTC
An issue related to a recent database migration has been identified. The engineering team is working on safely rolling back the change.
- identified Jul 07, 2026, 03:54 PM UTC
The web application is operational and sync execution is starting.
- monitoring Jul 07, 2026, 04:01 PM UTC
A fix has been implemented and we're monitoring the results.
- resolved Jul 07, 2026, 06:22 PM UTC
This incident has been resolved and all systems are operational.
Minor May 21, 2026 Microsoft Advertising Sync Failures 6h 19m
Started May 21, 2026, 05:00 PM UTC· resolved May 21, 2026, 11:19 PM UTC
- resolved May 22, 2026, 12:24 AM UTC
Syncs to Microsoft Advertising temporarily experienced failures with an error message like "OAuth2::Error: invalid_client" from approximately 05/21/2026 17:00 UTC - 05/21/20206 23:19 UTC. This error was the result of the Activations Microsoft Advertising app configuration and it has now been resolved. Any impacted syncs will recover on their next scheduled run.
Critical February 26, 2026 Census Web Outage 4m Census Sync Management UI
Started Feb 26, 2026, 12:28 AM UTC· resolved Feb 26, 2026, 12:32 AM UTC
- investigating Feb 26, 2026, 12:28 AM UTC
We are currently investigating the issue.
- resolved Feb 26, 2026, 12:32 AM UTC
The incident has been resolved. Issue determined to be caused due to a configuration change. Configuration change has been reverted.
Minor January 29, 2026 Degraded performance of Web & Sync Runs. 1h 25m Census Sync Management UI
Started Jan 29, 2026, 07:15 PM UTC· resolved Jan 29, 2026, 08:40 PM UTC
- investigating Jan 29, 2026, 07:15 PM UTC
We are currently investigating this issue.
- monitoring Jan 29, 2026, 07:30 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jan 29, 2026, 08:40 PM UTC
This incident has been resolved.
Critical January 5, 2026 Census Full Outage 5h 7m Census Sync Management UI, Sync Engine
Started Jan 05, 2026, 03:17 PM UTC· resolved Jan 05, 2026, 08:24 PM UTC
- identified Jan 05, 2026, 03:17 PM UTC
Census is currently having issues running Syncs and rendering the Website. Engineers have identified the issue and are remediating.
- identified Jan 05, 2026, 03:27 PM UTC
We have identified and triaged the affected system and systems are coming back up now. Web is operational. We will see Sync delays as we scale back up.
- identified Jan 05, 2026, 03:59 PM UTC
We are still seeing degraded performance and in some cases failing syncs. We are continuing efforts to mitigate as the system repairs.
- identified Jan 05, 2026, 04:47 PM UTC
Syncs are currently not operational. Scheduled syncs should still be queuing up but they won't start running at this time. We will provide an update once workers come back up.
- identified Jan 05, 2026, 06:34 PM UTC
Syncs are now operational. Users may be experiencing issues loading Sync Configuration and Sync Run details on the web.
- monitoring Jan 05, 2026, 07:05 PM UTC
The web is now operating normally, along with Sync Runs. We are monitoring the system for overall health.
- resolved Jan 05, 2026, 08:24 PM UTC
This incident has been resolved. Syncs have been running normally as of approximately 1:00pm EST, and the web has been running at normal latencies as of 2:00pm EST. The issue was caused by an indexing change on our side that impacted our ability to run syncs reliably. Recovery was delayed because we needed to rebuild the previous indexes. To avoid any risk of data loss, we chose a safer recovery approach that allowed the system to remain temporarily degraded while repairs were being completed. To restore syncs as quickly as possible, we prioritized sync execution and applied targeted fixes to improve performance. During this time, access to the UI was temporarily down.
Minor December 11, 2025 Census Web Outage and Sync Delays 35m Census Sync Management UI, Sync Engine
Started Dec 11, 2025, 06:32 PM UTC· resolved Dec 11, 2025, 07:07 PM UTC
- identified Dec 11, 2025, 06:32 PM UTC
Census is experiencing an outage on web, and we are experiencing degraded sync run activity. We have identified the cause and have applied the fix. We are monitoring system recovery.
- monitoring Dec 11, 2025, 06:39 PM UTC
Census Web has recovered and we are analyzing Sync Runs for impact.
- resolved Dec 11, 2025, 07:07 PM UTC
After investigation, a very small number of Sync Runs may have failed with an inability to connect to our Redis instance. The majority of syncs that ran between 1:19 pm and 1:28 pm EST will have experienced a few minutes of delay, and recovered automatically.
Minor November 12, 2025 Subset of syncs are failing with, "Passed `nil` into T.must" 2h 19m Sync Engine
Started Nov 12, 2025, 05:41 PM UTC· resolved Nov 12, 2025, 08:01 PM UTC
- identified Nov 12, 2025, 05:41 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring Nov 12, 2025, 06:30 PM UTC
The error impacting some customer syncs has now been resolved and syncs are recovering. The syncs impacted were runs with no new data changes to process. This happened due to a recent update that removed the part of our system that correctly handled "no change" scenarios. As a result, syncs without updates failed instead of completing successfully. Syncs with actual data changes were unaffected. We've rolled back the change, and all syncs are now running normally.
- monitoring Nov 12, 2025, 06:30 PM UTC
The error impacting some customer syncs has now been resolved and syncs are recovering. The syncs impacted were runs with no new data changes to process. This happened due to a recent update that removed the part of our system that correctly handled "no change" scenarios. As a result, syncs without updates failed instead of completing successfully. Syncs with actual data changes were unaffected. We've rolled back the change, and all syncs are now running normally.
- resolved Nov 12, 2025, 08:01 PM UTC
This incident has been resolved.
Minor October 29, 2025 Minor Delays in Census Syncs (US Region) 56m Sync Engine
Started Oct 29, 2025, 02:13 AM UTC· resolved Oct 29, 2025, 03:09 AM UTC
- investigating Oct 29, 2025, 02:13 AM UTC
We are currently investigating minor delays affecting some Census Sync job types in the US region. Most syncs are completing successfully, though some may take longer than usual.
- identified Oct 29, 2025, 02:53 AM UTC
We’ve identified the cause of the minor delays and implemented a fix. Sync performance returning back to normal. We’re monitoring to ensure continued stability.
- resolved Oct 29, 2025, 03:09 AM UTC
Delays have been resolved. Syncs are running normally again.
Minor October 20, 2025 Delays in Background Jobs 10h 42m Sync Engine
Started Oct 20, 2025, 01:43 PM UTC· resolved Oct 21, 2025, 12:26 AM UTC
- identified Oct 20, 2025, 01:43 PM UTC
In our US region, we are seeing increased latency in non-sync background tasks like metadata refreshes and connection tests due to issues scaling up worker load to match demand, as a result of the continued downstream provider outage. We have identified the issue and are now mitigating the impact.
- identified Oct 20, 2025, 04:07 PM UTC
Non-sync background tasks are running normally. Email notifications are still delayed. We have detected syncs that are currently stuck in working state due to issues earlier in the day. We are working to unblock them.
- identified Oct 20, 2025, 05:54 PM UTC
We are seeing increases in Sync runtimes as we continue to experience issues adding new workers to our pool. We are continuing work to mitigate this issue.
- monitoring Oct 20, 2025, 06:52 PM UTC
We're now able to appropriately scale workers to meet demands. We are through our main backlogs (including mail sends), and Sync run latencies have improved substantially. We are still continuing to see transient errors throughout Sync runs, mainly dealing with issues hitting our Redis instances, but the frequency of these errors is continuing to decrease.
- monitoring Oct 20, 2025, 08:51 PM UTC
Our systems show sustained recovery and remain stable. We will continue to monitor for any further issues.
- resolved Oct 21, 2025, 12:26 AM UTC
Our system has been operating normally for the last few hours, and the aforementioned downstream provider has marked their incident as resolved. We are marking the sync engine as operational. Please contact support if you believe you are continuing to see issues.
Notice October 20, 2025 Major Service Degradation 3h 30m
Started Oct 20, 2025, 07:00 AM UTC· resolved Oct 20, 2025, 10:30 AM UTC
- resolved Oct 20, 2025, 11:09 AM UTC
Census experienced major service degradation for running Syncs and on the web for users viewing Sync details for a period of about 3 hours, from 2:46 am EST until 5:30 am EST, due to a large-scale downstream provider outage. All systems are now operational.
Minor September 19, 2025 Intermittent Page Load Fails 8m Census Sync Management UI
Started Sep 19, 2025, 04:41 PM UTC· resolved Sep 19, 2025, 04:50 PM UTC
- investigating Sep 19, 2025, 04:41 PM UTC
We have detected intermittent page load failures on the Census UI due to DNS. Our team is investigating the root cause. Sync runs are unaffected.
- resolved Sep 19, 2025, 04:50 PM UTC
This incident has been resolved and page loads are now fully operational. During a system upgrade it was determined that our DNS resolver returned empty values for app.getcensus.com for a brief point - our team will continue investigating the root cause of why this occurred.
Minor July 15, 2025 Census unable to send any emails 2h 8m Census Sync Management UI
Started Jul 15, 2025, 04:35 PM UTC· resolved Jul 15, 2025, 06:44 PM UTC
- investigating Jul 15, 2025, 04:35 PM UTC
We have identified an incident that has caused Census to stop sending all emails. This includes emails related to sync alerts as well as password reset emails and verification emails for new account signups. We are working to remediate the issue. The Census UI and Sync Engine are not otherwise affected
- monitoring Jul 15, 2025, 06:31 PM UTC
We have updated the our configurations for sending emails and we are currently verifying the fix.
- resolved Jul 15, 2025, 06:44 PM UTC
This incident has been resolved.
Notice July 3, 2025 AWS Incident Being Monitored - No Production Impact Yet 13m
Started Jul 03, 2025, 01:58 AM UTC· resolved Jul 03, 2025, 02:11 AM UTC
- monitoring Jul 03, 2025, 01:58 AM UTC
There are no known problems in production but we are monitoring this AWS incident presently as it has impacted some things in our staging environment. https://health.aws.amazon.com/health/status
- resolved Jul 03, 2025, 02:11 AM UTC
AWS has marked this as resolved.
Minor June 12, 2025 GCP Outage May Affect Syncs to and from Google Resources 2h 35m Sync Engine
Started Jun 12, 2025, 06:30 PM UTC· resolved Jun 12, 2025, 09:05 PM UTC
- monitoring Jun 12, 2025, 06:30 PM UTC
We are aware of the current GCP outage and we are monitoring its impact on Census syncs to and from Google and Google Cloud Resources. Census does not run any critical components on GCP but we do use GCP resources, including Cloud Storage, to facilitate interaction with BigQuery and other Google Cloud resources.
- monitoring Jun 12, 2025, 06:37 PM UTC
Internal monitoring indicates that syncs to and from BigQuery started experiencing increased failure rates at around 18:05 UTC. The rate of failures is now decreasing but has not returned to usual levels.
- monitoring Jun 12, 2025, 08:19 PM UTC
Our monitoring systems continue to see a sustained error rate when communicating with Google BigQuery. We will monitor and report when the issue is resolved from Census' perspective. Google Cloud has provided additional information on their status page, located here: https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW
- resolved Jun 12, 2025, 09:05 PM UTC
Census systems remain unaffected as GCP comes back online. We are now seeing the majority of our GCP hosted customers have successful syncs.
Notice June 6, 2025 Sync Runs Failing with Undefined Column Error 26m Sync Engine
Started Jun 06, 2025, 05:52 PM UTC· resolved Jun 06, 2025, 06:18 PM UTC
- monitoring Jun 06, 2025, 05:52 PM UTC
Some syncs started failing with the following error at 12:18pm (EST) "ActiveRecord::StatementInvalid: PG::UndefinedColumn: ERROR: column sync_configurations.new_diff_timestamp_expression_id does not exist" This was due to a brief issue during a schema update. The problem has been resolved, and we are monitoring.
- resolved Jun 06, 2025, 06:18 PM UTC
This incident has been resolved.
Major June 4, 2025 Sync list UI not loading 43m Census Sync Management UI
Started Jun 04, 2025, 08:11 PM UTC· resolved Jun 04, 2025, 08:54 PM UTC
- identified Jun 04, 2025, 08:11 PM UTC
The Census sync list UI is not loading for some customers. We have identified a faulty deployment and we are reverting it. The sync engine is not affected.
- identified Jun 04, 2025, 08:24 PM UTC
A fix for this issue is currently being deployed and will be in place in the next 15-30 minutes
- monitoring Jun 04, 2025, 08:43 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jun 04, 2025, 08:54 PM UTC
This incident has been resolved.
Notice May 28, 2025 Web Outage 1h 32m
Started May 28, 2025, 02:00 PM UTC· resolved May 28, 2025, 03:32 PM UTC
- resolved May 28, 2025, 03:45 PM UTC
During a window of time from 9:58 am EST until 10:32 am EST, the Census web UI, and a portion of the Census Public Management API experienced an outage. Sync Runs were unaffected and operated normally.
Notice April 21, 2025 Some syncs failing with "T.cast: Expected type T::Struct, got type TrueClass" – Sync Engine
Started Apr 21, 2025, 07:33 PM UTC· resolved Apr 21, 2025, 07:33 PM UTC
- resolved Apr 21, 2025, 07:33 PM UTC
A recent code change introduced a bug resulting in some syncs failing with the message "T.cast: Expected type T::Struct, got type TrueClass". This impacted sync runs where there were no incremental changes identified and the source connection utilizes the Advanced Sync Engine. We identified the problematic change, and have reverted. Syncs are now running successfully.
Minor April 16, 2025 Background job delays (Syncs not impacted) 23m Census Sync Management UI
Started Apr 16, 2025, 11:31 PM UTC· resolved Apr 16, 2025, 11:54 PM UTC
- identified Apr 16, 2025, 11:31 PM UTC
We've identified an issue that caused background jobs to be delayed. The issue does not impact running syncs.
- monitoring Apr 16, 2025, 11:36 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Apr 16, 2025, 11:54 PM UTC
This incident has been resolved.
Major April 4, 2025 Sync might be failing with mismatch errors 17h 42m Sync Engine
Started Apr 04, 2025, 10:40 PM UTC· resolved Apr 05, 2025, 04:23 PM UTC
- investigating Apr 04, 2025, 10:40 PM UTC
We are currently investigating issue with some syncs failing with mismatch errors.
- monitoring Apr 04, 2025, 11:00 PM UTC
We experienced a performance issue from ~3:00-3:15pm Pacific that may have caused some syncs to fail with a message about "mismatch counts". We believe we have resolved the problem, but syncs that encountered the issue may not report an error until sometime after the fact, so errors may continue to trickle in. If you encounter this error, please attempt to rerun your sync. If a rerun does not succeed, please contact support.
- monitoring Apr 05, 2025, 01:18 AM UTC
This issue is resolved.
- monitoring Apr 05, 2025, 04:21 PM UTC
We are continuing to monitor for any further issues.
- resolved Apr 05, 2025, 04:23 PM UTC
This incident has been resolved.