Oct 23, 08:02 PDT
Postmortem - On Tuesday 10/22, we had an issue with iOS push notifications that resulted in a portion of our notifications being sent to the wrong devices. We want to explain what happened and describe the steps we're taking to prevent it from happening again.
### What happened
* At Tuesday 10:40am, we pushed out a fix to address an iOS 7 compatibility issue in our iOS app.
* At approximately 1:30pm, we started receiving reports from customers that they were receiving push notifications that did not appear to originate from their accounts. We immediately began investigating and addressing the issue.
* At 2:20pm, we fixed the issue in production.
### Impact of this issue
* This issue affected a small number of our iOS users. These users received push notifications intended for someone else and did not receive any notifications intended for them. The majority of our customers were not impacted.
* The information contained in these push notifications potentially included application names, key transaction names, and/or server names, depending on the origin of the alert. There were also a small number of notifications that included the names of users acknowledging an alert.
* Although users received these notification message on their iOS device, they were not able to actually access the full notification on the New Relic web site.
* The alert only contained the title for the alert. No account IDs or detailed performance data was contained in the alert.
### Looking ahead
* We are currently reviewing out internal processes to determine why this issue was not caught prior to release.
* We're also reviewing how we might further improve our monitoring and response processes to decrease future time-to-resolution.
* Please contact [support@newrelic.com](mailto:support@newrelic.com)[](mailto:security@newrelic.com) if you have additional questions or concerns.
Oct 22, 14:35 PDT
Resolved - We've just deployed a fix for misdirected push notifications. For the duration of this incident, some push notifications were not sent properly (~1930-2020 UTC)
Oct 22, 13:41 PDT
Investigating - We've received reports of invalid Push Notifications of alerts being delivered to some customers.