Deployment of PROD-294, PROD-299 - Minimal customer impact
Scheduled Maintenance Report for SecureAuth Service
Update
Scheduled maintenance has been completed.

During our scheduled maintenance this evening, while making improvements to strengthen our back-end systems, we experienced an intermittent outage for SMS and TTS services over a period of 7 minutes from 21:17 to 21:23 (EST). We have had no reports of any customer impact and all systems are currently operational.
Posted Oct 24, 2018 - 20:01 PDT
Completed
The scheduled maintenance has been completed.
Posted Oct 24, 2018 - 20:00 PDT
In progress
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted Oct 24, 2018 - 18:00 PDT
Scheduled
We will be doing a release into Cloud Services on Wednesday, October 24, 2018 at 6:00 PM PST. No outage is expected, but users who are currently attempting to authenticate via message level encryption may not receive their OTP. This is a known issue with the message level encryption with no viable work-around.

What:
We are planning to deploy the following releases into Cloud Services production.

PROD-294 Add Country Code 596 and 594, Unknown VOIP numbers fix
PROD-299 Add HTTP Retry logic to SMS/Telephony requests

When:
Rollout will begin at 6:00 PM PST and is expected to take approximately 2 hrs. No interruption of service is expected. In order to best leverage the time difference, deployment will begin with US-1, followed by US-2.

Impact:
PROD-294 – Impacts Fraud Prevention services
PROD-299 – impacts SMS, Telephony, and Fraud Prevention services

PROD-299 will only be deployed on US1-Web1. After a suitable observation time, we will schedule another deployment to put PROD-299 on the remaining production web servers.

Minimal customer impact is anticipated. Users who are currently attempting to authenticate via message level encryption may not receive their OTP. This is a known issue with the message level encryption with no viable work-around.

Risk: Low
The risk of these releases is considered low. The releases will be applied to each server in turn after the server has been drained of connections and removed from the load balancer pool. After confirmation of proper operation, the server will be added back into the pool. No risk of splash damage from a failed deploy has been identified.

Rollback Plan:
The previous known-working version of the service will be deployed.
Posted Oct 23, 2018 - 11:47 PDT
This scheduled maintenance affected: SecureAuth Cloud Services (Nexmo Voice API, SMS Service - US1, SMS Service - US2, Telephony Extension/DTMF Service - US1, Telephony Extension/DTMF Service - US2, Telephony Provider SMS API, Telephony Service - US1, Telephony Service - US2, Threat Service - US1, Threat Service - US2).