Service Interruption 6/30/15
Incident Report for Pardot

At approximately 5:00 p.m. EST on June 30, 2015, we began experiencing a service disruption with the Pardot application. The cause of the disruption was an issue in the queueing system that powers automation rules and dynamic lists. When this issue occurred, the Pardot application became inaccessible to users and displayed an error message. During this time, live landing pages and forms hosted in Pardot may have also displayed an error message. Tracked email links were also affected and may have resulted in an error upon click.

At approximately 5:10 p.m. EST, we temporarily disabled background processing (emails, imports, CRM syncing, automations) and restarted our servers in order to restore service. From approximately 5:20 p.m. EST to 5:30 p.m. EST, access to the Pardot application and hosted forms and landing pages was intermittent.

To prevent this moving forward, we will first be fixing a bug, which contributed to the issue in our queueing infrastructure. Additionally, we will be increasing our monitoring to proactively identify similar issues more quickly in the future. Lastly, new higher-capacity hardware is being provisioned in order to reduce the chance for the same issue to recur.

We apologize for any trouble caused and appreciate your patience while we resolved this incident.

Zach Bailey, Director of Engineering

Posted over 1 year ago. Jul 01, 2015 - 19:27 EST

Resolved
App performance has returned to normal and appears stable. Please contact our Support team at pardot.com/help with any questions related to this incident. A full postmortem will be posted here once next steps have been identified.
Posted over 1 year ago. Jun 30, 2015 - 18:21 EST
Monitoring
Performance has been restored. The web application as well as hosted assets (landing pages, forms) are now accessible. Background processing (emails, imports, automations) has been restored and is catching up. We're continuing to monitor to ensure stability.
Posted over 1 year ago. Jun 30, 2015 - 17:52 EST
Identified
The root cause has been identified and we're actively working towards a resolution. Access to the Pardot app may be intermittent while we work.
Posted over 1 year ago. Jun 30, 2015 - 17:23 EST
Investigating
We're currently investigating a service interruption with the Pardot web application. Our engineers are actively investigating to resolve this as top priority. We're sorry for the trouble. We'll post future updates here as we learn more.
Posted over 1 year ago. Jun 30, 2015 - 17:05 EST