tag:dpsadtracker.statuspage.io,2005:/historyDPS AdTracker Status - Incident History2024-03-25T22:35:46-04:00DPS AdTrackertag:dpsadtracker.statuspage.io,2005:Incident/201679032024-03-05T13:25:01-05:002024-03-05T13:25:07-05:00Facebook/Instagram/Threads (Meta) are currently DOWN<p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>13:25</var> EST</small><br><strong>Resolved</strong> - Facebook/Instagram/Threads (Meta) have seemingly resolved this issue.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>11:08</var> EST</small><br><strong>Monitoring</strong> - This is being provided for informational purposes only since most of our customers post advertisements to Facebook, Instagram, and Threads (Meta). <br /><br />These sites are currently down or experiencing extreme slowness. You may also find that you're logged out.<br /><br />This has NOTHING TO DO WITH DPS nor our hosted systems.<br /><br />For more information, please follow along in your favorite media outlet:<br /><br />https://www.usatoday.com/story/tech/2024/03/05/facebook-down-super-tuesday/72850694007/<br /><br />https://www.engadget.com/its-not-just-you-facebook-instagram-and-threads-are-all-down-155024905.html</p>tag:dpsadtracker.statuspage.io,2005:Incident/200484222024-02-22T15:58:26-05:002024-02-22T15:58:26-05:00Major AT&T, Verizon, & T-Mobile Cellular issues reported in USA<p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>15:58</var> EST</small><br><strong>Resolved</strong> - This information is being provided for informational purposes only. All DPS services and software are operational, though you may have connectivity issues if you are using an impacted carrier.<br /><br />**UPDATE**<br />At this time, all Cellular Carriers in the US are reporting services are fully restored. If you are having an issue, please contact your wireless provider.<br /><br />News can be found here: https://www.nbcnews.com/news/us-news/live-blog/internet-cell-outage-live-updates-rcna139965</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>14:59</var> EST</small><br><strong>Update</strong> - This information is being provided for informational purposes only. All DPS services and software are operational, though you may have connectivity issues if you are using an impacted carrier.<br /><br />AT&T reports that 75% of its network has been restored. There are still lingering issues. Other carriers are also improving. Cricket Wireless is backed by AT&T, so it's important to note that this network was equally impacted.<br /><br />Further details can be found here:<br />https://www.nbcnews.com/news/us-news/live-blog/internet-cell-outage-live-updates-rcna139965<br /><br />This is outside of the control of DPS and impacts the services and software our customers use outside of our own services. Please continue to monitor this or contact your carrier.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>09:17</var> EST</small><br><strong>Monitoring</strong> - This information is being provided for informational purposes only. All DPS services and software are operational, though you may have connectivity issues if you are using an impacted carrier.<br /> <br />Customers in multiple US States are reporting widespread outages on the cellular networks of AT&T, Verizon, and T-Mobile. This may have the adverse effect of preventing users from using Multi-Factor Authentication (MFA/2FA) if they rely on SMS/Text or Cellular Callback methods. Nearly every major software company and service requires MFA/2FA in some format. Your cellular service may not work and/or your MFA/2FA confirmation may not be delivered unless you are on Wi-Fi or use a backup token provided by your authenticator app. If you have further concerns about your service, you may wish to contact your cellular provider.<br /><br />Furthermore, if your location uses cellular Internet as a primary Internet Service Provider, then you may be unable to connect.<br /><br />This story is being covered by most major news outlets. We urge customers to continue to follow the story at the outlet of their choosing. Here are two such articles: <br /><br />https://www.usatoday.com/story/tech/2024/02/22/att-outage-service-down/72695579007/<br /><br />https://www.nbcnews.com/news/us-news/t-verizon-t-mobile-customers-hit-widespread-cellular-outages-us-rcna139938 <br /><br />AT&T specifically reports this: " Some customers in your area are having trouble making or receiving calls. As a result, we are experiencing long hold times. We apologize for this inconvenience and we are working to resolve this issue. " <br /><br />You can also monitor along at AT&T, though we've found their information can lag behind news outlets and social media:<br />https://www.att.com/outages/<br /><br />Verizon: https://www.verizon.com/support/check-network-status/<br /><br />This is outside of the control of DPS and impacts the services and software our customers use outside of our own services. Please continue to monitor this or contact your carrier.</p>tag:dpsadtracker.statuspage.io,2005:Incident/191520192023-11-17T12:51:55-05:002023-11-17T12:51:55-05:00Database Issue impacting some customers<p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>12:51</var> EST</small><br><strong>Resolved</strong> - This has stayed healthy and we will close the tracking incident.</p><p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>11:34</var> EST</small><br><strong>Monitoring</strong> - Microsoft identified a problem with the SQL Database Elastic Pool and the performance issue appears to be easing now. We will monitor this for the next hour.</p><p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>10:38</var> EST</small><br><strong>Investigating</strong> - Certain customer databases in the DPSCLOUD (not DPSdesignIQ) have been impacted by a performance issue. The issue appears to be a database server issue in Microsoft Azure Cloud. We're actively working with Microsoft Engineers to identify why the database server is not scaling appropriately to meet user demand. The issue appears to be internal to Microsoft Azure at this time, as it is occurring across multiple databases in multiple regions.<br /><br />This is impacting customers in DPSCLOUD.<br />This is currently not impacting DPSdesignIQ.</p>tag:dpsadtracker.statuspage.io,2005:Incident/184913382023-09-13T16:12:57-04:002023-09-13T16:12:57-04:00Intermittent Adobe Issues<p><small>Sep <var data-var='date'>13</var>, <var data-var='time'>16:12</var> EDT</small><br><strong>Resolved</strong> - Adobe has resolved the major incidents and you can review them at https://status.adobe.com<br /><br />Some minor issues remain but the core services appear operational at this time. For further questions, we would redirect you to Adobe.</p><p><small>Sep <var data-var='date'>13</var>, <var data-var='time'>11:26</var> EDT</small><br><strong>Monitoring</strong> - DPS is monitoring this, though there is nothing that DPS can do to impact this. This is a separate Cloud Service that is provided by Adobe. For further details, please visit https://status.adobe.com</p><p><small>Sep <var data-var='date'>13</var>, <var data-var='time'>11:21</var> EDT</small><br><strong>Identified</strong> - Some customers have notified us that there are some issues with their Adobe Creative Cloud Subscription particular to:<br />- Library Sync.<br />- Font Activation.<br />- PDF Services.<br /><br />These are services provided by an external software vendor that you have a relationship directly with. Unfortunately, DPS does not have further insight into this beyond the Adobe System Status/Health Page.<br /><br />If you are experiencing issues within the Adobe products themselves -- not AdTracker's interaction with them -- please review the Adobe Status Page (https://status.adobe.com) and/or contact Adobe. It is very likely your issue is part of the known issue(s).</p>tag:dpsadtracker.statuspage.io,2005:Incident/177236832023-06-29T20:34:47-04:002023-06-29T20:34:47-04:00AT&T Indiana Connectivity Issues<p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>20:34</var> EDT</small><br><strong>Resolved</strong> - We are closing this ticket, however, this does not mean that every ISP's issues have been resolved. The issues are scattered across the Midwest due to storms. We will revisit tomorrow if there are still outages.</p><p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>17:31</var> EDT</small><br><strong>Update</strong> - The AT&T issue appears to be weather related and will likely spill to other ISPs. We see there was just a significant dangerous weather event happening there.</p><p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>17:26</var> EDT</small><br><strong>Monitoring</strong> - We've become aware that some customers in the Midwest leveraging AT&T may be experiencing connectivity issues. While the issues are reported predominantly in Indianapolis, other areas of the state appear to be impacted.<br /><br />This is not a DPS issue. DPS does not leverage AT&T -- we're hosted exclusively in Microsoft Azure leveraging their network. That said, some of our customers either are on AT&T directly or may traverse these networks. If you are having issues and are a AT&T customer, we would encourage you to contact your ISP.<br /><br />We provide this information to aid your troubleshooting and alert you that it is happening.<br /><br />Main AT&T Issue: <br />https://app.fing.com/internet/outage/DROP:US-Indiana--AT&T@2023-06-29-2000-00000<br /><br />You can see information about others in the General Page below.<br /><br />General Internet Outage List: <br />https://app.fing.com/internet/outages</p>tag:dpsadtracker.statuspage.io,2005:Incident/177223882023-06-29T17:33:40-04:002023-06-29T17:33:40-04:00Comcast Midwest Connectivity Issues<p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>17:33</var> EDT</small><br><strong>Resolved</strong> - This incident related to Comcast appears to be resolved, though there has been significant dangerous weather in the Midwest which may impact connectivity through the area on a variety of ISPs. This is not our only ISP alert currently.</p><p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>14:16</var> EDT</small><br><strong>Monitoring</strong> - We've become aware that some customers in the Midwest leveraging Comcast may be experiencing connectivity issues. While the issues are reported predominantly in Illinois, we have noticed increased latency to customers using Comcast in surrounding states in the Midwest, indicating that traffic likely routes via Chicago to them.<br /><br />This is not a DPS issue. DPS does not leverage Comcast -- we're hosted exclusively in Microsoft Azure leveraging their network. That said, some of our customers either are on Comcast directly or may traverse these networks. If you are having issues and are a Comcast customer, we would encourage you to contact your ISP.<br /><br />We provide this information to aid your troubleshooting and alert you that it is happening.<br /><br />The main issue has been occurring all morning (about 6 hours). There have been some other minor ones surrounding it.<br /><br />Main Comcast Issue: <br />https://app.fing.com/internet/outage/DROP:US-Illinois--Comcast%20Business@2023-06-29-1110-00000<br /><br />You can see information about others in the General Page below.<br /><br />General Internet Outage List: <br />https://app.fing.com/internet/outages</p>tag:dpsadtracker.statuspage.io,2005:Incident/175013292023-06-07T13:37:22-04:002023-06-07T13:37:22-04:00Adobe Creative Cloud Issues (see https://status.adobe.com)<p><small>Jun <var data-var='date'> 7</var>, <var data-var='time'>13:37</var> EDT</small><br><strong>Resolved</strong> - DPS is closing this incident as the majority of Adobe Advisories are marked complete/resolved. This does not mean that there may not be lingering issues, but there is nothing at this time that DPS can do to impact Adobe Creative Cloud. You may continue monitoring the status and/or subscribe to alerts directly from Adobe at https://status.adobe.com</p><p><small>Jun <var data-var='date'> 7</var>, <var data-var='time'>09:16</var> EDT</small><br><strong>Monitoring</strong> - There have been issues reported launching and opening documents across our customers with the Adobe Creative Cloud Applications. There have been a large number of incidents reported this morning on Adobe’s Status site. These would likely come into play on application launch or any time it’s checking licensing. Acrobat and Photoshop would be especially susceptible. Most are clearing now according to: https://status.adobe.com<br /><br />Likely this manifests itself as slow launch/open or failure to launch/open. We will continue to monitor this, but it does not appear that this is something we have impact of. This is Adobe’s software and cloud. Keep in mind that even if they close an incident, it may take some time before everyone stops experiencing it. <br /><br />You can continue to monitor the progress of the outages there at https://status.adobe.com.</p>tag:dpsadtracker.statuspage.io,2005:Incident/166095372023-03-22T21:47:15-04:002023-03-22T21:47:15-04:00Adobe Creative Cloud Service Issue<p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>21:47</var> EDT</small><br><strong>Resolved</strong> - All of our customers are no longer reporting issues, though Adobe still lists considerable issues.<br /><br />If you need to continue following the issue status, please visit https://status.adobe.com and use your Adobe Credentials, if prompted.<br /><br />This is *NOT* something DPS has control over, as this is not our product our Cloud. We are passing this information on in case you are experiencing this issue or your users are frustrated with it.</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>16:57</var> EDT</small><br><strong>Monitoring</strong> - The scope of this issue has expanded at Adobe to include Creative Cloud Platform Core Services (used by all applications), the original Photoshop issue, plus many other items.<br /><br />Users may have issues launching or using services within Creative Cloud Applications (CC 2013 and newer -- NOT CS5.5 or CS6). This is *NOT* something DPS has control over, as this is not our product our Cloud. We are passing this information on in case you are experiencing this issue or your users are frustrated with it:<br /><br />Platform Core Services<br />Issue #202303220016<br />Status: Opened<br />Cloud: Adobe Experience Platform<br />Regions: Americas, EMEA<br />Started/Updated: Today 2:30 PM - Today 4:30 PM (EDT)<br /><br />Photoshop<br />Issue #202303220012<br />Status: Opened<br />Cloud: Creative Cloud<br />Regions: Americas<br />Started/Updated: Today 11:39 AM - Today 4:24 PM (EDT)<br /><br />Query Service<br />Issue #202303220016<br />Status: Opened<br />Cloud: Adobe Experience Platform<br />Regions: Americas<br />Started/Updated: Today 2:30 PM - Today 4:39 PM (EDT)<br /><br />Journey Orchestration<br />Issue #202303220016<br />Status: Opened<br />Cloud: Adobe Experience Platform<br />Regions: Americas<br />Started/Updated: Today 2:30 PM - Today 4:39 PM (EDT)<br /><br />Experience Cloud Home<br />Issue #202303220016<br />Status: Opened<br />Cloud: Experience Cloud<br />Regions: Americas<br />Started/Updated: Today 2:30 PM - Today 4:38 PM (EDT)<br /><br />Data Science Workspace<br />Issue #202303220016<br />Status: Opened<br />Cloud: Adobe Experience Platform<br />Regions: Americas<br />Started/Updated: Today 2:30 PM - Today 4:38 PM (EDT)<br /><br />Adobe Journey Optimizer<br />Issue #202303220016<br />Status: Opened<br />Cloud: Experience Cloud<br />Regions: Americas, EMEA<br />Started/Updated: Today 2:30 PM - Today 4:37 PM (EDT)<br /><br />Data Foundation<br />Issue #202303220016<br />Status: Opened<br />Cloud: Adobe Experience Platform<br />Regions: Americas<br />Started/Updated: Today 2:30 PM - Today 4:34 PM (EDT)</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>14:43</var> EDT</small><br><strong>Identified</strong> - Adobe has reported the following HIGH IMPACT / MAJOR ISSUE on their Service Status Site. Users may have issues launching or using services within Photoshop/Creative Cloud (CC 2013 and newer -- NOT CS5.5 or CS6). This is *NOT* something DPS has control over, as this is not our product our Cloud. We are passing this information on in case you are experiencing this issue or your users are frustrated with it:<br /><br />Adobe System Status<br />We've opened a major issue #202303220012<br />Cloud: Creative Cloud <br />Regions: Americas <br />Started/Updated: Mar 22, 2023 1:36 PM – Mar 22, 2023 2:31 PM (UTC-4)<br />Mar 22, 2023 2:31 PM (UTC-4) <br />Impact severity: Major <br />Impact scope: Some customers are impacted. <br />Services impacted: Photoshop <br />Impact update: This issue has been determined to be impactful. We're investigating an availability issue. <br /><br /><br />Not all users may be experiencing a problem.</p>tag:dpsadtracker.statuspage.io,2005:Incident/165312622023-03-16T15:02:39-04:002023-03-16T15:02:39-04:00Azure East Asia/Hong Kong/Oceania Issue<p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>15:02</var> EDT</small><br><strong>Resolved</strong> - This bulletin **ONLY** Impacts customers hosted in East Asia/Hong Kong/Oceania. <br /><br />US/North America and India-based customers are *NOT* impacted at this time.<br /><br />Microsoft phoned to confirm this was a regional provider issue and storage is back online.</p><p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>14:37</var> EDT</small><br><strong>Monitoring</strong> - This bulletin **ONLY** Impacts customers hosted in East Asia/Hong Kong/Oceania. <br /><br />US/North America and India-based customers are *NOT* impacted at this time.<br /><br />Microsoft has not yet updated the case, but we're starting to see services coming back online. We will continue to monitor and update accordingly.</p><p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>13:43</var> EDT</small><br><strong>Identified</strong> - This bulletin **ONLY** Impacts customers hosted in East Asia/Hong Kong/Oceania. <br /><br />US/North America and India-based customers are *NOT* impacted at this time.<br /><br />Microsoft has acknowledged this issue and put out a service bulletin:<br /><br />------ Microsoft's Official Response is below ------<br />Microsoft Tracking ID: VLB2-HC0<br /><br />Status<br />Active<br /><br />Health Event Type<br />Service Issue<br /><br />Start time<br />3/16/2023 13:03:43 (38 minutes ago)<br /><br />End Time<br />-<br /><br />Last update<br />Impact Statement: Starting at 17:03 UTC on 16 Mar 2023, you have been identified as a customer using Storage in East Asia who may receive failure notifications when performing service management operations - such as create, update, delete - for resources hosted in this region.<br /><br /><br />Current Status: We are aware of this issue and are actively investigating. An update will be provided as events warrant.</p><p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>13:19</var> EDT</small><br><strong>Investigating</strong> - This bulletin **ONLY** Impacts customers hosted in East Asia/Hong Kong/Oceania. <br /><br />US/North America and India-based customers are *NOT* impacted at this time.<br /><br />There is currently an issue occurring in the Asia East Asia/Hong Kong Region which has taken storage accounts offline. We are currently working with Microsoft to determine why this is offline and what they are doing to rectify the problem.</p>tag:dpsadtracker.statuspage.io,2005:Incident/136609952022-11-27T09:41:50-05:002022-11-27T09:41:50-05:00Non-Azure DPSCLOUD FTP/SFTP Server Update<p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>09:41</var> EST</small><br><strong>Completed</strong> - This applies to *NON-AZURE* Customers delivering Business System and other Feed Files to feeds.dpsadtrackercloud.com via FTP/SFTP.<br /><br />DNS changes have been complete since 9:15AM US/EST to redirect feeds.dpsadtrackercloud.com to the newer FTP/SFTP Server. The TTL on this DNS record was set to 600s (5 minutes), so this change should have already taken effect everywhere. Some companies may need to restart their transfer service if their Business System caches the DNS/IP.<br /><br />Make sure you stay using the name "feeds.dpsadtrackercloud.com" for transfers, though now it should resolve to an address starting with "20" instead of the old one starting with "208".<br /><br />As part of the planning for this move, we've captured the IP Addresses of all of the systems that have successfully sent to us in the past thirty (30) days. We've taken those IP Addresses and made firewall allowances *ONLY* for those addresses on the new system. After this change, if you have issues sending feed files to us, please open a ticket and provide both your FTP Username and the IP Address(es) from which you're sending along with whatever error message you're seeing (most likely "Connection refused"). We can make allowances very quickly for any that were either missed or if you need to make a change. Both the username and IP Address(es) are *REQUIRED* to be able to help make a new allowance.<br /><br />Finally, sometime in Q1 2023, we will move anyone still using FTP to SFTP. If you would like to move to SFTP at your own convenience sooner than this, please reach out with a ticket including your existing FTP Username and we can provide you updated, encrypted SFTP credentials. This does not have to be done now, but we provide this as an option in case your IT Departments have some available project time before this. The only change should be updated credentials and the protocol switch. All pathing is identical.</p><p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>09:02</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>23</var>, <var data-var='time'>09:46</var> EST</small><br><strong>Scheduled</strong> - This applies to *NON-AZURE* Customers delivering Business System and other Feed Files to feeds.dpsadtrackercloud.com via FTP/SFTP.<br /><br />On the morning of Sunday, November 27 US/EST, we will be migrating to a newer FTP/SFTP Server. As part of the planning for this move, we've captured the IP Addresses of all of the systems that have successfully sent to us in the past thirty (30) days. We've taken those IP Addresses and made firewall allowances *ONLY* for those addresses on the new system. After this change, if you have issues sending feed files to us, please open a ticket and provide both your FTP Username and the IP Address(es) from which you're sending along with whatever error message you're seeing (most likely "Connection refused"). We can make allowances very quickly for any that were either missed or if you need to make a change.<br /><br />Finally, sometime in Q1 2023, we will move anyone still using FTP to SFTP. If you would like to move to SFTP at your own convenience sooner than this, please reach out with a ticket including your existing FTP Username and we can provide you updated, encrypted SFTP credentials. This does not have to be done now, but we provide this as an option in case your IT Departments have some available project time before this. The only change should be updated credentials and the protocol switch. All pathing is identical.<br /><br />Thank you and, to our US Customers, have a very Happy Thanksgiving!</p>tag:dpsadtracker.statuspage.io,2005:Incident/128704202022-11-13T01:00:34-05:002022-11-13T01:00:34-05:00US Cloud Only - Non-Azure - Emergency Carrier Maintenance<p><small>Nov <var data-var='date'>13</var>, <var data-var='time'>01:00</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>20:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>11</var>, <var data-var='time'>16:16</var> EST</small><br><strong>Scheduled</strong> - This impacts US-based Non-Azure Customers *ONLY*. <br /><br />Our carriers have notified us that they will be performing emergency network maintenance on Saturday, November 12 from 8:00PM to midnight US/EST (7p-11p US/CST, 6p-10p US/MST, 5p-9p US/PST). During this time, brief interruptions are possible. This is not a time that users are normally on the system, so this should have limited to no impact. <br /><br />Again, if you are an Azure Hosted Customer, this does not apply to your system.</p>tag:dpsadtracker.statuspage.io,2005:Incident/126843742022-11-01T15:23:30-04:002022-11-01T15:23:30-04:00Internet connectivity problem<p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>15:23</var> EDT</small><br><strong>Resolved</strong> - This appears be still be healthy and we will mark the incident resolved.</p><p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>12:55</var> EDT</small><br><strong>Monitoring</strong> - A fix was implemented by our carrier, and we will monitor for this the next several hours. If you have further issue please contact you ISP, and then reach out to DPS support.<br /><br />This incident did not impact any Azure hosted customers.</p><p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>12:14</var> EDT</small><br><strong>Investigating</strong> - We are aware that there is a connectivity issue impacting some US customers, and are investigating.</p>tag:dpsadtracker.statuspage.io,2005:Incident/126049592022-10-24T18:22:20-04:002022-10-24T18:22:20-04:00DPSCLOUD - Northeast Internet Outage<p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>18:22</var> EDT</small><br><strong>Resolved</strong> - Our carriers were able to route around the problem ISP handoff and services that we monitor all appear to be working at this time.<br /><br />This did not appear to be impacting DPSAZURE Customers or International Customers.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>17:42</var> EDT</small><br><strong>Identified</strong> - The issue has been identified as an uplink route which is now overloaded and our ISP is working to route around the problem. <br /><br />This does not appear to be impacting DPSAZURE Customers or International Customers.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>17:23</var> EDT</small><br><strong>Investigating</strong> - There appears to be some kind of regional Internet Outage impacting services in the Northeast. Some customers have reported that they are not able to reach their systems. We are actively looking into this.<br /><br />This does not appear to be impacting DPSAZURE Customers or International Customers.<br /><br />We are working to identify the issue with our carriers at this time and will update everyone as the situation changes.</p>tag:dpsadtracker.statuspage.io,2005:Incident/110830182022-09-08T15:37:54-04:002022-09-08T15:37:54-04:00Nationwide Spectrum Internet Issues<p><small>Sep <var data-var='date'> 8</var>, <var data-var='time'>15:37</var> EDT</small><br><strong>Resolved</strong> - We believe all impacted customers on Spectrum are working now. <br /><br />Should you be a Spectrum or Spectrum Business customer and have further issues, please contact your ISP.<br /><br />All DPSCLOUD Hosted Systems in Azure and Datacenters were not having any issue -- this outage was limited to where the users originate from. None of our hostings leverage Spectrum or Spectrum Business.</p><p><small>Sep <var data-var='date'> 8</var>, <var data-var='time'>14:03</var> EDT</small><br><strong>Update</strong> - This appears to also be impacting users in Texas.<br /><br />All DPSCLOUD Hosted Systems in Azure and Datacenters are not having any issue -- this outage is limited to where the users originate from. None of our hostings leverage Spectrum or Spectrum Business.</p><p><small>Sep <var data-var='date'> 8</var>, <var data-var='time'>13:55</var> EDT</small><br><strong>Monitoring</strong> - This notice impacts a small subset of DPSCLOUD users and is not reflective of a problem at any DPSCLOUD hosting.<br /><br />There appears to be a widespread outage for users of Spectrum throughout the USA -- especially the Northeast and Midwest. Users have had interruptions for a few minutes or some extreme lag while working, then it rectifies. This has been repeating for some customers all day today.<br /><br />This is impacting mostly telecommuting home users that use Spectrum as their ISP or Spectrum Business for office.. If you are a Spectrum or Spectrum Business user and unable to connect, please contact your ISP.<br /><br />All DPSCLOUD Hosted Systems in Azure and Datacenters are not having any issue -- this outage is limited to where the users originate from. None of our hostings leverage Spectrum or Spectrum Business.</p>tag:dpsadtracker.statuspage.io,2005:Incident/106550942022-07-20T21:11:29-04:002022-07-20T21:11:29-04:00ISP Issue with Lumen/CenturyLink/Level3 impacting Upstate/Western NY<p><small>Jul <var data-var='date'>20</var>, <var data-var='time'>21:11</var> EDT</small><br><strong>Resolved</strong> - This outage is persisting but not impacting DPS directly. We will close monitoring of this issue at this time.<br /><br />Lumen/CenturyLink/Level3 ISP Customers located in Upstate/Western New York State, or customers with ISPs that handoff through this ISP regionally, may be experiencing intermittent issues. None of our services are run solely through this ISP and location, so we are not experiencing any issues ourselves. If you are a customer of Lumen/CenturyLink/Level3 or confirm you're traversing this company and having an issue, please contact your ISP.<br /><br />Full details here: https://app.fing.com/internet/outage/DROP:US-New%20York--Lumen@2022-07-20-0515-00000</p><p><small>Jul <var data-var='date'>20</var>, <var data-var='time'>14:54</var> EDT</small><br><strong>Monitoring</strong> - There is no impact to any DPS Cloud Service, though there may be customer impact if you are leveraging certain ISPs.<br /><br />Lumen/CenturyLink/Level3 ISP Customers located in Upstate/Western New York State, or customers with ISPs that handoff through this ISP regionally, may be experiencing intermittent issues. None of our services are run solely through this ISP and location, so we are not experiencing any issues ourselves. If you are a customer of Lumen/CenturyLink/Level3 or confirm you're traversing this company and having an issue, please contact your ISP.<br /><br />This outage has been going on all day according to this Internet Outage Map:<br />https://twitter.com/outagedetect/status/1549805368670359557<br />https://app.fing.com/internet/outage/DROP:US-New%20York--Lumen@2022-07-20-0515-00000</p>tag:dpsadtracker.statuspage.io,2005:Incident/105415152022-07-17T11:55:27-04:002022-07-17T11:55:27-04:00US Cloud Only - Non-Azure - NY Datacenter - Power Maintenance<p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>11:55</var> EDT</small><br><strong>Completed</strong> - All systems for this impacted maintenance window are back online. If there are any issues that are production critical to today's deadline, please reach out to DPS Support. If you have any customer managed systems housed within this datacenter, please be sure that you verify their operation.</p><p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>08:30</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>11</var>, <var data-var='time'>15:50</var> EDT</small><br><strong>Scheduled</strong> - ** THIS DOES NOT IMPACT AZURE CUSTOMERS -- US Cloud Only - Non-Azure - NY Datacenter - Only **<br /><br />** This impacts Non-Azure Customers using Remote Desktop Services. **<br />** If you are an Azure Customer using Windows Virtual Desktop, this does *NOT* impact you. **<br /><br />On Sunday, July 17 between 8:30AM and 1:30PM US/EDT our Primary NON-AZURE Datacenter in NY will undergo emergency repairs to a power feed. During this time, we expect two brief interruptions. We expect this to be completed much earlier, though the datacenter has requested the full window in case they run into issues. <br /><br />Normally there are no customers working during this window. If for some reason you are scheduled to work during this window, please make alternate arrangements to shift your staff.</p>tag:dpsadtracker.statuspage.io,2005:Incident/104742882022-07-05T20:36:52-04:002022-07-05T20:36:52-04:00Mediacom ISP Outage in Midwest<p><small>Jul <var data-var='date'> 5</var>, <var data-var='time'>20:36</var> EDT</small><br><strong>Resolved</strong> - For impacted Mediacom ISP customers in the US Midwest, Mediacom has finally acknowledged the problem directly on their Twitter Support Account @MediacomSupport<br /><br />Here's what they said:<br />"**OUTAGE UPDATE @ 6:30PM CST** We are aware of the disruption in service. Sincerely apologize for the inconvenience caused and rest assured we are working diligently on restoring services. Thank you for your patience!" --Mediacom Support<br />https://twitter.com/MediacomSupport/status/1544463303170297858<br /><br />DPS is going to stop monitoring this, as this is an internal ISP issue at Mediacom and not something DPS or its customers can impact. If you continue to have issues and you are a Mediacom ISP Customer, please contact Mediacom. Thank you.</p><p><small>Jul <var data-var='date'> 5</var>, <var data-var='time'>16:31</var> EDT</small><br><strong>Monitoring</strong> - This notice impacts a small subset of DPSCLOUD users and is not reflective of a problem at any DPSCLOUD hosting.<br /><br />There appears to be a widespread outage for users of Mediacom ISP throughout the Midwest -- including, but not limited to, Iowa; Illinois; Minnesota; and Missouri.<br /><br />This is impacting mostly telecommuting home users that use Mediacom as their ISP. If you are a Mediacom user, please contact your ISP.<br /><br />All DPSCLOUD Hosted Systems in Azure and Datacenters are not having any issue -- this outage is limited to where the users originate from. None of our hostings leverage Mediacom.<br /><br />https://downdetector.com/status/mediacom-communications/<br />https://downdetector.com/status/mediacom-communications/map/</p>tag:dpsadtracker.statuspage.io,2005:Incident/104164212022-06-27T16:25:40-04:002022-06-27T17:05:16-04:00Internet Outages impacting customers in Northeast and Midwest<p><small>Jun <var data-var='date'>27</var>, <var data-var='time'>16:25</var> EDT</small><br><strong>Resolved</strong> - It appears the handoff issue may be resolved. We will continue monitoring and re-open if the issue recurs.<br /><br />If you have any "stuck" ads that are on a DELIVERY RETRY/DELIVERY FAIL, you should attempt to re-approve them.</p><p><small>Jun <var data-var='date'>27</var>, <var data-var='time'>16:13</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating a network outage which appears to be occurring with a handoff between Spectrum, Level3/CenturyLink, and CrownCastle. We will have more information as this becomes available. <br /><br />This is only impacting a subset of customers -- within that subset, only customers hosted in the NY and VA Datacenter. <br /><br />This does not appear to be impacting Azure Hosted Datacenter.</p>tag:dpsadtracker.statuspage.io,2005:Incident/103699662022-06-21T23:36:16-04:002022-06-21T23:36:16-04:00Sporadic Spectrum Internet Issues at some customers<p><small>Jun <var data-var='date'>21</var>, <var data-var='time'>23:36</var> EDT</small><br><strong>Resolved</strong> - This appears to now be resolved with Spectrum.</p><p><small>Jun <var data-var='date'>21</var>, <var data-var='time'>09:59</var> EDT</small><br><strong>Update</strong> - While some users are able to now connect just fine, other Spectrum users continue to see nuisance conditions that it can make the desktop experience seem to lag behind user input, can result in sessions stating "Reconnecting...", desktops that momentarily disconnect, or final delivery files going to DELIVERY RETRY/DELIVERY FAIL. These same users confirm that sometimes websites do not load on their computer locally, but a refresh brings them up. Further confirming the ISP issue.<br /><br />None of the DPSCLOUD hostings leverage Spectrum as a primary circuit, so those systems are completely unaffected and have remained online. That said, if your office or your telecommuting users leverage Spectrum and/or your traffic traverses a Spectrum-managed handoff between you and the DPSCLOUD, you may experience sporadic issues. <br /><br />Unfortunately, if you are experiencing these issues, there is not much we can collectively do to impact it unless you have an alternate ISP at your location(s). You may also wish to contact your ISP.</p><p><small>Jun <var data-var='date'>21</var>, <var data-var='time'>09:30</var> EDT</small><br><strong>Monitoring</strong> - This alert is informational in case your users are experiencing these issues and use Spectrum. <br /><br />Over the past hour, we've seen a subset of customers using the Spectrum ISP have intermittent connectivity issues. We monitor customer locations using Spectrum, as well as a number of us use Spectrum from our homes. This seems to be impacting Spectrum Residential and Spectrum Business Customers. So far, the issues seem limited to the Northeast and Midwest. This is similar to yesterday, though the problem seems to impact fewer users.<br /><br />This hasn't been enough to keep anyone from working, but it is a nuisance in that it can make the desktop experience seem to lag behind user input, can result in sessions stating "Reconnecting...", desktops that momentarily disconnect, or final delivery files going to DELIVERY RETRY/DELIVERY FAIL.<br /><br />None of the DPSCLOUD hostings leverage Spectrum as a primary circuit, so those systems are completely unaffected and have remained online. That said, if your office or your telecommuting users leverage Spectrum and/or your traffic traverses a Spectrum-managed handoff between you and the DPSCLOUD, you may experience sporadic issues. <br /><br />These same users confirm that sometimes websites do not load on their computer, but a refresh brings them up. Further confirming the ISP issue.<br /><br />Unfortunately, if you are experiencing these issues, there is not much we can collectively do to impact it unless you have an alternate ISP at your location(s).</p>tag:dpsadtracker.statuspage.io,2005:Incident/103609072022-06-20T13:10:23-04:002022-06-20T13:10:23-04:00Nationwide Spectrum Internet Issue<p><small>Jun <var data-var='date'>20</var>, <var data-var='time'>13:10</var> EDT</small><br><strong>Resolved</strong> - This issue appears to now be resolved at Spectrum. If you continue to have intermittent connectivity issues *AND* you use Spectrum ISP, you should reach out to your carrier.</p><p><small>Jun <var data-var='date'>20</var>, <var data-var='time'>11:16</var> EDT</small><br><strong>Monitoring</strong> - This alert is informational in case your users are experiencing these issues and use Spectrum.<br /><br />Over the past two hours, we've seen customers using the Spectrum ISP have intermittent connectivity issues. We monitor customer locations using Spectrum, as well as a number of us use Spectrum from our homes. This seems to be impacting Spectrum Residential and Spectrum Business Customers. So far, the issues seem widespread in the Northeast, Midwest, Mid-Atlantic, and Southeast. <br /><br />This hasn't been enough to keep anyone from working, but it is a nuisance in that it can make the desktop experience seem to lag behind user input, can result in sessions stating "Reconnecting...", desktops that momentarily disconnect, or final delivery files going to DELIVERY RETRY/DELIVERY FAIL.<br /><br />None of the DPSCLOUD hostings leverage Spectrum as a primary circuit, so those systems are completely unaffected and have remained online. That said, if your office or your telecommuting users leverage Spectrum and/or your traffic traverses a Spectrum-managed handoff between you and the DPSCLOUD, you may experience sporadic issues. <br /><br />Unfortunately, if you are experiencing these issues, there is not much we can collectively do to impact it unless you have an alternate ISP at your location(s).</p>tag:dpsadtracker.statuspage.io,2005:Incident/96588812022-03-30T20:27:19-04:002022-03-30T20:27:19-04:00US Cloud Only - Non-Azure - NY Datacenter - Network Maintenance<p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>20:27</var> EDT</small><br><strong>Completed</strong> - This weekend's maintenance window is no longer required. The update to the uplinks was able to be done individually to the firewall cluster and uplinks so that no downtime was required. Work is now complete.</p><p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>11:02</var> EDT</small><br><strong>Scheduled</strong> - Overnight between Friday and Saturday (Saturday, April 2 at 1:00AM US/EDT), maintenance will be performed on our Internet uplinks. Downtime is not planned, but it is possible. If you have staff that works during this time window, we recommend scheduling around it.</p>tag:dpsadtracker.statuspage.io,2005:Incident/95191842022-03-11T13:32:02-05:002022-03-11T13:32:02-05:00GoDaddy DNS Outage<p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>13:32</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>12:47</var> EST</small><br><strong>Monitoring</strong> - It appears that GoDaddy's DNS has come back online and is servicing requests. Our monitoring is showing systems now operational everywhere again.<br /><br />If you have any ads that have gone to a DELIVERY FAIL status, please be sure to re-approve them so they re-transmit.<br /><br />We will continue monitoring and, if all stays well, close out the case.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>12:39</var> EST</small><br><strong>Update</strong> - Clarification for what DNS means in this case: When you visit a website or resources using a domain name, it goes to a DNS Lookup to determine the actual Internet address to route the traffic to (think of it as a phone book). That lookup at GoDaddy is currently failing to produce results some of the time, which is sometimes preventing login to ATOL, SFTP/FTP and Remote Desktop.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>12:36</var> EST</small><br><strong>Investigating</strong> - It appears that GoDaddy is having some kind of global issue with their DNS. Like many companies, DPS uses domains and SSL certificates purchased through GoDaddy. It appears right now that DNS is not resolving for any of their domains. <br /><br />You may see trouble reaching our domains as well as anything you own or use that leverages GoDaddy Domain Names.<br /><br />We will update as we can.</p>tag:dpsadtracker.statuspage.io,2005:Incident/88551532021-12-15T11:25:30-05:002021-12-15T11:25:30-05:00Zendesk Support Desk is currently offline<p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>11:25</var> EST</small><br><strong>Resolved</strong> - Zendesk appears to be back online.<br /><br />Amazon has updated their system status to mark this as resolved. All services appear to be working from AWS.</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>10:45</var> EST</small><br><strong>Investigating</strong> - The DPS Zendesk Support Desk System is currently offline. It is hosted by Zendesk and it appears that their cloud provider (likely AWS) is currently experiencing an issue.<br /><br />If you have an issue that cannot wait until Zendesk is back online, please revert to telephone support.</p>tag:dpsadtracker.statuspage.io,2005:Incident/88554922021-12-15T11:24:13-05:002021-12-15T11:24:13-05:00Amazon US-WEST-2 Cloud issue for Customers leveraging AWS<p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>11:24</var> EST</small><br><strong>Resolved</strong> - Amazon has updated their system status to mark this as resolved. All services appear to be working from AWS. <br /><br />This is being provided for information purposes, as some customers use their own services/resources in AWS in addition to the DPSCLOUD. <br /><br />Since these are not DPS services, if you are still having an issue reaching them, we encourage you to contact your other cloud provider(s) for those managed services or monitor the provided site: https://status.aws.amazon.com</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>11:05</var> EST</small><br><strong>Update</strong> - Amazon has expanded the outage to include US-WEST-1.<br /><br />This is being provided for information purposes, as some customers use their own services/resources in AWS in addition to the DPSCLOUD.<br /><br />Since these are not DPS services, if you are having an issue reaching them, we encourage you to contact your other cloud provider(s) for those managed services or monitor the provided site: https://status.aws.amazon.com</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>10:54</var> EST</small><br><strong>Monitoring</strong> - For customers leveraging services on AWS, Amazon is reporting a network issue impacting their US-WEST-2 Region.<br /><br />For full details, visit the AWS System Health Page at https://status.aws.amazon.com<br /><br />They currently have an issue reported as "AWS Internet Connectivity (Oregon) -- We are investigating Internet connectivity issues to the US-WEST-2 Region".<br /><br />Since these are not DPS services, if you are having an issue reaching them, we encourage you to contact your other cloud provider(s) for those managed services or monitor the provided site: https://status.aws.amazon.com<br /><br />This issue has no impact on the DPSCLOUD of hosted services that DPS provides. The only DPS related item with an issue is Zendesk, which is hosted by Zendesk in US-WEST-2. We are tracking that in a separate incident.</p>tag:dpsadtracker.statuspage.io,2005:Incident/87846352021-12-07T20:26:26-05:002021-12-07T20:26:26-05:00Amazon Outage impacting some Customers<p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>20:26</var> EST</small><br><strong>Resolved</strong> - This appears to be resolved or on the way to being resolved by Amazon. Again, there were no DPS services impacted, though some of our customers use resources hosted by Amazon that may have been impacted.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>13:43</var> EST</small><br><strong>Monitoring</strong> - Amazon AWS is currently experiencing an outage that is impacting services used by a number of our customers. This is not something that is under DPS control that we can impact for you.<br /><br />If you have a service that you use that is impacted, please check that vendor's cloud system status page<br /><br />For further details:<br /><br />General Article: https://www.theverge.com/2021/12/7/22822332/amazon-server-aws-down-disney-plus-ring-outage?scrolla=5eb6d68b7fedc32c19ef33b4<br /><br />Amazon AWS Status Page: https://status.aws.amazon.com<br /><br />If you are using a Network Monitoring Tool, such as PRTG, it may also be hosted in AWS and cause erroneous reports.</p>