tag:status.capenetworks.com,2005:/historyAruba User Experience Insight (UXI) Status - Incident History2024-03-28T20:39:41+02:00Aruba User Experience Insight (UXI)tag:status.capenetworks.com,2005:Incident/202760352024-03-16T10:42:14+02:002024-03-16T10:42:14+02:00Data Processing Delays - Issues, Incidents, and Notifications<p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>10:42</var> CAT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>09:35</var> CAT</small><br><strong>Monitoring</strong> - Our data processing infrastructure experienced a problem and fell behind with the processing of Issues, Incidents, and Notifications. No data has been lost and we are in the process of catching up. We should be caught up soon.</p>tag:status.capenetworks.com,2005:Incident/202760272024-03-16T01:00:00+02:002024-03-16T09:33:59+02:00Data Processing Delays - Issues, Incidents, and Notifications<p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>01:00</var> CAT</small><br><strong>Resolved</strong> - Our data processing infrastructure experienced a problem and fell behind with the processing of Issues, Incidents, and Notifications. No data has been lost and we are in the process of catching up. We should be caught up soon.</p>tag:status.capenetworks.com,2005:Incident/200569992024-02-23T15:33:49+02:002024-02-23T15:33:49+02:00Delayed test results<p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>15:33</var> CAT</small><br><strong>Resolved</strong> - We have resolved the issue</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>14:47</var> CAT</small><br><strong>Monitoring</strong> - We have implemented a fix and we are monitoring the situation</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>14:43</var> CAT</small><br><strong>Identified</strong> - We identified an issue where sensors have a delay in the data that they send.</p>tag:status.capenetworks.com,2005:Incident/200503082024-02-22T20:36:12+02:002024-02-22T20:36:12+02:00Users encountering a problem when attempting to configure sensors in Settings -> Sensors and Agents.<p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>20:36</var> CAT</small><br><strong>Resolved</strong> - This issue has been resolved.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>19:58</var> CAT</small><br><strong>Investigating</strong> - All dashboards are experiencing a situation where, upon clicking the wrench icon to configure a sensor from the unconfigured list, they encounter a perpetual "Loading Sensor Configuration..." page, and unable to proceed further. We are investigating the issue.</p>tag:status.capenetworks.com,2005:Incident/199504942024-02-15T03:38:59+02:002024-02-15T03:38:59+02:00Microsoft Teams / Skype for business test target is not responding to TCP pings.<p><small>Feb <var data-var='date'>15</var>, <var data-var='time'>03:38</var> CAT</small><br><strong>Resolved</strong> - The test target utilized for Microsoft Teams / Skype for Business has been responding to TCP pings since Monday at 12:15 PM EST and has not produced issues across customers except for a brief period on Wednesday from 7:25 AM to 7:27 AM EST. We will continue to monitor and reopen this announcement if necessary.</p><p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>20:48</var> CAT</small><br><strong>Investigating</strong> - As of 8:00 AM EST, we've observed that the test target utilized for Microsoft Teams / Skype for Business is not responding to TCP pings across several customer dashboards. It's important to note that while this issue affects many, not all dashboards are impacted.<br /><br />Here's what you need to know:<br />- No Dashboard or UXI Sensor Issues: There are no issues with the UXI sensors or our dashboard itself. The test is operating as intended.<br />- Anycast Test Target: Our sensors leverage a Microsoft anycast test target to gauge network performance and estimate voice MOS. You can find more information about this test target in Microsoft's resource: https://learn.microsoft.com/en-us/skypeforbusiness/optimizing-your-network/media-quality-and-network-connectivity-performance#network-performance-requirements-from-a-skype-for-business-client-to-microsoft-network-edge <br />- Actionable Step: If you wish to mute notifications related to this test, you can do so under Settings -> Notifications.<br /><br />We're actively monitoring the situation and will provide updates as we have them. Thank you for your patience and understanding.</p>tag:status.capenetworks.com,2005:Incident/199752932024-02-13T16:28:33+02:002024-02-13T16:28:33+02:00Dashboard not loading<p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>16:28</var> CAT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>16:18</var> CAT</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>16:17</var> CAT</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>16:15</var> CAT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p>tag:status.capenetworks.com,2005:Incident/203022312024-02-13T10:00:00+02:002024-03-19T17:30:29+02:00[Past Incident] UXI-Aruba Central Integration Issue<p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>10:00</var> CAT</small><br><strong>Resolved</strong> - On February 13th 2024, we encountered an issue affecting UXI dashboards integrated with Aruba Central. UXI was unable to refresh the Central API tokens and now many integrations are in an error state. <br /><br />Resolution Steps:<br />If your UXI dashboard shows Aruba Central integration in an error state, you will need to edit the integration in UXI and add a new aruba central token. https://help.capenetworks.com/en/articles/4305360-aruba-central-integration <br /><br />We apologize for any inconvenience caused and appreciate your patience.</p>tag:status.capenetworks.com,2005:Incident/199610642024-02-11T17:56:24+02:002024-02-11T18:11:48+02:00Dashboard Degraded Performance<p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>17:56</var> CAT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>17:49</var> CAT</small><br><strong>Update</strong> - The WiFi Environment on a sensor test result page is failing to. We are working on a fix for this</p><p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>17:47</var> CAT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>16:59</var> CAT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>16:39</var> CAT</small><br><strong>Investigating</strong> - We are currently investigating an issue preventing users from accessing their dashboard</p>tag:status.capenetworks.com,2005:Incident/199377762024-02-10T12:00:29+02:002024-02-10T12:00:29+02:00Aruba UXI Scheduled Maintenance Saturday February 10th<p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>12:00</var> CAT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>08:00</var> CAT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>11:43</var> CAT</small><br><strong>Scheduled</strong> - Dear Customer, <br /><br />We are scheduling a system maintenance event on: <br /><br />Saturday February 10th, 2024 from 1:00 AM to 5:00 AM US Eastern Time (GMT-4) <br /><br />We are estimating a 4-hour maintenance window, the issue data and metrics might be delayed at times during this window. This will affect the dashboard availability, notifications (email/webhooks) and the data push. Your UXI sensors will continue to test as per usual. Your issue data and metrics will be preserved, and once the maintenance event is complete, the issue data will be available. <br /><br />Progress updates during the maintenance event will be posted to status.capenetworks.com and you can choose to subscribe to receive email updates from the same page.<br /><br />We apologize for any inconvenience. Please reach out to our support team if you have any concerns.</p>tag:status.capenetworks.com,2005:Incident/196839082024-01-12T05:04:34+02:002024-01-12T05:04:34+02:00Issue processing test results<p><small>Jan <var data-var='date'>12</var>, <var data-var='time'>05:04</var> CAT</small><br><strong>Resolved</strong> - The dashboard is fully functional again</p><p><small>Jan <var data-var='date'>12</var>, <var data-var='time'>04:38</var> CAT</small><br><strong>Monitoring</strong> - We noticed an issue processing test result metrics and slow loading of the dashboard. This has been mitigated and we are monitoring the situation. <br />At the moment we have a delay in the processing of the test results</p>tag:status.capenetworks.com,2005:Incident/191860632023-11-21T13:43:16+02:002023-11-21T13:43:16+02:00Dashboard Not Loading<p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>13:43</var> CAT</small><br><strong>Resolved</strong> - The incident has been resolved, we will continue to monitor to ensure no regression</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>11:35</var> CAT</small><br><strong>Update</strong> - We have a fix for the issue and working on rolling it out. The WiFi Environment is currently unavailable whilst we implement this fix</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>11:32</var> CAT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>11:30</var> CAT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>11:29</var> CAT</small><br><strong>Investigating</strong> - We are experiencing an outage with the dashboard not loading.</p>tag:status.capenetworks.com,2005:Incident/191129462023-11-14T09:57:58+02:002023-11-14T09:57:58+02:00WI-FI Environment Chart Not Loading<p><small>Nov <var data-var='date'>14</var>, <var data-var='time'>09:57</var> CAT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>14</var>, <var data-var='time'>03:33</var> CAT</small><br><strong>Investigating</strong> - We have identified an issue where the WI-FI environment chart on the sensor status page is not displaying data. We are investigating the issue.</p>tag:status.capenetworks.com,2005:Incident/190575332023-11-08T15:00:00+02:002023-11-08T15:59:25+02:00Incorrect RSSI Dropped and High Packet Loss threshold issues identified<p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>15:00</var> CAT</small><br><strong>Resolved</strong> - We are aware of an issue where certain customers have received an unusually high number of RSSI Dropped or High Packet Loss threshold issues.<br /><br />These issues were created incorrectly due to an internal change. They do not reflect any change in the observed metrics or network degredations in client networks.<br /><br />We have resolved the underlying problem.</p>tag:status.capenetworks.com,2005:Incident/190363662023-11-06T18:55:31+02:002023-11-06T18:55:31+02:00Slow dashboard loading<p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>18:55</var> CAT</small><br><strong>Resolved</strong> - We have identified the issue and seen that the dashboard load performance is back to usual</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>18:17</var> CAT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>18:17</var> CAT</small><br><strong>Investigating</strong> - We have discovered that the dashboard is taking longer than usual to load. We are busy investigating this.</p>tag:status.capenetworks.com,2005:Incident/189152052023-10-24T19:46:06+02:002023-10-24T19:46:06+02:00Test Configuration Rate Limit Error<p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>19:46</var> CAT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>19:21</var> CAT</small><br><strong>Monitoring</strong> - At 8 AM EDT, a software change was made to our test configuration service. This change impacted tests where frequency and rate limit settings were ignored for some customers. The issue was discovered at 12:40 EDT and the change was rolled back at 1 PM EDT. A fix has been implemented and we are monitoring the results.</p>tag:status.capenetworks.com,2005:Incident/187320752023-10-09T00:30:00+02:002023-10-09T15:12:06+02:00Delay in test result data push integrations<p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>00:30</var> CAT</small><br><strong>Resolved</strong> - We discovered an issue which caused a delay in the test results data push integrations for a few customers. This was fixed within 1 hour from the beginning of this incident. There was approximately another hour needed to process the delayed results. This incident is now resolved.</p>tag:status.capenetworks.com,2005:Incident/186512142023-10-07T10:50:10+02:002023-10-07T10:50:10+02:00Aruba UXI Scheduled Maintenance Saturday October 7th<p><small>Oct <var data-var='date'> 7</var>, <var data-var='time'>10:50</var> CAT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'> 7</var>, <var data-var='time'>07:00</var> CAT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>30</var>, <var data-var='time'>17:13</var> CAT</small><br><strong>Scheduled</strong> - Dear Customer, <br /><br />We are scheduling a system maintenance event on: <br /><br />Saturday October 7th, 2023 from 1:00 AM to 5:00 AM US Eastern Time (GMT-4) <br /><br />We are estimating a 4-hour maintenance window, the issue data and metrics might be delayed at times during this window. This will affect the dashboard availability, notifications (email/webhooks) and the data push. Your UXI sensors will continue to test as per usual. Your issue data and metrics will be preserved, and once the maintenance event is complete, the issue data will be available. <br /><br />Progress updates during the maintenance event will be posted to status.capenetworks.com and you can choose to subscribe to receive email updates from the same page.<br /><br />We apologize for any inconvenience. Please reach out to our support team if you have any concerns.</p>tag:status.capenetworks.com,2005:Incident/185748942023-09-30T17:12:01+02:002023-09-30T17:12:01+02:00Aruba UXI Scheduled Maintenance Saturday October 7th<p><small>Sep <var data-var='date'>30</var>, <var data-var='time'>17:12</var> CAT</small><br><strong>Completed</strong> - This maintenance message was sent erroneously. The maintenance window is still scheduled for 7 October 2023</p><p><small>Sep <var data-var='date'>30</var>, <var data-var='time'>07:00</var> CAT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'> 7</var>, <var data-var='time'>07:00</var> CAT</small><br><strong>Scheduled</strong> - Dear Customer, <br /><br />We are scheduling a system maintenance event on: <br /><br />Saturday October 7th, 2023 from 1:00 AM to 5:00 AM US Eastern Time (GMT-4) <br /><br />We are estimating a 4-hour maintenance window, the issue data and metrics might be delayed at times during this window. This will affect the dashboard availability, notifications (email/webhooks) and the data push. Your UXI sensors will continue to test as per usual. Your issue data and metrics will be preserved, and once the maintenance event is complete, the issue data will be available. <br /><br />Progress updates during the maintenance event will be posted to status.capenetworks.com and you can choose to subscribe to receive email updates from the same page.<br /><br />We apologize for any inconvenience. Please reach out to our support team if you have any concerns.</p>tag:status.capenetworks.com,2005:Incident/184708982023-09-12T20:19:59+02:002023-09-12T20:19:59+02:00Service Test Editing Disabled<p><small>Sep <var data-var='date'>12</var>, <var data-var='time'>20:19</var> CAT</small><br><strong>Resolved</strong> - This incident is resolved</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>22:29</var> CAT</small><br><strong>Monitoring</strong> - A fix has been implemented and we have re-enabled editing in the Service & App Tests settings page. We are continuing to monitor the situation.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>19:47</var> CAT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>18:10</var> CAT</small><br><strong>Investigating</strong> - We have identified an issue when editing service tests on the dashboard. Whilst implementing a fix we have disabled the service test editing functionality in the Service & App Tests settings page.</p>tag:status.capenetworks.com,2005:Incident/184254422023-09-07T18:00:00+02:002023-09-07T20:37:05+02:00Degraded performance on dashboard loading test results.<p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>18:00</var> CAT</small><br><strong>Resolved</strong> - Dashboard test results went through a short period of degraded performance where the results either took loang to load or failed to load.</p>tag:status.capenetworks.com,2005:Incident/181021482023-08-10T08:55:19+02:002023-08-10T08:55:19+02:00Adding sensors to account not working for some customers<p><small>Aug <var data-var='date'>10</var>, <var data-var='time'>08:55</var> CAT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>10</var>, <var data-var='time'>07:57</var> CAT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Aug <var data-var='date'>10</var>, <var data-var='time'>07:11</var> CAT</small><br><strong>Investigating</strong> - We are aware of a problem impacting some customers when trying to add new sensors.</p>tag:status.capenetworks.com,2005:Incident/180357912023-08-04T13:24:29+02:002023-08-04T13:24:29+02:00Central Integration Partial Failures<p><small>Aug <var data-var='date'> 4</var>, <var data-var='time'>13:24</var> CAT</small><br><strong>Resolved</strong> - We have identified the issue which was causing the a partial outage of our integration with central. This has been resolved and you should see normal operation of the integration.</p><p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>00:04</var> CAT</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>00:03</var> CAT</small><br><strong>Identified</strong> - We have identified partial failures in the central integration. Specifically, this affects sending information from UXI to Central. <br />We will provide an update when we have more information.</p>tag:status.capenetworks.com,2005:Incident/176726852023-06-24T18:40:49+02:002023-06-24T18:40:49+02:00Maintenance still in progress<p><small>Jun <var data-var='date'>24</var>, <var data-var='time'>18:40</var> CAT</small><br><strong>Resolved</strong> - We will send a post mortem in the next few days</p><p><small>Jun <var data-var='date'>24</var>, <var data-var='time'>18:15</var> CAT</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Jun <var data-var='date'>24</var>, <var data-var='time'>18:15</var> CAT</small><br><strong>Monitoring</strong> - Maintenance is over. We encountered outages during the time. We will write a post-mortem once we have gather all the information and have identified the root cause of the outages.</p><p><small>Jun <var data-var='date'>24</var>, <var data-var='time'>14:43</var> CAT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jun <var data-var='date'>24</var>, <var data-var='time'>14:02</var> CAT</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.capenetworks.com,2005:Incident/175684942023-06-24T15:00:07+02:002023-07-05T09:53:35+02:00Aruba UXI Schedule Maintenance Saturday Jun 24th, 2023<p><small>Jun <var data-var='date'>24</var>, <var data-var='time'>15:00</var> CAT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jun <var data-var='date'>24</var>, <var data-var='time'>09:00</var> CAT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jun <var data-var='date'>14</var>, <var data-var='time'>08:04</var> CAT</small><br><strong>Scheduled</strong> - Dear Customer, <br /><br />We are scheduling a system maintenance event on: <br /><br />Saturday June 24th, 2023 from 3:00 AM to 8:00 AM US Eastern Time (GMT-4) <br /><br />We are estimating a 5-hour maintenance window, the issue data and metrics might be delayed at times during this window. This will affect the dashboard availability, notifications (email/webhooks) and the data push. Your UXI sensors will continue to test as per usual. Your issue data and metrics will be preserved, and once the maintenance event is complete, the issue data will be available. <br /><br />Progress updates during the maintenance event will be posted to status.capenetworks.com and you can choose to subscribe to receive email updates from the same page. <br /><br />We apologize for any inconvenience. Please reach out to our support team if you have any concerns.</p>tag:status.capenetworks.com,2005:Incident/174883482023-06-06T14:04:30+02:002023-06-06T14:04:30+02:00Degraded Dashboard Performance<p><small>Jun <var data-var='date'> 6</var>, <var data-var='time'>14:04</var> CAT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'> 6</var>, <var data-var='time'>12:59</var> CAT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jun <var data-var='date'> 6</var>, <var data-var='time'>12:56</var> CAT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Jun <var data-var='date'> 6</var>, <var data-var='time'>12:53</var> CAT</small><br><strong>Investigating</strong> - We are currently investigating an issue where users are being logged out of the dashboard after 15 - 20 mins. Additionally we are are seeing intermittent login failures on the dashboard.</p>