February 2017

No incidents reported for this month.

January 2017

[Scheduled] Event Cluster Storage Expansion
Maintenance is complete. All systems functioning normally as expected.
Jan 10, 16:30-17:02 CST
[Scheduled] Event Cluster Storage Expansion
The scheduled maintenance has been completed.
Jan 10, 09:30-12:49 CST

December 2016

[Scheduled] Release of a new Cloud Integration, stay tuned for more details!
TrueSight Pulse now offers native Microsoft Azure cloud monitoring!
Dec 13, 11:18-11:54 CST
[Scheduled] Data Migration Cleanup
All systems functioning normally.
Dec 8, 23:40 CST
[Scheduled] Data Migration Cleanup
All systems are functioning normally.
Dec 8, 11:12 CST
[Scheduled] Data Migration Cleanup
All systems are functioning normally.
Dec 6, 23:04 CST
[Scheduled] Maintenance (Data Architecture)
Maintenance activities are complete. All systems are functioning normally.
Dec 6, 09:21-15:54 CST

November 2016

No incidents reported for this month.

October 2016

[Scheduled] Infrastructure upgrades
Maintenance was completed on time with no outstanding issues.
Oct 26, 07:13 CST
Event Service Issues starting at 12:52 PM (PST)
The Event Collection Service has been resumed and all systems are fully functional.
Oct 11, 15:41 - Oct 15, 16:15 CST

September 2016

[Scheduled] Infrastructure upgrades
The scheduled maintenance has been completed.
Sep 6, 11:58 CST

August 2016

[Scheduled] Event storage cluster expansion
event capacity expansion was completed with no service interruption.
Aug 30, 16:42 CST
[Scheduled] Kafka Node Update
The scheduled maintenance has been completed.
Aug 10, 12:47-12:47 CST
[Scheduled] Alarm updates
Alarm maintenance was completed without incident.
Aug 3, 13:41 CST
False connectivity alarms
At 11:32 CST we reconfigured part of our alarming systems, and that resolved the immediate issue. RCA is ongoing, but at present everything is operating normally.
Aug 1, 11:34-13:04 CST
[Scheduled] Scheduled Maintenance for Aug 1st 8am (PST) to 11am (PST)
Maintenance was completed.
Aug 1, 13:00 CST

July 2016

Event Service Issues starting at 4:08 AM (PST)
Events continue to look good. Please contact help@truesight.bmc.com if you have any questions or noticed any anomalies.
Jul 29, 12:00 - Jul 30, 14:03 CST
Problems with Events
The cluster was restored at 7:30pm (PST). While there was no impact to any of the metric data, a subset of events between 1:30 PM to 5:30 PM are not accessible. We apologize for the inconvenience, the monitoring and infrastructure has been updated and should help in mitigating these issues in the future.
Jul 27, 21:43-23:33 CST

June 2016

No incidents reported for this month.

May 2016

Frontend Outage
The loss of a backend system exposed a configuration error. The issue has been resolved.
May 23, 13:42-14:50 CST
[Scheduled] Architecture Changes
The scheduled maintenance has been completed.
May 16, 14:00-14:18 CST
[Scheduled] Architecture Changes
The scheduled maintenance has been completed.
May 11, 11:04 CST

April 2016

[Scheduled] Maintenance (Architecture)
The scheduled maintenance has been completed.
Apr 19, 14:01-20:00 CST

March 2016

Minor Update Resulted in Ingress Outage
During a minor update rollout to our ingress systems, a bug in an unrelated piece of software caused some code to be deployed to our API tier that was not ready for release, causing invalidation of incoming data. We have reverted the change. During this 8 minute period some custom metrics streams were dropped, resulting in gaps in 1 second data between 11:55 and 12:03 CDT. - The bug that caused the inadvertent deployment has been fixed - We are investigating ways to ensure that metrics are not dropped if our API tier is responding incorrectly
Mar 28, 15:06 CST
Public Ingress IPs Have Changed
Public ingress IPs have changed: --- old -- 54.187.219.54 54.149.174.139 54.191.178.69 --- new -- 52.36.21.67 52.37.156.237 52.37.221.50
Mar 11, 23:43 CST
[Scheduled] Systems Migration
Completed successfully!
Mar 11, 18:30-23:41 CST

February 2016

[Scheduled] URL Change
Maintenance complete
Feb 17, 18:00-18:23 CST
Meter plugin installs currently non-operational
This incident has been resolved.
Feb 2, 16:40-17:00 CST

January 2016

No incidents reported for this month.

December 2015

No incidents reported for this month.

November 2015

No incidents reported for this month.

October 2015

No incidents reported for this month.

September 2015

No incidents reported for this month.

August 2015

No incidents reported for this month.

July 2015

[Scheduled] Meter versions prior to 4.2.0-611 can no longer connect to Boundary Enterprise
The scheduled maintenance has been completed.
Jun 23, 17:15 - Jul 11, 00:00 CST

June 2015

[Scheduled] Update Your Meter Version to Receive the Latest Features and Continue Support by June 23rd 2015
The scheduled maintenance has been completed.
Jun 23, 17:00-17:15 CST

May 2015

No incidents reported for this month.

April 2015

Problem with Data Store Node
We rolled back the change that was made in order to re-analyze the issues in the staging environment. We will roll out the new code again at a point after we have ensured that this issue will no longer materialize.
Apr 8, 21:46 - Apr 10, 11:03 CST
Problems with Data Store
The problem with the data store was resolved. The issue was with the number of open files. The code was modified to rectify the issue.
Apr 8, 17:15-19:41 CST
[Scheduled] Boundary Premium Maintenance
The scheduled maintenance has been completed.
Apr 3, 20:00-21:03 CST

March 2015

[Scheduled] Deprecation of Graphdat Agents
The scheduled maintenance has been completed.
Mar 23, 05:00-17:00 CST
Dashboards Not Updating Regularly
We identified the problem and have modified the meter to be able to track the metric which would have helped us to identify the issue earlier. We are now in a state where we can resolve this issue before it becomes an issue by using Boundary.
Mar 4, 16:40 - Mar 5, 09:54 CST
Momentary Graph Disruption
At 1:30 PM CST today, several of the services in the backend re-started themselves due to a race condition. The display of data was temporarily affected, but there was no data loss. The services came back online and the system is currently running smoothly. There was no data loss in either this disruption or the previous disruption.
Mar 4, 14:19 CST
Momentary Outage
At 12:00 PM today, several of the services in the backend re-started themselves due to a race condition. The display of data was temporarily affected, but there was no data loss. The services came back online and the system is currently running smoothly.
Mar 4, 12:12 CST
Boundary Dashboards Not Updating Regularly
While we are continuing to make updates in order to improve the recoverability of the backend components, we believe that we have resolved the primary issues which caused this issue in the first place. As previously stated, it centered around timing issues between the backend services and was exacerbated by an issue in the Linux kernel. We have updated both components and have seen no service interruption since the components were updated.
Mar 2, 10:26 - Mar 3, 15:44 CST
Premium Data Incident
This incident has been resolved.
Feb 24, 18:48 - Mar 2, 10:24 CST

February 2015

Problems with deadlocking backend components
System almost caught up
Feb 26, 14:36-14:38 CST

January 2015

Premium API Services Down
This incident has been resolved.
Jan 12, 18:51 - Jan 13, 09:39 CST
Enterprise Data Incident
Our Enterprise service is back to full operations.
Jan 7, 09:30 - Jan 8, 08:45 CST

December 2014

No incidents reported for this month.

November 2014

No incidents reported for this month.

October 2014

No incidents reported for this month.

September 2014

No incidents reported for this month.

August 2014

Enterprise Streaming Delay Incident
The streaming issue has been resolved and graphs are in real time again. No data was lost.
Aug 12, 21:01 - Aug 13, 00:07 CST
Premium Data Incident
The data incident has been resolved. A subset set of customers may see partial metric data loss.
Aug 12, 20:46-21:43 CST