Processing Issues Resolved! 03.10.2015 Issue Explanation

A major power outage occurred this morning in Nashville that affected our co-production site starting around 8:00am CT this morning.  Although this site was configured to withstand a power outage, a problem with their UPS system caused their location to lose power until around 9:30 am.  This caused slowness and timeouts for customers that were directed to the co-location and caused Medical Necessity to fail.  Our systems team began redirecting our traffic to Franklin immediately, but the backlog of transactions caused slow response times until around 10:30am CT.  Most Medical Necessity customers began accessing data around 10:30 as well.  Our current datacenter vendor has assured us that they are taking steps to prevent this from happening again.  However, we intend to explore other options.  We apologize for disrupting your workflow!

[11:55] Real-time processing is currently normal for all products.  There may be sporadic issues with Medical Necessity alerts, but otherwise no processing problems.  We sincerely appreciate your patience!

[11:30] We continue to monitor processing for any slowness.  There is still a backlog of requests for IntelliSource customers, but most products are processing real-time transactions normally.  We appreciate your patience!

[11:00] We continue to process the backlog of requests, so there may be intermittent slow response times.  However, the overall processing is greatly improved.  Additionally, most Medical Necessity customers are back online.

[10:30] OneSource, EDI, IntelliSource, eCare NEXT still running slightly slower than normal, but dramatically improved over the past hour. We are in the process of bringing Medical Necessity back online in the next 30 minutes. You may check for updates on this site every 15-30 minutes.

[10:00]  OneSource, EDI, IntelliSource, eCare NEXT still running slower than normal, but improving.  We are in the process of bringing Medical Necessity back online.  You may check for updates on this site every 15-30 minutes.

Be certain to check back here for updates approximately every 15 minutes.

[9:35] Processing for Franklin products (eCare NEXT, EDI, OneSource, IntelliSource) has improved, but Medical Necessity products are still not available.  Be certain to check back here for updates approximately every 15 minutes.

[9:15] We are continuing to work on moving all of our traffic to another datacenter.  Processing is much slower than normal.  Unfortunately, Orders products are completely unavailable.

[8:45]  Our co-production site is having production issues that are affecting our main data center.  We have resources onsite and are working to isolate the issue and restore processing to normal.

[8:30]  We continue to research an issue that is causing slowness for multiple products. It is our top priority to resolve these issues ASAP. Currently, we do not have an estimated fix time.

[8:00]  We are researching an issue that is causing slowness for multiple products.  It is our top priority to resolve these issues ASAP.  Currently, we do not have an estimated fix time.

This entry was posted in Archived Posts. Bookmark the permalink.