2012.05.09 Software issue affected VoIP cluster 5

2012.05.09 09:35 (PDT) Approximately

We started receiving calls from users stating that phones were disconnecting  from the server. Recognizing the scope of the issue we immediately identified a  server issue. VoIP cluster 5 had stopped handling calls. Attempts to restart  the software failed as the software was becoming unresponsive immediately on  restart.

Suspecting a hardware failure, we transfered service to one of the two backup machines for this cluster, however as phones started to register on the newly  active server the problem re-occured.

This confirmed a software issue. By reviewing logs we were able to determine  that a bug in the server software was being triggered by a seldom used feature  that was malfunctioning. We implemented a block of that feature and    restarted.

Phones re-registered without issue. First registrations were seen    approximately at 10:00.

We will transfer back to the primary server later tonight and re-test

We appologize for the inconvenience the issue has caused and appreciate the  efforts of many users to submit detailed descriptions of the problem. Thank   you.

Bitblock Systems Inc.