Information Technology
Information Technology
This page contains details about all IT service outages during the 2008-09 academic year.
|
Event |
Event |
Outage |
Scheduled? |
Announcement |
Event |
Event |
Event |
|---|---|---|---|---|---|---|---|
| 05/11/09 | Intermittant over 9 hours | Intermittant full outages | No | N/A | Multiple power interruptions in SS 002 computer facility | Event limited to GS320 - loss of all production level Banner services | Power interruptions ceased, no further service interruptions |
| 05/04/09 | 17 hours | Full | Yes | 05/04/09 | Banner Scheduled Maintenance | All Banner databases and UM web database down | Banner maintenance completed |
| 04/30/09 | 15 minutes | Full | Yes | 04/30/09 | Install fix for Banner login problems following 04/24/09 INB upgrade | Banner INB ADMN and HCADMN databases down, CyberBear up | Fix installed, service restored |
| 04/27/09 - 04/28/09 | N/A | Partial | No | N/A | Intermittant client configuration issues with accessing Banner INB | Browser configuration issues - changes required for upgraded Oracle software | Various advisotries issued, work with individual users |
| 04/24/09 | 31 hours | Partial | Yes | 04/22/09 04/24/09 |
Banner INB down for upgrade of front-end INB servers | Upgrade to Oracle iAS on INB front-end servers, INB users affected, CyberBear users and batch applications unaffected | Upgrade completed |
| 04/13/09 - 04/15/09 | 2 days | Partial | Yes | N/A | Refresh UM Foundation test database | Foundation test database unavailable to users | Database refresh completed |
| 04/06/09 | 17 hours | Full | Yes | 04/06/09 | Banner scheduled maintenance | All Banner databases and UM web database down | Banner maintenance completed,faulty GS320 CPU 12 replaced |
| 03/30/09 | 6.25 hours | Full | No | N/A | GS320 Parity Error | Banner inaccesible - GS320 rebooted but listeners and batch & print queues did not come up | Replace CPU at next Banner downtime |
|
03/11/09
|
7 hours
|
Full
|
Yes
|
03/11/09
|
Banner down for monthly maintenance | Monthly maintenance | Maintenance Completed |
|
03/05/09
|
2 minutes
|
Full
|
No
|
N/A
|
Banner ADMN (Production) instance Reload | Reload Completed | |
|
02/20/09
|
2.5 hours
|
Partial
|
No
|
N/A
|
Banner REPORT instance unavailable | Banner REPORT late cominging up. Most likely related to long running batch processes. | Processes completed; REPORT came up. |
|
02/17/09
|
1.5 hours
|
Partial
|
No
|
N/A
|
Banner ADMN instance partially unavailable | Problems for some users logging in to Banner - result of testing of Academic Course Planner application | Academic Course Planner test terminated by DBAs - Banner service restored about 11:30 |
|
02/09/09
|
7 hours
|
Full
|
Yes
|
02/09/09
|
Banner down for monthly maintenance | Monthly maintenance | Maintenance Completed |
|
02/09/09
|
1.75 Hours
|
Full
|
No
|
N/A
|
Users unable to connect to Banner | Banner connectivity problem - required restart of listener | Listener restarted - Banner connectivity restored |
|
01/14/09
|
ongoing
|
Partial
|
No
|
N/A
|
Banner INB certificate issues reported | Banner users report certificate expired error when accessing Banner INB | Temporary fix advertised -- turning off cert checking features in various browsers. DBAs opened case with Oracle & SunGard |
|
01/12/09
|
7 hours
|
Full
|
Yes
|
|
Banner down for monthly maintenance | Monthly maintenance | Maintenance Completed |
|
12/30/08
|
5 hours
|
Partial
|
No
|
N/A
|
Banner REPORT instance unavailable | Banner REPORT late cominging up. | |
|
12/12/08
|
2 Minutes
|
Full
|
No
|
N/A
|
Banner ADMN instance reload | Bounce required to fix an Oracle Reports Issue | Reload Completed |
|
12/08/08
|
7 hours
|
Full
|
Yes
|
12/08/08
|
Banner down for monthly maintenance | Monthly maintenance | Maintenance Completed |
|
11/12/08
|
8 hours
|
Full
|
Yes
|
11/12/08
|
Banner down for monthly maintenance | Monthly maintenance | Maintenance Completed |
|
10/06/08
|
7 hours
|
Full
|
Yes
|
10/06/08
|
Banner down for monthly maintenance | Monthly maintenance | Maintenance Completed |
|
09/22/08
|
7 hours
|
Full
|
Yes
|
09/22/08
|
Banner down for monthly maintenance | Monthly maintenance | Maintenance Completed |
|
09/08/08
|
4 hours
|
Partial
|
No
|
N/A
|
Banner REPORT instance unavailable | Banner REPORT late cominging up. |
|
Event |
Event |
Outage |
Scheduled? |
Announcement |
Event |
Event |
Event |
|---|---|---|---|---|---|---|---|
|
05/28/09
|
5 minutes
|
Partial
|
No
|
N/A
|
Power failure |
Gallagher Building affected |
Power restored |
|
05/27/09
|
1 hour
|
Partial
|
No
|
N/A
|
Router software upgrade |
CRMW, Fort Missoula, CoT West, & University Villages affected |
Upgrade completed |
|
05/26/09
|
5 minutes
|
Partial
|
Yes
|
N/A
|
Switch software upgrade |
Brantly Hall & Washington-Grizzly Stadium affected |
Upgrade completed |
|
05/23/09
|
5 minutes
|
Partial
|
No
|
N/A
|
Power failure |
Miller Hall 3rd floor affected |
Power restored |
|
05/19/09
|
5 minutes
|
Partial
|
No
|
N/A
|
Power failure |
Generator test at Physical Plant Bldg. interrupted power |
Power restored |
|
05/19/09
|
5 minutes
|
Partial
|
No
|
N/A
|
Power failure |
Generator test at Physical Plant Bldg. interrupted power |
Power restored |
|
05/19/09
|
12 hours
|
Full at University Villages office
|
No
|
N/A
|
Qwest T1 circuit failure |
Data and Voice affected at University Villages office |
Qwest restored circuit |
|
05/18/09
|
13 hours
|
Partial
|
No
|
N/A
|
Power failure |
Chemistry 1st floor switch affected |
Power restored |
|
05/17/09
|
5 minutes
|
Partial
|
No
|
N/A
|
Campus-wide electrical outage |
Approx. 30% of campus buildings affected |
Power restored |
|
04/29/09
|
4 minutes
|
Partial
|
No
|
N/A
|
Electrical outage - ISB 2nd floor |
ISB 2nd floor affected |
Power restored |
|
04/28/09
|
4 hours
|
Full at MT Tech remote site
|
No
|
N/A
|
Power failure at MT Tech-Billings remote site |
MT Tech Billings remote site unable to communicate with MT Tech |
Power restored |
|
04/28/09
|
2 minutes
|
Full at FLBS
|
No
|
N/A
|
Power failure at FLBS |
FLBS network down |
Power restored |
|
04/23/09
|
10 hours 45 minutes
|
Partial
|
No
|
N/A
|
Switch malfunction - Anderson Building 4th floor |
Devices using Journaism's AVID storage system were the only things affected |
Switch rebooted, service restored |
|
04/21/09
|
45 minutes
|
Partial
|
No
|
N/A
|
Bad 10Mb hub |
4th floor LA affected |
Hub replaced, service restored |
|
04/20/09
|
No data
|
Full at affected site
|
Yes
|
N/A
|
Data connection down |
Avian Research Lab at Ft. Missoula affected | T1 card at UM-M campus replaced, service restored |
|
04/18/09
|
5 minutes
|
Full outage of SummitNet core
|
Yes
|
None
|
Bresnan network outage | Bresnan maintenance - SummitNet core affected | Maintenance completed, service restored |
|
04/08/09
|
1 hour 7 minutes
|
Partial
|
No
|
N/A
|
Bresnan network outage | 1 Gb link to UM-Missoula only UM-to-State traffic | Service restored |
|
03/31/09
|
Unknown
|
Partial Slow Down
|
No
|
No
|
Unknown network slow down | Affected non-upgraded buidings on south half of campus | Faulty Cisco Catalyst 5000 switch in NTSG |
|
3/31/2009
|
20 minutes
|
Partial
|
No
|
N/A
|
Schreiber Gym Building netowrk outage | Malfunctioning PC - Bad NIC flooded building network | PC Isolated - service restored |
|
3/30/2009
|
|
Full at FLBS
|
No
|
N/A
|
FLBS Network outage | Infected Domain Controller at FLBS | Domain Controller rebuilt |
|
3/30/2009
|
5 minutes
|
Partial
|
No
|
N/A
|
Network outage in Natural Science Building | Power strip accidentally unplugged by worker | Power to power strip restored |
|
3/27/2009 - 3/28/2009
|
8 hours
|
Full
|
Yes
|
03/16/09, 03/25/09, 03/27/09
|
Social Science Core Router replacement / LA server room electrical work | Campus netowrk down, Internet & central services down for all campuses | Work completed, service restored |
|
3/27/2009
|
1 minute
|
Partial
|
No
|
N/A
|
Qwest local T1 failure | Voice and data services to CRMW interrupted | T1 reset by Qwest, service restored |
|
3/24/2009
|
8 minutes
|
Full
|
No
|
N/A
|
Qwest DID/DOD T1 failure | Outside voice service to/from campus interrupted | T1 reset by Qwest, service restored |
|
3/23/2009
|
4 minutes
|
Full
|
No
|
N/A
|
Chemistry Building electrical failure | Service to all floors affected | Electrical power restored |
|
3/20/2009
|
0 minutes
|
Partial
|
No
|
N/A
|
Network issue - Lommasson 1st floor | Unknown interface issue (no impact to end users) | N/A |
|
3/19/2009
|
I minute
|
Partial
|
No
|
No
|
UNKNOWN - Voice issue | MSU-established calls would be cut off | Line reset, service restored |
|
3/18/2009
|
1.5 hours
|
Partial
|
No
|
N/A
|
UNKNOWN-Reboot Wireless Access Point | Clapp- 3rd Floor Wireless (only 1 WAP of 2 affected) | WAP rebooted, service restored |
|
3/17/2009
|
2 minutes
|
Partial
|
Yes
|
No
|
Voice issue - Reset T1 to State Capitol | Established calls to State Capitol would be cut off | T1 reset by Qwest, service restored |
|
3/17/2009
|
1 minute
|
Partial
|
No
|
N/A
|
UNKNOWN Voice Issue - T1 to Kalispell | Established calls to Kalispell would be cut off | T1 reset by Qwest, service restored |
|
3/16/2009
|
8 minutes
|
Partial
|
No
|
N/A
|
UNKNOWN ATM Circuit Issue | Communications to MT Tech, UM-Helena, UM-Western afftected | Service restored |
|
3/16/2009
|
3 minutes
|
Full
|
No
|
N/A
|
Chemistry Building electrical failure | Service to all floors affected | Electrical power restored |
|
3/15/2009
|
7 minutes
|
Partial
|
No
|
N/A
|
Electrical Storm outage | Lewis & Clark and University Villages, Craighead Apts., CRMW, 6th Street houses all afected | Electrical power restored |
|
3/13/2009
|
|
Full
|
No
|
N/A
|
Miller Hall electrical failure | Service to all floors affected | Electrical power restored |
|
03/11/09
|
|
Partial
|
No
|
N/A
|
Building server flooding buiding network | Education building affected | |
|
03/10/09
|
|
|
No
|
N/A
|
Electrical failure | Miller Hall | Electrical power restored |
|
02/19/09
|
1.5 hours
|
Full for south half of campus
|
Yes
|
02/17/09
|
Replace core router - Clapp building | Dorms and South half of campus affected | Router repacement completed, service restored |
|
FEB. 2009
|
|
|
No
|
N/A
|
Switch failure | Craig Hall | Switch replaced, service restored |
|
01/30/09
|
15 minutes
|
Full
|
Yes
|
Yes
|
Reboot core routers | All campus and WAN sites unavailable | Reboot completed, service restored |
|
01/22/09
|
|
|
No
|
Yes
|
Switch failure resulting from electrial outage | Skaggs complex affected | Switch replaced, service restored |
|
01/05/09
|
|
Partial
|
No
|
N/A
|
Campus-wide electrical outage (Law construction) | Campus-wide outage -- Social Science and Clapp core routers stayed up | Campus electrical service restored |
|
JAN. 2009
|
N/A
|
Full at FLBS
|
No
|
N/A
|
Power outage | Flathead Lake Biological Station | Power restored |
|
11/04/08
|
|
|
Yes
|
Yes
|
Reboot firewall | Internet/I2 and off-campus access to UMM campus affected | Reboot completed, service restored |
|
10/01/08
|
15 minutes
|
Partial
|
Yes
|
09/30/08
|
Reboot core routers | LA core router reboot 5:00 am, Clapp core router reboot 5:05 am, SS core router reboot 5:10 am | Reboot completed, service restored |
|
SEPT. 2008
|
|
|
Yes
|
Yes
|
Reboot WAN router | WAN locations affected (MT Tech, UM-Western, UM-Helena, ……) | Reboot completed, service restored |
|
?
|
|
N/A
|
Yes
|
N/A
|
Software upgrades | Minimal Impact | Software upgrade completed |
|
?
|
|
|
No
|
N/A
|
Virus in Anderson Hall - DoS attack | Internet/I2 and off-campus access to UMM campus affected | Infected machine located and isolated, service restored |
|
?
|
|
Partial
|
No
|
N/A
|
Reboot VPN concentrator | On- and off-campus VPN users affected | Reboot completed, service restored |
|
?
|
|
|
No
|
N/A
|
Qwest circuit outage | UM-Western affected | Qwest restored circuit |
|
?
|
|
Partial
|
No
|
N/A
|
Router failure | Center for the Rocky Mountain West | Router repaired, service restored |
|
?
|
|
Partial
|
No
|
N/A
|
Router failure | UM-Missoula CoT West Campus affected | Router repaired, service restored |
|
Weekly Recurring
|
|
Partial
|
No
|
N/A
|
Electrical failure (Generator test) | Curry Health Center | Generator test completed |
|
Weekly Recurring
|
|
Partial
|
No
|
N/A
|
Electrical failure (Generator test) | Adams Center | Generator test completed |
|
Event |
Event |
Outage |
Scheduled? |
Announcement |
Event |
Event |
Event |
|---|---|---|---|---|---|---|---|
| 05/26/09 |
3 hours scheduled, no actual interruption in service |
None | Yes | 05/26/09 |
Exchange storage reconfig to extend available free storage space | New DAE storage expansion added to Exchange CX300 storage array | Storage expansion unit installed. |
| 05/22/09 |
1 hour |
Full | Yes | Software upgrade | Upgrade Bb Production 7.3.230.0 to 7.3.230.2 | Upgrade completed, service restored | |
| 05/21/09 |
5 minutes |
Partial | Yes | 05/21/09 |
Restart of part of Exchange cluster | Correct Exchange space issue | Service restarted |
| 05/07/09 - 05/11/09 |
3 days |
Partial | No | N/A |
TSS server 'newb' removed from network; 'newb' was found to have been hijacked for use as a SPAM relay | News, events, blogs, and wiki services temporarily unavailable. | Temporary replacement for 'newb' put in place, content files cleaned and restored |
| 05/07/09 - 05/19/09 |
12 days 5 hours |
Partial | Yes | Add 2nd 3310 storage to Bb Test Environment | Bb Test environment unavailable | Storage added, full service restored | |
| 04/26/09 |
3 hours |
Partial | Yes | 04/24/09 | Space issue on one Exchange Message Store database | Compression of database required to recover space, some Exchange users (mso) were affected | Compression done, space recovered, full service restored |
| 04/15/09 - 04/22/09 |
7 days 1.5 hours | Partial | No | N/A | Blackboard upgrade of test environment failed | Upgrade of Bb Test from 7.3.230.0 to 7.3.230.2 failed; Bb Test unavailable while test environment rebuilt | Bb Test rebuild, access to test environment restored |
| 04/08/09 |
2.5 hours | Partial | No | N/A | Exchange free space issue | Certain Exchange mailboxes cleaned up or moved to free up space | Space reclaimed, full service restored |
| 3/27/09 - 3/28/09 | 5 hours | Full | Yes | 3/13/2009 | Power outage in LA004 to install emergency power-off (EPO) switches | All servers and services originating from LA004 are down | Work performed, services restored |
| 03/11/09 | 1 hour | Full | Yes | 03/11/09 | Scheduled FTP maintenance | FTP service unavailable | Maintenance completed, service restored |
| 03/06/09 | 1 hour | Partial | No | N/A | Microsoft domain controllers MUMTDC1, MSODC11, GSDC6 infected | Infection detected & blocked at firewall, domain controlelrs removed from service | Domain controllers rebuilt/replaced |
| 03/05/09 | 3.2 hours | Partial | No | N/A | POP & IMAP services on Exchange server not restored until 4:15 pm | POP, IMAP, and SSL functionality of Exchange not working | Exchange sys admins corrected problems and restarted services |
| 03/05/09 | 1 hour | Full | No | N/A | Exchange Server down | Space exhausted in e-mail stores databasesdue to "abend" aborted backup | Adjustments to storage made |
| 02/09/09 | 1 hour | Full | Yes | 02/02/09 & 02/05/09 | Blackboard and other services provided through LA computer room down for electrical move | Electrical services in LA computer room were moved affecting the availability of Blackboard and other services | Electrical move completed, services restored |
| 01/19/09 - 02/27/09 | 1.5 months | Full | No | N/A | Windows software update server (WSUS) dropped off-line | WSUS server exhausted disk storage space - apparently no one noticed | Space issues addressed, service was restored |
| 01/05/09 - 01/09/2009 | 5 hours/day for 5 days | Partial | Yes | 01/05/09 | Maintenance of Grizmail message stores, compression of data | Exchange administrators began series of message stores database compressions involving student GrizMail mailboxes | Commpression of Exchange message stored databases for faculty/staff mailboxes completed |
| 12/30/08 | 4 hours | Partial | Yes | 12/17/08 | Listserv maintenance, listserv down | UNIX administrators performed maintenance on listserv server and updated listserv software | Maintenance completed, service restored |
| 12/29/2008 | All day | Full | Yes | 12/19/2008 | Implement CAS on Blackboard LMS | Blackboard (UNIX) administrators performed work to add CAS support to Blackboard LMS | Work completed, service restored |
| 12/27/08 - 12/28/08 | 5 hours each day | Partial | Yes | 12/18/2008 | Maintenance on staff & faculty exchange message stores, compression of data | Exchange administrators continued the series of message stores database compressions | Commpression of Exchange message stored databases for faculty/staff mailboxes completed |
| 12/24/2008 | 7 hours | Partial | Yes | 12/24/2008 | Maintenance on staff & faculty exchange message stores, compression of data -- work began 2 hours early on 12/24/08 | Exchange administrators continued the series of message stores database compressions | - |
| 12/18/08 - 12/23/08 | 5 hours | Partial | Yes | 12/18/08 | Maintenance on staff & faculty exchange message stores, compression of data | Exchange administrators began series of message stores database compressions involving faculty/staff mailboxes - no user access to e-mail stores being compressed | - |
| 12/18/08 | ongoing | Partial | No | N/A | Exchange message stores space issues affecting ability of some users to access and/or send mail | Some of the message stores databases are out of space -- compression of databases must be performed | - |
| 12/14/08 | 1 hour | Partial | Yes | 12/12/08 | Exchange Manitenance intermittent outages on Sunday | Exchange administrators addressed Exchange message stores space issues | Adjustments to storage made |
| 12/03/08 | 1 hour | Full | Yes | 12/03/08 | Scheduled FTP maintenance | FTP service unavailable | Maintenance completed, service restored |
| 11/29/08 | All Day | Inermittant | Yes | 11/26/08 | Exchange system maintenance, intermittent outages | Exchange administrators addressed Exchange message stores space issues | Adjustments to storage made |
| 11/26/08 | 30 minutes | Full | No | N/A | Unscheduled OID Maintenance | NetID services unavailable (Bb, Grizmail,Mail1, etc.) | Maintenance completed, service restored |
| 11/03/08-11/05/08 | 30 hours | Full | Yes | 10/30/2008 | Install expanded storage on Blackboard LMS | Additional storage required as use of Blackboard has grown substantially | Expanded storage added. |
| 10/17/2009 | Partial | No | N/A | Exchange issues - some users unable to acces accounts | POP, IMAP, and SSL functionality of Exchange not working | Exchange sys admins corrected problems and restarted services | |
| 10/13/08 | 1 hour | Intermittant | Yes | 10/13/08 | Short intermittent Exchange issues for maintenance | Exchange administrators addressed lingering Exchange issues | Lingering Exchange issues fixed |
| 10/09/08 - 10/10/08 | 24 hours | Partial | No | N/A | POP & IMAP servivces not restored following Exchange maintenance | POP, IMAP, and SSL functionality of Exchange not working | Exchange sys admins corrected problems and restarted services |
| 10/09/08 | 1.5 hours | Partial | Yes | 10/09/08 | Exchange security maintenance | Critical security maintenance required due to CERT bulletin & MS patches | Exchange sys admins completed maintenance |
| 09/30/08 | 1.5 hours | Partial | Yes | 09/30/08 | Intermittant Exchange availabililty issues | Exchange administrators addressed Exchange message space stores issues | Adjustments to storage made |
| 09/08/08 | Partial | No | N/A | Exchange message stores space issue preventing some users from accessing Grizmail | Space exhausted in one of the approx. 55 message stores databases prevented some users from accessing e-mail | Temporary adjustments to storage made | |
| Weekly Recurring | 2 hours | Fully, weekly on Wednesday as required | Yes | Scheduled Blackboard database and patch maintenance as needed | - | - |
Information Technology
Social Sciences 126
IT Office: (406) 243-5350
IT Central: (406) 243-HELP
