CSE-IT Major Incident Alerted 5/20/19: At 9:52am.
"One of CSE-IT's file servers ran out of disk space. Users whose home directory resides on this server will be unable to log in or create new files. We are working to correct this situation and hope to have it resolved soon."
mail.cs was affected by a compromised email account. CS mail is currently down and mail delivery will be impacted for several days. We will post updates here when we have them. If you have any questions or concerns please email email@example.com.
Update 1:50 PM: CS mail has been brought back online and is processing a large backlog of emails. Users will likely still have significant mail delivery delays.
The File server cs-fs-13 was experiencing issues. This has lead to login issues with the CSELab Machines and Vole. The CSE-IT Administrators have rebooted the cs-fs-13 file server. The issue seems to be resolved at this time. If you are still having any issues email us at firstname.lastname@example.org
We are currently experiencing issues with two of our VOLE nodes. We are aware of the issue and are working on a fix. You will likely see the error "All configured authentication methods failed" and "Socket error when logging in: client-socket"
For future status updates, information can be found on the Office of Information Technology's IT Service Status page: https://umnprd.service-now.com/sysstatus/?km
We are currently experiencing issues with one of our Vole nodes. We are aware of the issue and are working on a fix. You will likely see the error (Xrdp failed to start: Exit Code 1)
Update 2:00PM: We have found the root cause of this error to be a full /tmp directory on one of the nodes. This has been cleared up and users should not have any other issues. Let us know if you are still experiencing difficulties by contacting email@example.com.
CS Samba shares are currently affected by an ongoing issue with nfs mounts. The issue seems intermittent so you may be able to mount your Samba share and then no longer be able to access it. We are aware of this issue and are working on a fix.
Sometime after the maintenance window, users began reporting login issues and issues opening browsers on CS Unix machines. The login issue usually manifests as windows not appearing and only a cursor or windows appearing without a cursor. We currently believe the issues with opening browsers and the login issues are connected. We are currently working on troubleshooting this issue and will keep you updated. Thank you for your patience.
Vole 3D was down completely beginning after the maintenance window on Sunday. We recognized this problem this morning and have rebooted the Vole nodes. As the nodes come back up you should be able to connect to Vole 3D however, our SSL certificate has expired for vole 3D. This means you will still be able to connect to Vole 3D but your browser will warn you that the certificate has expired and you must confirm that you want to continue connecting.
The firewall in the DTC is experiencing issues. This has led to networking issues in the DTC. Since many of our services depend on the network users may experience different issues that are associated with this. These include but are not limited to: Not being to access the internet, not being able to login to your machine, your machine "freezing", and, not being able to print. There may be other issues you are experiencing that are not listed explicitly here as well. We will keep you updated and are working on getting this issue fixed ASAP.