System and Infrastructure Status News
FASTER Maintenance Wednesday, 8 February 2023
PublishedInfrastructure News Type: Outage Full
Affected Infrastructure: faster.tamu.access-ci.org
Start Date: February 8, 2023, 3:00 p.m.
End Date: February 9, 2023, 2:00 a.m.
FASTER will be unavailable from 9a to 8pm for software and hardware maintenance.
Posted: March 20, 2026
Stampede2 Status Saturday 28 January 2023
PublishedInfrastructure News Type: Outage Full
Affected Infrastructure: stampede2.tacc.access-ci.org
Start Date: January 28, 2023, 7:19 p.m.
End Date: January 29, 2023, 5:59 a.m.
Stampede2 is currently experiencing issues with the /scratch filesystem and queues will remain down for a prolonged duration as the issues are investigated.
Posted: March 20, 2026
Delta Notice: Delta projects (taiga) file system currently unavailable
PublishedInfrastructure News Type: Outage Partial
Affected Infrastructure: delta-cpu.ncsa.access-ci.org, delta-gpu.ncsa.access-ci.org
Start Date: December 24, 2022, 6:01 a.m.
End Date: December 27, 2022, 5:59 a.m.
The /projects file system has been returned to service and is again available. Users who had blocks on their workloads due to dependencies on the /projects file system have been removed. The slurm Feature for projects has been added back to the compute nodes. We apologize for the delay in getting the /projects file system back in service. Please send questions to help@ncsa.illinois.edu (mailto:help@ncsa.illinois.edu) and be sure to mention Delta in the subject or message body. -------------------------------------- The Delta projects (/projects) file system is currently unavailable. NCSA staff are working with the vendor to return the file system as soon as possible. Jobs already in the queue have been put on hold that reference the /projects as a slurm Feature. Users with jobs in the queue are currently not able to run jobs if they have jobs that have a slurm job variable which references /projects such as a working directory, a submit directory or a location for job stdout/stderr. Jobs that do not require the /projects or /taiga file system as a Feature will be allowed to run. See File System Dependency Specification for Jobs (https://wiki.ncsa.illinois.edu/display/DSC/Delta+User+Guide#DeltaUserGuide-FileSystemDependencySpecificationforJobs) for information on how to specify file systems as a job Feature. We will provide updates on the status of the projects file system as they become available. Please send questions to help@ncsa.illinois.edu (mailto:help@ncsa.illinois.edu) and be sure to mention Delta in the subject or message body.
Posted: March 20, 2026
Delta core router preventative maintenance 12-20-2022
PublishedInfrastructure News Type: Outage Partial
Affected Infrastructure: delta-cpu.ncsa.access-ci.org, delta-gpu.ncsa.access-ci.org
Start Date: December 20, 2022, 2:00 p.m.
End Date: December 20, 2022, 3:00 p.m.
Update: Maintenance is complete. The Delta core router will undergo preventative maintenance from 8:00AM to 9:00AM CST on Tuesday December 20th, 2022. The Delta core router provides connectivity between the Delta resource and the outside world. External access to or from Delta compute resources (dt-login and compute nodes) and to Delta services (Open OnDemand, Globus Online endpoint) will be unavailable during the maintenance period. Non-interactive jobs should not be impacted as internal connectivity between compute nodes and storage will not be affected. A follow-up message will be sent once maintenance is complete. Please send questions to help@ncsa.illinois.edu (mailto:help@ncsa.illinois.edu) and be sure to mention Delta in the subject or message body. --Delta Project Office
Posted: March 20, 2026
ACCESS Metrics XDMoD Update - UPDATED
PublishedInfrastructure News Type: Outage Partial
Affected Infrastructure: xdmod.access-ci.org
Start Date: November 30, 2022, 7:01 p.m.
End Date: December 13, 2022, 4:59 a.m.
The work to bring the new Allocations information online has now been completed. ---------------------------------------------------------------------------------------------------------- ACCESS XDMoD (https://xdmod.access-ci.org/ ) may experience some temporary performance degradation while work is done to bring the new Allocations information online. Chart load times may be slower than usual. Another notice will be sent when the work is complete.
Posted: March 20, 2026
Jetstream2: Partial Network Outage
PublishedInfrastructure News Type: Outage Partial
Affected Infrastructure: jetstream2.indiana.access-ci.org, jetstream2-gpu.indiana.access-ci.org, jetstream2-lm.indiana.access-ci.org, jetstream2-storage.indiana.access-ci.org
Start Date: November 30, 2022, 1:45 a.m.
End Date: November 30, 2022, 2:23 p.m.
UPDATE - 9:23am Eastern Network engineers have restored access to the 149.165.168.0/21 CIDR block. While they are still working on the failed networking equipment, that network is now routed via other means and connectivity appears to be fully restored. ---- UPDATE - 10:53pm Eastern There is an outage on the research network hardware that presently serves the 149.165.168.0/21 routes for Jetstream2. Network engineers are assessing the issue. There is no estimated time for return to full operations at this time. ----- It appears that the network routing outside Jetstream2 for our newest subnet (149.165.168.0/21) is no longer functioning. We have alerted our Network Operations Center for diagnosis and resolution as it is outside of Jetstream2. VMs with IPs in other ranges (i.e. anything under 149.165.168.0 are not presently affected). We will update as soon as we have more information.
Posted: March 20, 2026
Jetstream2 rolling updates over the next few days
PublishedInfrastructure News Type: Reconfiguration
Affected Infrastructure: jetstream2.indiana.access-ci.org, jetstream2-gpu.indiana.access-ci.org, jetstream2-lm.indiana.access-ci.org, jetstream2-storage.indiana.access-ci.org
Start Date: November 10, 2022, 6:13 p.m.
End Date: November 13, 2022, 6:13 p.m.
Jetstream2 is upgrading compute nodes and infrastructure in preparation for an OpenStack upgrade in December. You may see brief pauses in VMs as they are live migrated to other compute nodes. There should not be downtimes. GPU nodes are being updated as they empty since we cannot presently live migrate GPU instances. We will likely have a planned outage in coming weeks for GPU node maintenance and will notify users here and via https://jetstream.status.io/ as well.
Posted: March 20, 2026
Ranch Storage Expansion Tuesday, 1 November 2022
PublishedInfrastructure News Type: Outage Partial
Affected Infrastructure: ranch.tacc.access-ci.org
Start Date: November 1, 2022, 2:00 p.m.
End Date: November 2, 2022, 2:00 a.m.
Ranch will be undergoing tape storage expansion from 9:00 AM (CDT) until 9:00 PM on Tuesday, 1 November 2022. Ranch will be up for data ingestion but unavailable for data recovery during this time. Users will be delayed in reading their older data off of tape during this downtime. Please submit any questions you may have via the TACC User Portal. https://portal.tacc.utexas.edu/tacc-consulting
Posted: March 20, 2026
ACCESS Duo Suspension of Service - UPDATED
PublishedInfrastructure News Type: Reconfiguration
Affected Infrastructure: identity.access-ci.org
Start Date: October 28, 2022, 7:10 p.m.
End Date: October 28, 2022, 9:15 p.m.
Duo has been re-enabled on the ACCESS IdP at https://idp.access-ci.org/ (https://idp.access-ci.org/idp/) . ------------------------------------------------- Previously: Due to ongoing issues with Duo licensing, Duo has informed us that they will be downgrading our service until the issue gets resolved. As a result we will have to suspend the Duo authentication component of the ACCESS IdP at idp.access-ci.org. We expect this to be a seem-less transition and for web authentication to continue to function with your ACCESS identity. Any issues encountered should be reported to the ACCESS ticket system at: https://support.access-ci.org/open-a-ticket
Posted: March 20, 2026
FASTER Maintenance Thursday, Oct. 20, 2022
PublishedInfrastructure News Type: Outage Full
Affected Infrastructure: faster.tamu.access-ci.org
Start Date: October 20, 2022, 2:00 p.m.
End Date: October 21, 2022, 1:00 a.m.
The FASTER cluster will be unavailable from 9am to 8pm on Thursday, October 20th. Software and hardware maintenance will be performed during this downtime. Queued jobs will not start if they overlap with this maintenance window. For questions or concerns, please e-mail help@hprc.tamu.edu
Posted: March 20, 2026
CILogon Update for ACCESS Single Sign-On (SSO)
PublishedInfrastructure News Type: Reconfiguration
Affected Infrastructure: identity.access-ci.org
Start Date: October 17, 2022, 1:00 p.m.
End Date: October 17, 2022, 1:30 p.m.
https://cilogon.org will be updated with quality-of-life improvements for ACCESS users, including enterprise-style Single Sign On (SSO). Please see https://cilogon.statuspage.io/incidents/hm97jc36qspy for details.
Posted: March 20, 2026
Stampede2 emergency maintenance beginning now
PublishedInfrastructure News Type: Outage Full
Affected Infrastructure: stampede2.tacc.access-ci.org
Start Date: October 14, 2022, 2:24 a.m.
End Date: October 15, 2022, 1:00 p.m.
Stampede2 is currently experiencing a file system outage. The system will be unavailable while emergency maintenance is performed. Queues will be closed during this time. We will be able to update with an estimated recovery when we're further along in the restoration. Please submit any questions you may have via the TACC User Portal. https://portal.tacc.utexas.edu/tacc-consulting 10/14/2022 Afternoon Update Stampede2 emergency maintenance is ongoing. Admins will continue working to restore service as soon as possible. We will update User News when the machine is returned to service. Thank you for your patience. 10/15/2022 Morning Update Stampede2 is back in production. Emergency maintenance has ended.
Posted: March 20, 2026
Publish metadata for idp.access-ci.org to InCommon
PublishedInfrastructure News Type: Reconfiguration
Affected Infrastructure: identity.access-ci.org
Start Date: October 11, 2022, 1:00 p.m.
End Date: October 11, 2022, 10:00 p.m.
On Tuesday, October 11, 2022, the metadata for idp.access-ci.org (https://identity.access-ci.org/access-metadata.xml) will be published to InCommon (https://spaces.at.internet2.edu/display/federation/Metadata+Service). This will enable Service Providers to use InCommon's Metadata Query (MDQ) service (https://spaces.at.internet2.edu/display/MDQ/production-metadata) for idp.access-ci.org (https://idp.access-ci.org/idp/). Metadata will be added to the InCommon Federation Manager (https://service1.internet2.edu/siteadmin/) in the morning. Updated metadata is typically published by 5:00pm (Eastern time), although availability via the MDQ service may be earlier. For questions or concerns, please contact help+idp@ncsa.illinois.edu (mailto:help+idp@ncsa.illinois.edu).
Posted: March 20, 2026
Coolant outage at IU Data Center affecting Jetstream2
PublishedInfrastructure News Type: Outage Partial
Affected Infrastructure: jetstream2.indiana.access-ci.org, jetstream2-gpu.indiana.access-ci.org, jetstream2-lm.indiana.access-ci.org
Start Date: September 21, 2022, 6:50 p.m.
End Date: September 21, 2022, 8:16 p.m.
Update: Vendor issue with coolant caused thermal shutdown on Jetstream2 compute nodes. These have all been returned to service at this time. If your VM is not reachable, you may need to reboot it via the interface of your choice. ---- There was a coolant outage at the IU Data Center in Bloomington. Engineers are investigating this issue now. Direct cooled nodes went into thermal shutdown. Jetstream2 engineers are working to bring these back online presently.
Posted: March 20, 2026
ACCESS ticketing system undergoing maintenance 9/6 at 2pm ET
PublishedInfrastructure News Type: Outage Full
Affected Infrastructure: tickets.access-ci.org
Start Date: September 6, 2022, 6:00 p.m.
End Date: September 6, 2022, 6:30 p.m.
Update: due to a high volume of problems, we are moving up the maintenance to 2pm ET At 9pm ET (6pm PT), the ACCESS ticketing system undergoing maintenance to increase the server memory. We estimate that the system will be down for less than 30 minutes.
Posted: March 20, 2026
ACCESS ticketing system DB inaccessible
PublishedInfrastructure News Type: Outage Partial
Affected Infrastructure: tickets.access-ci.org
Start Date: September 4, 2022, 11:00 p.m.
End Date: September 5, 2022, 12:00 a.m.
The ACCESS ticketing system's DB is inaccessible. Admins are working to restore full functionality
Posted: March 20, 2026
ACCESS Operations Portal now live
PublishedInfrastructure News Type: Reconfiguration
Affected Infrastructure: operations.access-ci.org
Start Date: August 30, 2022, 1:00 a.m.
End Date: December 31, 2022, 2:00 p.m.
The ACCESS Operations portal at https://operations.access-ci.org/ is now live. It includes high-level introductions to the ACCESS Operations project, including ACCESS infrastructure integration approaches, ACCESS operations policies, procedures, and best practices, infrastructure news and outages publishing, and ACCESS provided online services.
Posted: March 20, 2026
ACCESS Ticketing System now live!
PublishedInfrastructure News Type: Reconfiguration
Affected Infrastructure: tickets.access-ci.org
Start Date: August 29, 2022, 1:00 p.m.
End Date: December 31, 2022, 2:00 p.m.
The ACCESS Request Tracker ticketing system now live! The XSEDE ticketing system redirects to ACCESS, please update your bookmarks: tickets.access-ci.org
Posted: March 20, 2026
