CIRCE Hardware
CIRCE Hardware
Advanced computing resources at the University of South Florida are administered by Research Computing (RC). RC hosts the CIRCE (Central Instructional and Research Computing Environment) cluster computer which currently consists of approximately 372 nodes with over 9,000 processor cores running Red Hat Enterprise Linux v7. The cluster is built on the condominium model with approximately 57TB of memory shared across the nodes in various configurations. Additionally, there are 158 GPUs available. The nodes utilize either 100GB Omnipath, 100GB Infiniband, or 40GB Infiniband for a computational interconnect. There are three parallel file systems employed on CIRCE: a 2.9PB GPFS file system, a 819TB BeeGFS file system, and a 350 TB encrypted BeeGFS file system. These file systems are used to support high speed and I/O intensive computations, as well as for long-term storage. RC also provides and supports more than 120 scientific software packages for use on a variety of platforms. Remote system and file access is available from essentially anywhere. RC staff members are available to facilitate use of the cluster, as well as provide direct assistance with research projects that require high-performance computing or advanced visualization and analysis of data. User education and training sessions are also provided upon request.
- The above statement as well as any information below can be used as part of the facilities description for grant proposals, provided that it is acknowledged that these resources are administered by Research Computing at the University of South Florida.
Server Hardware
| Partition | Nodes | Core Count | Processors | Cores per Node | Memory per Node | GPUs per Node | Interconnect |
| amd_2021 | 8 | 1024 | 2x AMD Epyc 7702 CPU @ 2.0GHz | 128 | 1TB | none | 100GB Infiniband |
| bfbsm_2019 | 12 | 288 | 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz | 24 | 192GB | none | 100GB Omnipath |
| bgfsqdr | 34 | 544 | 2x Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz | 16 | 32GB | none | 40GB Infiniband |
| cbcs | 7 | 168 | 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz | 24 | 192GB | none | 100GB Infiniband |
| cbcs | 1 | 32 | 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz | 32 | 192GB | 4x Tesla V100 | 100GB Infiniband |
| circe | 58 | 1392 | 2x Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | 24 | 64GB | none | 40GB Infiniband |
| cms2016 | 11 | 264 | 2x Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | 24 | 64GB | none | 40GB Infiniband |
| cms_ocg | 9 | 216 | 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz | 12 | 192GB | none | 100GB Omnipath |
| devel | 8 | 128 | 2x Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz | 16 | 32GB | none | 40GB Infiniband |
| devel | 1 | 16 | 2x Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz | 16 | 32GB | 2x Tesla K20m | 40GB Infiniband |
| hchg | 2 | 48 | 2x Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | 24 | 128GB | none | 40GB Infiniband |
| henderson_itn18 | 12 | 240 | 2x Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz | 20 | 96GB | 2x GTX 1080 Ti | 100GB Omnipath |
| henderson_itn18 | 2 | 48 | 2x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz | 24 | 96GB | 1x TITAN RTX | 100GB Omnipath |
| henderson_itn18 | 1 | 24 | 2x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz | 24 | 96GB | 1x TITAN V | 100GB Omnipath |
| henderson_itn18 | 4 | 96 | 2x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz | 24 | 96GB | 3x GTX 1080 Ti | 100GB Omnipath |
| henderson_itn18 | 1 | 24 | 2x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz | 24 | 96GB | 2x GTX 1080 Ti | 100GB Omnipath |
| hii02 | 40 | 640 | 2x Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz | 16 | 128GB | none | 40GB Infiniband |
| hii02 | 35 | 700 | 2x Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz | 20 | 128GB | none | 40GB Infiniband |
| hii02 | 2 | 56 | 2x Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz | 14 | 1000GB | none | 40GB Infiniband |
| hii-interactive | 3 | 36 | 2x Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz | 12 | 64GB | none | 40GB Infiniband |
| hii-test | 11 | 132 | 2x Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz | 12 | 64GB | none | 40GB Infiniband |
| himem | 4 | 80 | 2x Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz | 20 | 512GB | none | 40GB Infiniband |
| margres_2020 | 3 | 72 | 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz | 24 | 192GB | none | 100GB Infiniband |
| mri2016 | 39 | 936 | 2x Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | 24 | 64GB | none | 40GB Infiniband |
| muma_2021 | 5 | 640 | 2x AMD Epyc 7702 CPU @ 2.0GHz | 128 | 1TB | none | 100GB Infiniband |
| simmons_itn18 | 20 | 480 | 2x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz | 24 | 96GB | 3x GTX 1080 Ti | 100GB Omnipath |
| snsm_itn19 | 29 | 580 | 2x Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz | 20 | 192GB | 1x GTX 1070 Ti | 100GB Omnipath |
| snsm_itn19 | 10 | 200 | 2x Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz | 20 | 192GB | 2x GTX 1070 Ti | 100GB Omnipath |
| tfawcett | 2 | 40 | 2x Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz | 20 | 192GB | 1x GTX 1080 Ti | 100GB Omnipath |
| Totals | 374 | 9144 | 54457 GB | 158 |