CIRCE Hardware

CIRCE Hardware

Advanced computing resources at the University of South Florida are administered by Research Computing (RC). RC hosts the CIRCE (Central Instructional and Research Computing Environment) cluster computer which currently consists of approximately 435 nodes with over 9,000 processor cores running Red Hat Enterprise Linux v7. The cluster is built on the condominium model with 55TB of memory shared across the nodes in various configurations. Additionally, there are 279 GPUs available. The nodes utilize either 100GB Omnipath, 100GB Infiniband, or 40GB Infiniband for a computational interconnect. There are three parallel file systems employed on CIRCE, a 2.9PB GPFS file system, a 819TB BeeGFS file system, and a 350 TB encrypted BeeGFS file system. These file systems are used to support high speed and I/O intensive computations, as well as for long-term storage. RC also provides and supports more than 120 scientific software packages for use on a variety of platforms. Remote system and file access is available from essentially anywhere. RC staff members are available to facilitate use of the cluster, as well as provide direct assistance with research projects that require high-performance computing or advanced visualization and analysis of data. User education and training sessions are also provided several times per semester.

  • The above statement as well as any information below can be used as part of the facilities description for grant proposals, provided that it is acknowledged that these resources are administered by Research Computing at the University of South Florida.

Server Hardware

Partition Nodes Core Count Processors Cores per Node Memory per Node GPUs per Node Interconnect
bfbsm_2019 12 288 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz 12 192GB none 100GB Omnipath
bgfsqdr 34 544 2x Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz 16 32GB none 40GB Infiniband
cbcs 7 168 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz 24 192GB none 100GB Infiniband
cbcs 1 32 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz 32 192GB 4x Tesla V100 100GB Infiniband
circe 58 1392 2x Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz 24 64GB none 40GB Infiniband
cms2016 11 264 2x Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz 24 64GB none 40GB Infiniband
cms_ocg 9 216 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz 12 192GB none 100GB Omnipath
devel 8 128 2x Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz 16 32GB none 40GB Infiniband
devel 1 16 2x Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz 16 32GB 2x Tesla K20m 40GB Infiniband
hchg 2 48 2x Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz 24 128GB none 40GB Infiniband
hii02 40 640 2x Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz 16 128GB none 40GB Infiniband
hii02 33 660 2x Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz 20 128GB none 40GB Infiniband
hii02 2 56 2x Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz 14 1000GB none 40GB Infiniband
hii-interactive 3 36 2x Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz 12 64GB none 40GB Infiniband
hii-test 11 132 2x Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz 12 64GB none 40GB Infiniband
himem 3 60 2x Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz 20 512GB none 40GB Infiniband
henderson_itn18 12 240 2x Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz 20 96GB 2x GTX 1080 Ti 100GB Omnipath
henderson_itn18 2 48 2x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz 24 96GB 1x TITAN RTX 100GB Omnipath
henderson_itn18 1 24 2x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz 24 96GB 1x TITAN V 100GB Omnipath
henderson_itn18 5 120 2x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz 24 96GB 3x GTX 1080 Ti 100GB Omnipath
margres_2020 3 72 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz 24 192GB none 100GB Infiniband
mri2016 39 936 2x Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz 24 64GB none 40GB Infiniband
rra 55 1100 2x Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz 20 192GB 1x GTX 1080 Ti 100GB Omnipath
rra 19 456 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz 24 192GB 3x RTX 2080 Ti 100GB Infiniband
rra_con2020 2 64 2x Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz 32 192GB 4x Tesla V100 100GB Infiniband
rra_con2020 1 48 4x Intel(R) Xeon(R) Gold 6246 CPU @ 3.30GHz 48 1.5TB none 100GB Infiniband
simmons_itn18 20 480 2x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz 24 96GB 3x GTX 1080 Ti 100GB Omnipath
snsm_itn19 29 580 2x Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz 20 192GB 1x GTX 1080 Ti 100GB Omnipath
snsm_itn19 10 200 2x Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz 20 192GB 2x GTX 1080 Ti 100GB Omnipath
tfawcett 2 40 2x Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz 20 192GB 1x GTX 1080 Ti 100GB Omnipath
Totals 435 9088 54801.50 GB 279


 

Additional Information for Cluster Hardware and Usage