Difference between revisions of "CaFe Disk Space"
From HallCWiki
Jump to navigationJump to search (Created page with "Disk space allocation directories for the CaFe experiment. == Hall C cdaq-cluster filesystems == File storage directories during the online analysis of CaFe. There is a READ...") |
|||
| Line 2: | Line 2: | ||
== Hall C cdaq-cluster filesystems == | == Hall C cdaq-cluster filesystems == | ||
| − | |||
| − | |||
| − | |||
| − | |||
1. main directory (for online analyzer, DBs, replay scripts, etc.): | 1. main directory (for online analyzer, DBs, replay scripts, etc.): | ||
/home/cdaq/cafe-2022/ | /home/cdaq/cafe-2022/ | ||
2. output directory (ROOTfiles, REPORT_OUTPUT, PDF files, etc.): | 2. output directory (ROOTfiles, REPORT_OUTPUT, PDF files, etc.): | ||
/net/cdaq/cdaql1data/cdaq/hallc-online-cafe2022/ | /net/cdaq/cdaql1data/cdaq/hallc-online-cafe2022/ | ||
| − | ; | + | ;NOTES: |
| − | Please do take special care to avoid modifying any files outside of your ~/cafe-2022 directory. | + | * Please do take special care to avoid modifying any files outside of your ~/cafe-2022 directory. |
| − | For example, no changes/additions to anything in ~/bin, changes to init files like .tcshrc, .bashrc, etc, text editor config files, etc. | + | * File storage directories during the online analysis of CaFe. |
| + | * There is a README in the first directory with a few notes. | ||
| + | * It is recommended to make a '~/cafe-2022/go_analysis_cafe' shell script that sets up your environment from scratch. For example, no changes/additions to anything in ~/bin, changes to init files like .tcshrc, .bashrc, etc, text editor config files, etc. | ||
| + | |||
| + | == Farm/CUE disk allocations == | ||
| + | /volatile/c-cafe-2022/ (4 TB high quota; 2 TB guarantee) | ||
| + | ;NOTES: | ||
| + | * Files are '''NOT''' backed-up | ||
| + | * Use for all large file output from analysis or simulation jobs. When guarantee threshold is exceeded it is possible to have files auto-cleaned up (removed). See policy: https://scicomp.jlab.org/docs/volatile_disk_pool | ||
| + | * Files you want to keep should be pushed to tape using ''jput'' | ||
| + | |||
| + | /work/hallc/c-cafe-2022/ directory ( 1TB quota ) | ||
| + | ;NOTES: | ||
| + | * Files are '''NOT''' backed up. | ||
| + | * Good place for analysis software, database files, etc. | ||
| + | * These files should be in GitHub or have similar backups. | ||
| + | * Nothing that matters should be stored '''only''' on /work. | ||
| + | |||
| + | /group/c-cafe-2022/ directory ( 100GB quota ) | ||
| + | ;NOTES: | ||
| + | * Backed up regularly. | ||
| + | * Best place for analysis/replay scripts; software that is being actively developed, etc. (But, still use GitHub!) | ||
| + | |||
| + | == Tape allocations == | ||
| + | /mss/hallc/c-cafe-2022/analysis | ||
| + | * tape volume for analysis output (ie. simulation output, replay output that you want to keep long-term, etc.) | ||
| + | /mss/hallc/c-cafe-2022/raw | ||
| + | * tape volume for raw data output (ie. production CODA files from the Hall) | ||
| + | |||
== Hall C cdaq-cluster filesystems == | == Hall C cdaq-cluster filesystems == | ||
Revision as of 16:15, 25 March 2022
Disk space allocation directories for the CaFe experiment.
Hall C cdaq-cluster filesystems
1. main directory (for online analyzer, DBs, replay scripts, etc.):
/home/cdaq/cafe-2022/
2. output directory (ROOTfiles, REPORT_OUTPUT, PDF files, etc.):
/net/cdaq/cdaql1data/cdaq/hallc-online-cafe2022/
- NOTES
- Please do take special care to avoid modifying any files outside of your ~/cafe-2022 directory.
- File storage directories during the online analysis of CaFe.
- There is a README in the first directory with a few notes.
- It is recommended to make a '~/cafe-2022/go_analysis_cafe' shell script that sets up your environment from scratch. For example, no changes/additions to anything in ~/bin, changes to init files like .tcshrc, .bashrc, etc, text editor config files, etc.
Farm/CUE disk allocations
/volatile/c-cafe-2022/ (4 TB high quota; 2 TB guarantee)
- NOTES
- Files are NOT backed-up
- Use for all large file output from analysis or simulation jobs. When guarantee threshold is exceeded it is possible to have files auto-cleaned up (removed). See policy: https://scicomp.jlab.org/docs/volatile_disk_pool
- Files you want to keep should be pushed to tape using jput
/work/hallc/c-cafe-2022/ directory ( 1TB quota )
- NOTES
- Files are NOT backed up.
- Good place for analysis software, database files, etc.
- These files should be in GitHub or have similar backups.
- Nothing that matters should be stored only on /work.
/group/c-cafe-2022/ directory ( 100GB quota )
- NOTES
- Backed up regularly.
- Best place for analysis/replay scripts; software that is being actively developed, etc. (But, still use GitHub!)
Tape allocations
/mss/hallc/c-cafe-2022/analysis
- tape volume for analysis output (ie. simulation output, replay output that you want to keep long-term, etc.)
/mss/hallc/c-cafe-2022/raw
- tape volume for raw data output (ie. production CODA files from the Hall)
