Automation workflow docs: ECAL-TRK alignment
runreco.py
Submit ECAL automation jobs.
usage: runreco.py [-h] [--db DBNAME] [--notify NOTIFY]
[--campaign CAMPAIGN [CAMPAIGN ...]] [--logurl LOGURL]
[--wdir WDIR] [--eosdir EOSDIR]
{submit,resubmit,check} ...
Named Arguments
- --db
Database name, default is test db
Default: “ecal_online_test”
- --notify
Mattermost incoming webhook url for notifications
- --campaign
Processing campaign(s). “all” for all campaigns in the db
- --logurl
Base url for the logs
Default: “https://ecallogs.web.cern.ch/”
- --wdir
Working directory
- --eosdir
Base path of output location on EOS
subcommands
Select command to execute
- subcommand
Possible choices: submit, resubmit, check
Sub-commands
submit
Process all runs marked as new in the automation db
runreco.py submit [-h] [--t0 | --lfn] [--nfiles NFILES] [--template TEMPLATE]
Named Arguments
- --t0
Read input files from T0 storage
Default: False
- --lfn
Use logical file names for input files
Default: False
- --nfiles
Number of files per job, None=”all”
- --template
HTCondot template submit file
Default: “template.sub”
resubmit
Check for failed jobs and resubmit them
runreco.py resubmit [-h] [--lfn] [--template TEMPLATE] [--resub-flv RESUBFLV]
Named Arguments
- --lfn
Use logical file names for input files
Default: False
- --template
HTCondot template submit file
Default: “template.sub”
- --resub-flv
Resubmit JobFlavour
Default: “workday”
check
Check ongoing runs and mark them as done/failed if completed
runreco.py check [-h] [--max-retries MAX_RETRIES]
[--skipped-delay SKIPPED_DELAY]
Named Arguments
- --max-retries
Max number of tries, for each single job. -1 = no limit
Default: -1
- --skipped-delay
Number of days after which a task is considered as stalled and is marked as skipped.
Default: 7
runalign.py
Submit ECAL automation jobs.
usage: runalign.py [-h] [--db DBNAME] [--notify NOTIFY]
[--campaign CAMPAIGN [CAMPAIGN ...]] [--logurl LOGURL]
[--wdir WDIR] [--eosdir EOSDIR]
{submit,resubmit,check} ...
Named Arguments
- --db
Database name, default is test db
Default: “ecal_online_test”
- --notify
Mattermost incoming webhook url for notifications
- --campaign
Processing campaign(s). “all” for all campaigns in the db
- --logurl
Base url for the logs
Default: “https://ecallogs.web.cern.ch/”
- --wdir
Working directory
- --eosdir
Base path of output location on EOS
subcommands
Select command to execute
- subcommand
Possible choices: submit, resubmit, check
Sub-commands
submit
Process all runs marked as new in the automation db
runalign.py submit [-h] [--t0 | --lfn] [--nfiles NFILES] [--template TEMPLATE]
Named Arguments
- --t0
Read input files from T0 storage
Default: False
- --lfn
Use logical file names for input files
Default: False
- --nfiles
Number of files per job, None=”all”
- --template
HTCondot template submit file
Default: “template.sub”
resubmit
Check for failed jobs and resubmit them
runalign.py resubmit [-h] [--lfn] [--template TEMPLATE] [--resub-flv RESUBFLV]
Named Arguments
- --lfn
Use logical file names for input files
Default: False
- --template
HTCondot template submit file
Default: “template.sub”
- --resub-flv
Resubmit JobFlavour
Default: “workday”
check
Check ongoing runs and mark them as done/failed if completed
runalign.py check [-h] [--max-retries MAX_RETRIES]
[--skipped-delay SKIPPED_DELAY]
Named Arguments
- --max-retries
Max number of tries, for each single job. -1 = no limit
Default: -1
- --skipped-delay
Number of days after which a task is considered as stalled and is marked as skipped.
Default: 7