High Throughput Computing using Condor

Condor Registration

Condor is provided completely free of charge to staff (including associates) and postgraduate students but we do ask that all users register for the service using Service Now (go to https://liverpool.service-now.com/ess/ and select Make a request > Accounts > Application to access high performance/throughput computing facilities). Please include a brief description of your project and try to keep us informed of any published research which has benefited from using the Condor service (including conference proceedings and dissertations) - this will help secure future support for Condor at Liverpool.

It will help us if you can briefly answer at least some of the questions below in the registration form. Even if you do not have definite responses it is worth thinking about these points as they will influence how well particular problems are suited to using Condor. If in doubt please contact the Condor administrator Ian C. Smith (email: i.c.smith@liverpool.ac.uk)

What application software is needed ?
Are you planning to use software that you (or maybe a colleague) has written - if so which language does it use e.g. C/C++, FORTRAN, MATLAB, R. If third party software is needed, can it be obtained free of charge or is it a commercial package ? Are there any licensing restrictions associated with it ?
How long will the individual jobs run for ?
Condor works extremely well with jobs running for around 15-30 minutes but longer jobs are less efficient. It is generally not possible to run jobs for longer than about 10-12 hours unless the job can restart from where it left off (see the section on checkpointing).
Will the jobs require a lot of memory ?
Since Condor jobs are run on commodity PCs, memory is quite restriced. Around 1 GB is the absoulte maximum which any job can use although in practise this may drop to around 500 MB. If more memory is needed then the application may be better suited to the High Performance Computing Service.
How much disk space will be needed by individual jobs ?
Condor jobs should aim not to use more than a few GB of disk space on the Condor pool PCs as the availability of large amounts of storage cannot be guaranteed.