[Beowulf] [EXTERNAL] Re: PBS question
Lux, Jim (US 337K)
james.p.lux at jpl.nasa.gov
Tue Oct 29 13:49:08 PDT 2019
True, there’s tons of info in qstat -f, however, doesn’t qstat stop showing my job after it completes, though? Maybe there’s a switch that retrieves “last data”?
I suppose I could put a qstat -f in as the last thing in the sub job file.
resources_used.cpupercent = 99
resources_used.cput = 00:34:26
resources_used.mem = 11764kb
resources_used.ncpus = 4
resources_used.vmem = 1135264kb
resources_used.walltime = 00:34:28
and then there’s /usr/bin/time which might also help.
From: Beowulf <beowulf-bounces at beowulf.org> on behalf of Gus Correa <gus at ldeo.columbia.edu>
Date: Tuesday, October 29, 2019 at 11:34 AM
To: "beowulf at beowulf.org" <beowulf at beowulf.org>
Subject: [EXTERNAL] Re: [Beowulf] PBS question
On Tue, Oct 29, 2019 at 2:00 PM Lux, Jim (US 337K) via Beowulf <beowulf at beowulf.org<mailto:beowulf at beowulf.org>> wrote:
I’m doing some EP job arrays using PBS, and I was wondering if there’s a way to find out how much resources the job actually consumed.
For instance, if I do a select 1:ncpus=4 does it actually use 4 CPUs?
Likewise, is there a “memory high water mark”.
The idea here is that since my job competes with all the other jobs, the better I can describe my resource needs (i.e. not over-require) the faster my job gets through the system.
Or are these things I need to instrument in some other way.
ncpus=4 requests 4 cpus/cores, which PBS/Torque will allocate to your job alone (unless the nodes are tagged as work shared).
It is up to you use these cpus (e.g. MPI: mpirun np=4; OpenMP: OMP_THREAD_NUM=4) or not (a serial program).
"qstat -f" produces a fair amount of information about the job resources.
The accounting logs, in server_priv/accounting/YYYMMDD also do, if you have access to them.
You can request a certain amount of memory with the -l (lowercase L) switch of qsub.
See 'man qsub' for syntax, and 'man pbs_resources' for which resources can be requested (particularly pmem, pvmem, vmem).
I hope this helps,
Beowulf mailing list, Beowulf at beowulf.org<mailto:Beowulf at beowulf.org> sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Beowulf