[Beowulf] [EXTERNAL] Re: PBS question

[Lux, Jim (US 337K)]

True, there’s tons of info in qstat -f, however, doesn’t qstat stop showing my job after it completes, though? Maybe there’s a switch that retrieves “last data”?

I suppose I could put a qstat -f in as the last thing in the sub job file.

    resources_used.cpupercent = 99
    resources_used.cput = 00:34:26
    resources_used.mem = 11764kb
    resources_used.ncpus = 4
    resources_used.vmem = 1135264kb
    resources_used.walltime = 00:34:28

and then there’s /usr/bin/time which might also help.


From: Beowulf <beowulf-bounces at beowulf.org> on behalf of Gus Correa <gus at ldeo.columbia.edu>
Date: Tuesday, October 29, 2019 at 11:34 AM
To: "beowulf at beowulf.org" <beowulf at beowulf.org>
Subject: [EXTERNAL] Re: [Beowulf] PBS question



On Tue, Oct 29, 2019 at 2:00 PM Lux, Jim (US 337K) via Beowulf <beowulf at beowulf.org<mailto:beowulf at beowulf.org>> wrote:
I’m doing some EP job arrays using PBS, and I was wondering if there’s a way to find out how much resources the job actually consumed.
For instance, if I do a select 1:ncpus=4 does it actually use 4 CPUs?
Likewise, is there a “memory high water mark”.

The idea here is that since my job competes with all the other jobs, the better I can describe my resource needs (i.e. not over-require) the faster my job gets through the system.

Or are these things I need to instrument in some other way.

--

ncpus=4 requests 4 cpus/cores, which PBS/Torque will allocate to your job alone (unless the nodes are tagged as work shared).
It is up to you use these cpus (e.g. MPI: mpirun np=4; OpenMP: OMP_THREAD_NUM=4) or not (a serial program).
"qstat -f" produces a fair amount of information about the job resources.
The accounting logs, in server_priv/accounting/YYYMMDD  also do, if you have access to them.

You can request a certain amount of memory with the -l (lowercase L)  switch of qsub.
See 'man qsub' for syntax, and 'man pbs_resources' for which resources can be requested (particularly pmem, pvmem, vmem).

I hope this helps,
Gus Correa


_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org<mailto:Beowulf at beowulf.org> sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20191029/174a705c/attachment.html>