[scyld-users] how to let bbq migrate batch jobs to compute nodes?
Weirong Zhu
wrzhu at etinternational.com
Tue Mar 14 10:45:18 PST 2006
I just tried this method. It's working fine with "bbq" now. Thanks very
much.
One more question, after I using "atrm" to delete jobs from the queue,
those jobs disappeared from the queue. However, when I do a "ps", they
are still there.
Any suggestions?
Thanks for your help!
-- Weirong
Bishop, Ryan S SAJ Contractor wrote:
>We use the methodology I described below with batch, which feeds bbq. Works
>like a charm.
>
>-----Original Message-----
>From: scyld-users-bounces at beowulf.org
>[mailto:scyld-users-bounces at beowulf.org] On Behalf Of Weirong Zhu
>Sent: Tuesday, March 14, 2006 1:25 PM
>To: scyld-users at beowulf.org
>Subject: Re: [scyld-users] how to let bbq migrate batch jobs to compute
>nodes?
>
>Thanks for the information.
>
>This seems a feasible method. Thanks very much.
>
>Have you ever tried bbq? Since with a batch system, it will be easier to
>control jobs. For example, you can watch the status of all the jobs in the
>queue, and easily delete a job from a queue. Now if we do the batch
>ourselves, we need to use "ps" to find the corresponding pid, and kill the
>job.
>
>So I still want to know how make use of "bbq".
>
>-- Weirong
>
>Bishop, Ryan S SAJ Contractor wrote:
>
>
>
>>We use a batch script that sets a variable, something like
>>"NODE='beomap --nolocal'" and then runs a bpsh NODE [command]. That
>>will issue the job to the next free node. YMMV - make sure to check
>>out the beomap and bpsh man pages.
>>
>>--Schuyler
>>
>>-----Original Message-----
>>From: scyld-users-bounces at beowulf.org
>>[mailto:scyld-users-bounces at beowulf.org] On Behalf Of Weirong Zhu
>>Sent: Tuesday, March 14, 2006 1:23 AM
>>To: scyld-users at beowulf.org
>>Subject: [scyld-users] how to let bbq migrate batch jobs to compute nodes?
>>
>>We have just got our new Penguin Computing cluster.
>>Since one of our main purpose it to submit a lot of batch jobs to the
>>cluster, I tried to learn how to use bbq provided by scyld.
>>
>>As a simple test,
>>
>>(1) I wrote a C program, which has a while(1) loop. Then I compile it
>>to generate the binary a.out.
>>(2) Write a simple job file with only one command "./a.out". And name
>>this file as run.
>>(3) submit the job by "batch now -f run"
>>(4) do step (3) a lot of times.
>>
>>Then by using command "bbq" I saw a lot of jobs were listed. And I
>>assume those jobs would be migrated to computing nodes.
>>
>>However, when I use "beostat -C", find all the computing nodes are
>>actually idle, and all those instances are running on master node.
>>
>>Did I do something wrong to submit my simple batch jobs?
>>How should I do?
>>
>>Moreover, I tried to use "atrm" to delete my jobs from the queue.
>>After that, when I use "bbq" command, there is nothing in the queue.
>>However, when I did a "top" or "ps -fu myname". Those jobs are still
>>running on the master node.
>>Did I do something wrong to delete a batch job from the queue?
>>How should I do?
>>
>>I am really confused with the bbq batch system and it seems that there
>>is no PBS avaliable on this cluster.
>>
>>Any help and suggestions are welcome!
>>
>>Regards,
>>Weirong
>>
>>
>>
>>_______________________________________________
>>Scyld-users mailing list, Scyld-users at beowulf.org To change your
>>subscription (digest mode or unsubscribe) visit
>>http://www.beowulf.org/mailman/listinfo/scyld-users
>>
>>
>>
>>
>>
>
>_______________________________________________
>Scyld-users mailing list, Scyld-users at beowulf.org To change your subscription
>(digest mode or unsubscribe) visit
>http://www.beowulf.org/mailman/listinfo/scyld-users
>
>
>
More information about the Scyld-users
mailing list