how to start with own Beowulf
Utpal Jyoti Barman
Utpal Jyoti Barman
Sun Aug 26 22:26:03 PDT 2001
" <utpal_barman at rediffmail.com>
Content-ID: <Mon_Aug_27_10_56_03_IST_2001_0 at mailweb18.rediffmail.com>
Content-type: text/plain
Content-Description: Body
Content-Transfer-Encoding: quoted-printable
Hii there,
i am very new to Distributed Computing. Could anyone please help me to p=
roceed with the Beowulf Architecture. I want to make one in my Lab consis=
ting of 6 nodes.
With warm regards
Utpal
On Sun, 26 Aug 2001 beowulf-admin at beowulf.org wrote :
>
>Send Beowulf mailing list submissions to
> beowulf at beowulf.org
>
>To subscribe or unsubscribe via the web, visit
> http://www.beowulf.org/mailman/listinfo/beowulf
>or, via email, send a message with subject or body =
>'help' to
> beowulf-request at beowulf.org
>You can reach the person managing the list at
> beowulf-admin at beowulf.org
>
>When replying, please edit your Subject line so it is =
>more specific than
>"Re: Contents of Beowulf digest..."
>
>
>Today's Topics:
>
> 1. "mmap failed"---help (pramod ps)
> 2. Re:"mmap failed"---help (Sean Dilda)
> 3. RE:Network RAM for Beowulf (Thomas R Boehme)
> 4. Re:HELP (Brian)
> 5. Re:HELP (Ron Chen)
> 6. Re:HELP (=3D?iso-8859-1?Q?Jakob_=3DD8stergaard?=3D)
> 7. Re:Network RAM for Beowulf =
>(=3D?iso-8859-1?Q?Jakob_=3DD8stergaard?=3D)
> 8. Re:Network RAM for Beowulf =
>(=3D?iso-8859-1?Q?Jakob_=3DD8stergaard?=3D)
> 9. Re:Network RAM for Beowulf (Mark Hahn)
> 10. Re:HELP (Mark Hahn)
> 11. Re:Need to do something Useful (Kim Branson)
> 12. Re:Network RAM for Beowulf (andreas boklund)
> 13. Re:Network RAM for Beowulf (Eray Ozkural (exa))
>
>--__--__--
>
>Message: 1
>Date: Sat, 25 Aug 2001 10:13:56 -0700 (PDT)
>From: pramod ps =
>Subject: "mmap failed"---help
>To: beowulf at beowulf.org
>
>hi there,
>
> i tried to impliment the beowulf cluster using scyld
>cd in my college. i've instaled the server & booted
>the clients using floppy disks.
>then i partitioned the hard disk of the client
>remotely by giving commands, beofdisk -d & beofdisk
>-w.
>
> then i restart the machine , edit the fstab &tried
>to execute a program. but the client showed an error
>message as , " mmap failed".
>when the program is given to execute in the server ,
>it succesfully executed & showed the result. i'am
>using only one client to try this.
>
> its possible to create & write the partition table
>to client remotely. but when we tried to write the
>boot record & boot the system from hard disk , it
>showed that the there is no bootable partition. =
>i think the problem is that of mounting the client
>hard disk to the server.
>
> i've to complete this with in the next week. so
>kindly help me as early as possible to clear this
>problem.
>
>thank u ,
>pramod. =
>
>__________________________________________________
>Do You Yahoo!?
>Make international calls for as low as $.04/minute with =
>Yahoo! Messenger
>http://phonecard.yahoo.com/
>
>--__--__--
>
>Message: 2
>Date: Sat, 25 Aug 2001 13:26:04 -0400
>From: Sean Dilda =
>To: pramod ps =
>Cc: beowulf at beowulf.org
>Subject: Re: "mmap failed"---help
>protocol=3D"application/pgp-signature"; =
>boundary=3D"qMm9M+Fa2AknHoGS"
>
>
>--qMm9M+Fa2AknHoGS
>Content-Type: text/plain; charset=3Dus-ascii
>Content-Disposition: inline
>Content-Transfer-Encoding: quoted-printable
>
>On Sat, 25 Aug 2001, pramod ps wrote:
>
>> hi there,
>>=3D20
>> i tried to impliment the beowulf cluster using scyld
>> cd in my college. i've instaled the server & booted
>> the clients using floppy disks.
>> then i partitioned the hard disk of the client
>> remotely by giving commands, beofdisk -d & beofdisk
>> -w.
>>=3D20
>> then i restart the machine , edit the fstab &tried
>> to execute a program. but the client showed an error
>> message as , " mmap failed".
>
>Can you give me more details about where exactly you =
>saw the "mmap
>failed" error message
>
>> when the program is given to execute in the server ,
>> it succesfully executed & showed the result. i'am
>> using only one client to try this.
>>=3D20
>> its possible to create & write the partition table
>> to client remotely. but when we tried to write the
>> boot record & boot the system from hard disk , it
>> showed that the there is no bootable partition.=3D20
>> i think the problem is that of mounting the client
>> hard disk to the server.
>
>The master node never mounts the slave nodes harddrives.
>
>NOTE: I assume by 'server' you mean master node, and by =
>'client' you
>mean slave node or compute node.. please let me know if =
>I am wrong in
>that.
>
>--qMm9M+Fa2AknHoGS
>Content-Type: application/pgp-signature
>Content-Disposition: inline
>
>-----BEGIN PGP SIGNATURE-----
>Version: GnuPG v1.0.1 (GNU/Linux)
>Comment: For info see http://www.gnupg.org
>
>iD8DBQE7h9+s+pq97aGGtXARAtr2AKCFLjxqdpE4ZgHPwc7Dvl0FQp7Z-
>zgCeL75e
>KdiMu3+xFg5pqgkY3J9Xvss=3D
>=3Ddd2V
>-----END PGP SIGNATURE-----
>
>--qMm9M+Fa2AknHoGS--
>
>--__--__--
>
>Message: 3
>From: Thomas R Boehme =
>To: "'Mark Hahn'" , =
>beowulf at beowulf.org
>Subject: RE: Network RAM for Beowulf
>Date: Sat, 25 Aug 2001 13:51:54 -0400
>
>There are many applications that could make reasonable =
>use of network RAM.
>Basically everything which need more RAM then currently =
>possible and
>therefore has to swap to disk to process the data =
>(database applications,
>gaussian, etc.). The network latency is high compared =
>to memory latency, but
>not compared to disk slatency. There, network beats it =
>by several orders of
>magnitude.
>I know a lot of applications which have swapfiles of =
>several gigabytes,
>beeing able to keep them in memory (and even if it is =
>network ram) can speed
>then up significantly. And not everybody can afford to =
>buy Itaniums with
>more than 4 Gig's of memory.
>
>Bye, Thommy
>
>-----Original Message-----
>From: Mark Hahn [mailto:hahn at physics.mcmaster.ca] =
>Sent: Thursday, August 16, 2001 9:52 AM
>To: beowulf at beowulf.org
>Subject: Re: Network RAM for Beowulf
>
>
>> > we as a group of four students are *also* =
>thinking
>> > of implementing Network RAM for a beowulf cluster
>> > (assuming 100Mbps Ethernet ) whereby each node in =
>the
>
>I'm always puzzled why people want to keep trying this:
>have you considered the fairly breathtaking latency of =
>"sharing" pages over a net? do you really have apps =
>that can =
>tolerate that kind of latency?
>
>
>
>_______________________________________________
>Beowulf mailing list, Beowulf at beowulf.org
>To change your subscription (digest mode or unsubscribe)
> visit
>http://www.beowulf.org/mailman/listinfo/beowulf
>
>--__--__--
>
>Message: 4
>Date: Sat, 25 Aug 2001 13:59:38 -0400 (EDT)
>From: Brian =
>To: "J. M. Pacheco" =
>cc: beowulf at beowulf.org
>Subject: Re: HELP
>
>
>Hi J.M.,
>
> I ran into this problem as well - the basic problem =
>seems to be that
>linux maps the shared libraries at around the 1GB mark, =
>so you need to
>change this location in the kernel source code.
>
> Here's a post from late July I sent to the list =
>dealing with the same
>problem.. there's a little more information in that =
>thread, if you look it
>up in the mailing list archives.
>
> Short answer: Change the source code as below, and =
>you'll be ok.
>
> Here's more detail:
>----
>Hey guys,
>
> I think I'm answering my own question now - if anyone =
>else has had this
>problem, here's what SEEMS to be a quick and dirty fix. =
> (Quick and
>dirty being the key words!) Also, good conscience =
>tells me to write that
>although it's working for me right now, it's not =
>elegant, and who knows
>what problems it may create?
>
> That said, here goes:
>
> In the kernel source, in file mmap.c, there is a line =
>that reads:
>
> addr =3D TASK_UNMAPPED_BASE;
>
> .. This is what sets the default address of the =
>shared libs in the
>memory mapping, and it's at 0x40000000 (1G) by default. =
> So change it to,
>for example:
>
> addr =3D 0x80000000;
>
> .. And you should, in theory, have up to ~2GB to use =
>for the codes. =
>People with a little more knowledge than I have can =
>probably shed more
>light on this, and while it's not pretty right now, =
>when I have time I may
>try to work on something nicer. Right now, I just need =
>these jobs to run. =
>:)
>
> For more info on this, check out the =
>comp.os.linux.development.system
>newsgroup, back around June 7th or so.
>-----
>
> Best wishes,
> - Brian
>
>
>--__--__--
>
>Message: 5
>Date: Sat, 25 Aug 2001 11:36:48 -0700 (PDT)
>From: Ron Chen =
>Subject: Re: HELP
>To: Brian ,
>"J. M. Pacheco" =
>Cc: beowulf at beowulf.org
>
>64-bit Linux should be OK, correct?
>
>-Ron
>
>--- Brian wrote:
>> =
>> Hi J.M.,
>> =
>> I ran into this problem as well - the basic
>> problem seems to be that
>> linux maps the shared libraries at around the 1GB
>> mark, so you need to
>> change this location in the kernel source code.
>> =
>> Here's a post from late July I sent to the list
>> dealing with the same
>> problem.. there's a little more information in that
>> thread, if you look it
>> up in the mailing list archives.
>> =
>> Short answer: Change the source code as below, and
>> you'll be ok.
>> =
>> Here's more detail:
>> ----
>> Hey guys,
>> =
>> I think I'm answering my own question now - if
>> anyone else has had this
>> problem, here's what SEEMS to be a quick and dirty
>> fix. (Quick and
>> dirty being the key words!) Also, good conscience
>> tells me to write that
>> although it's working for me right now, it's not
>> elegant, and who knows
>> what problems it may create?
>> =
>> That said, here goes:
>> =
>> In the kernel source, in file mmap.c, there is a
>> line that reads:
>> =
>> addr =3D TASK_UNMAPPED_BASE;
>> =
>> .. This is what sets the default address of the
>> shared libs in the
>> memory mapping, and it's at 0x40000000 (1G) by
>> default. So change it to,
>> for example:
>> =
>> addr =3D 0x80000000;
>> =
>> .. And you should, in theory, have up to ~2GB to
>> use for the codes. =
>> People with a little more knowledge than I have can
>> probably shed more
>> light on this, and while it's not pretty right now,
>> when I have time I may
>> try to work on something nicer. Right now, I just
>> need these jobs to run. =
>> :)
>> =
>> For more info on this, check out the
>> comp.os.linux.development.system
>> newsgroup, back around June 7th or so.
>> -----
>> =
>> Best wishes,
>> - Brian
>> =
>> =
>> _______________________________________________
>> Beowulf mailing list, Beowulf at beowulf.org
>> To change your subscription (digest mode or
>> unsubscribe) visit
>http://www.beowulf.org/mailman/listinfo/beowulf
>
>
>__________________________________________________
>Do You Yahoo!?
>Make international calls for as low as $.04/minute with =
>Yahoo! Messenger
>http://phonecard.yahoo.com/
>
>--__--__--
>
>Message: 6
>Date: Sat, 25 Aug 2001 22:38:07 +0200
>From: =3D?iso-8859-1?Q?Jakob_=3DD8stergaard?=3D =
>
>To: "J. M. Pacheco" =
>Cc: beowulf at beowulf.org
>Subject: Re: HELP
>"J. M. Pacheco" , =
>beowulf at beowulf.org
>
>On Tue, Aug 14, 2001 at 04:26:54PM +0100, J. M. Pacheco =
>wrote:
>> =
>> Hello.
>> =
>...
>> Can anyone help me out of this mess ? =
>> Furthermore, browsing the beowulf mailing list, I got =
>accross some linux
>> limitations in writing huge temperary files. Mine can =
>be 2 GB large. Is
>> that problem solved in kernels 2.4 ? =
>
>The problem resided both in the kernel and standard =
>libraries, so either
>updating glibc *or* updating the kernel won't solve the =
>problem.
>
>However, newer distributions such as RedHat 7.1 have =
>both glibc and kernel
>updated so that this is no longer a problem.
>
>I would think your distribution had this solved too - =
>but I do not know.
>
>The last problem in writing 2+ GB files, is the =
>application (and it's libraries
>including any compiler-included support libraries). =
>If you have code that
>uses a 32-bit signed integer for byte-offsets into your =
>file, well, naturally
>you cannot address more than 2 GB no matter which =
>kernel you're running.
>
>If (and this is *pure* speculation!) g77 generated =
>Fortran code relies on
>a support library for file I/O that uses such =
>addressing, this could be the
>explanation for the problems you see.
>
>Test: Try dd if=3D/dev/zero of=3Dtest_file bs=3D8k =
>count=3D1024k
>
>If you end up with a test_file of size 8 GB, your =
>kernel, glibc, and tools
>(well, dd at least) have proper LFS support. The =
>problem must then be with
>your code or g77 (or support libraries).
>
>If you do not end up with the large file, I suggest you =
>try another
>distribution that has proper kernel and libraries. Or,
> see if there are
>updates to your distribution that fix this.
>
>-- =
>........................................................-
>........
>: jakob at unthought.net : And I see the elder races, =
> :
>:.........................: putrid forms of man =
> :
>: Jakob =D8stergaard : See him rise and claim the =
>earth, :
>: OZ9ABN : his downfall is at hand. =
> :
>:.........................:............{Konkhra}
>...............:
>
>--__--__--
>
>Message: 7
>Date: Sat, 25 Aug 2001 22:39:59 +0200
>From: =3D?iso-8859-1?Q?Jakob_=3DD8stergaard?=3D =
>
>To: Mark Hahn =
>Cc: beowulf at beowulf.org
>Subject: Re: Network RAM for Beowulf
>Mark Hahn , =
>beowulf at beowulf.org
>
>On Thu, Aug 16, 2001 at 02:52:23PM +0000, Mark Hahn =
>wrote:
>> > > we as a group of four students are *also* =
>thinking
>> > > of implementing Network RAM for a beowulf cluster
>> > > (assuming 100Mbps Ethernet ) whereby each node in =
>the
>> =
>> I'm always puzzled why people want to keep trying =
>this:
>> have you considered the fairly breathtaking latency =
>of =
>> "sharing" pages over a net? do you really have apps =
>that can =
>> tolerate that kind of latency?
>
>What latency ? ;)
>
>I have 100 usec ping latencies on my network. =
>Bandwidth ~ 8-12 MB/sec
>
>I have 8 ms seek latencies on my harddrives. Bandwidth =
>~ 12-16 MB/sec
>
>
>-- =
>........................................................-
>........
>: jakob at unthought.net : And I see the elder races, =
> :
>:.........................: putrid forms of man =
> :
>: Jakob =D8stergaard : See him rise and claim the =
>earth, :
>: OZ9ABN : his downfall is at hand. =
> :
>:.........................:............{Konkhra}
>...............:
>
>--__--__--
>
>Message: 8
>Date: Sat, 25 Aug 2001 23:29:38 +0200
>From: =3D?iso-8859-1?Q?Jakob_=3DD8stergaard?=3D =
>
>To: Mark Hahn , =
>beowulf at beowulf.org
>Subject: Re: Network RAM for Beowulf
>Mark Hahn , =
>beowulf at beowulf.org
>
>On Sat, Aug 25, 2001 at 10:39:59PM +0200, Jakob =
>=D8stergaard wrote:
>> On Thu, Aug 16, 2001 at 02:52:23PM +0000, Mark Hahn =
>wrote:
>> > > > we as a group of four students are *also* =
>thinking
>> > > > of implementing Network RAM for a beowulf =
>cluster
>> > > > (assuming 100Mbps Ethernet ) whereby each node =
>in the
>> > =
>> > I'm always puzzled why people want to keep trying =
>this:
>> > have you considered the fairly breathtaking latency =
>of =
>> > "sharing" pages over a net? do you really have =
>apps that can =
>> > tolerate that kind of latency?
>> =
>> What latency ? ;)
>> =
>> I have 100 usec ping latencies on my network. =
>Bandwidth ~ 8-12 MB/sec
>> =
>> I have 8 ms seek latencies on my harddrives. =
>Bandwidth ~ 12-16 MB/sec
>
>Sorry for following up on my own post, but this needs =
>clarification:
>
>I'm referring to network swap here. Swapping over fast =
>local networks
>can absolutely make sense.
>
>If you were referring to running separate threads of =
>the same process on
>multiple nodes in a cluster, sharing the same meory =
>space over the network, I
>completely agree with you. That's not practically =
>possible when the execution
>environment (the operating system kernel) doesn't =
>understand the code
>(compiler-generated native machine-code) it executes.
>
>Even MOSIX migrates complete processes. For good =
>reason I presume :)
>
>-- =
>........................................................-
>........
>: jakob at unthought.net : And I see the elder races, =
> :
>:.........................: putrid forms of man =
> :
>: Jakob =D8stergaard : See him rise and claim the =
>earth, :
>: OZ9ABN : his downfall is at hand. =
> :
>:.........................:............{Konkhra}
>...............:
>
>--__--__--
>
>Message: 9
>Date: Sat, 25 Aug 2001 19:04:27 -0400 (EDT)
>From: Mark Hahn =
>To: =3D?iso-8859-1?Q?Jakob_=3DD8stergaard?=3D =
>
>cc: beowulf at beowulf.org
>Subject: Re: Network RAM for Beowulf
>
>> > > > > we as a group of four students are *also* =
>thinking
>> > > > > of implementing Network RAM for a beowulf =
>cluster
>> > > > > (assuming 100Mbps Ethernet ) whereby each =
>node in the
>> > > =
>> > > I'm always puzzled why people want to keep trying =
>this:
>> > > have you considered the fairly breathtaking =
>latency of =
>> > > "sharing" pages over a net? do you really have =
>apps that can =
>> > > tolerate that kind of latency?
>> > =
>> > What latency ? ;)
>> > =
>> > I have 100 usec ping latencies on my network. =
>Bandwidth ~ 8-12 MB/sec
>
>I don't think you have 100 us latency for any =
>nontrivial-sized packet.
>my net (FD 100bT, nothing special), shows >.4ms us =
>latency for 1k pings.
>so you'll clearly be into the multiple ms for a =
>useful-sized page cluster,
>say, 32K.
>
>now, I assumed from the original context that someone =
>wanted =
>to do network shared memory. this is mostly a nutty =
>idea,
>since the granularity is necessarily 4 or 8K, therefore =
>latency
>is nontrivial unless your code is somehow incredibly =
>asynchronous.
>
>network swapping is a somewhat different story, since =
>there's =
>no huge urgency in pushing pages out, and often not =
>that much
>to get them back. of course, in the former case, =
>you're =
>short of ram, and it's not exactly nice to have to =
>allocate =
>more ram to accomplish the tx, and really you shouldn't =
>free
>the page until you get an ack from the server. in the =
>latter =
>case, someone will simply sleep until their page =
>arrives, which
>is at least not positive feedback.
>
>
>> > I have 8 ms seek latencies on my harddrives. =
>Bandwidth ~ 12-16 MB/sec
>
>that's pretty miserable bandwidth. it's basically =
>impossible to buy a modern
>IDE disk, for instance, that sustains less than 20 MB/s =
>on inner/slow tracks,
>and most peak close to 40 MB/s. not to mention how =
>easy it is to =
>stripe them, or just throw 15krpm scsi at the problem.
>
>> I'm referring to network swap here. Swapping over =
>fast local networks
>> can absolutely make sense.
>
>networks/nics suck, relative even to ide controllers. =
>there's just
>no getting around that. it's routine to launch off a =
>128K scatter-gather,
>busmaster command to a cheap UDMA controller - yes, =
>read latency can be =
>unpleasant, but the bandwidth is great, and the =
>overhead is minimal.
>
>you simply can't say that about networks, which is a =
>shame. the world
>would be a far better place if I could at least send =
>8-9K jumbos,
>preferably with a sane, zero-copy-friendly s-g =
>interface.
>
>yes, gigE helps, as do smarter nics, zcopy, jumbograms, =
>even exotica
>like STP.
>
>but have you looked at how much CPU is eaten by a gigE =
>card =
>streaming, say, 50 MB/s, versus a cheap dual-channel =
>IDE doing so?
>
>in summary: swapping or shmem over a net is attractive =
>at the surface,
>but crunch the numbers and you find it's only a win in =
>very special cases.
>(that said, I'll go back to tuning up my 112-cpu SC40 =
>that has ~200 MB/s
>very smart interconnect ;)
>
>regards, mark hahn.
>
>
>--__--__--
>
>Message: 10
>Date: Sat, 25 Aug 2001 19:23:27 -0400 (EDT)
>From: Mark Hahn =
>To: beowulf at beowulf.org
>Subject: Re: HELP
>
>> I ran into this problem as well - the basic problem =
>seems to be that
>> linux maps the shared libraries at around the 1GB =
>mark, so you need to
>> change this location in the kernel source code.
>
>more generally, mmaps start at 1G by default (not just =
>shlibs).
>it's pretty cool that you can just "cat =
>/proc/self/maps" to see this.
>
>and you can indeed hack the kernel to change the 1G; =
>there's actually =
>a somewhat more involved patch to make the mmap arena =
>grow *down*,
>so you can fix the max size of the stack instead of the =
>heap.
>it's conceivable this might get into 2.5.
>
>it's also true that you can use a modern glibc whose =
>malloc =
>will use both heap and mmap arenas; that doesn't give =
>you a =
>big contig allocation, though.
>
>you can also avoid the problem *entirely* by avoiding =
>mmaps!
>I posted a proof-of-concept of this here or linux-kernel
>sometime in the past year - just avoid using stdio and =
>any dynlibs ;)
>(stdio seems to want to mmap a single page for an =
>internal buffer,
>even if you statically link...)
>
>> addr =3D TASK_UNMAPPED_BASE;
>
>note also that some Linux ports have this configurable -
>I think it's ia64 that has it set in /proc...
>otoh, it's sort of moot on big-address hardware ;)
>
>regards, mark hahn.
>
>
>--__--__--
>
>Message: 11
>Date: Sun, 26 Aug 2001 13:21:59 +1000 (EST)
>From: Kim Branson =
>To: Tom Poe =
>cc: "Eric T. Miller" ,
>"Lambe, Dave" ,
>"Beowulf (E-mail)" =
>Subject: Re: Need to do something Useful
>
>
>
>
>the code (some of it is based on work done at the UCSF, =
>its a minimal
>license for academic work type of deal... industry =
>types pay big $$ ) So
>there might be legal hassles for non academic work. =
>
>It sure like to set it up as a beowulf.org project, but =
>i would need some
>help...volunteers?
>
>kim
>
>________________________________________________________-
>______________ =
>
>Mr Kim Branson
>Phd Student
>Structural Biology
>Walter and Eliza Hall Institute
>Royal Parade, Parkville, Melbourne, Victoria
>Ph 61 03 9662 7136
>Email kbranson at wehi.edu.au
>
>________________________________________________________-
>______________ =
>
>
>On Wed, 15 Aug 2001, Tom Poe wrote:
>
>> Hi, again: Forgot to mention, this looks to me like =
>it's a really neat
>> beowulf.org project, or HA.org project. What do you =
>think? I'd like to do
>> a bid, but maybe it's something the Open Source =
>community can rally around.
>> Who knows? Thanks, Tom
>> ----- Original Message -----
>> From: Kim Branson =
>> To: Eric T. Miller =
>> Cc: Lambe, Dave ; Beowulf =
>(E-mail)
>> =
>> Sent: Wednesday, August 15, 2001 4:18 PM
>> Subject: RE: Need to do something Useful
>> =
>> =
>> >
>> >
>> > Of you like you could install globus on your =
>machine and we can add it to
>> > our global grid for drug design applications.
>> >
>> > see http://www.csse.monash.edu.au/~rajkumar/vlab/ind-
>ex.html
>> > for more details.
>> >
>> > We are interested in designing small molecule =
>atagonists for malaria and
>> > leishmania.
>> >
>> > failing that theres always seti or something....
>> >
>> > kim
>> > ____________________________________________________-
>__________________
>> >
>> > Kim Branson
>> > Structural Biology
>> > Walter and Eliza Hall Institute
>> > Royal Parade, Parkville, Melbourne, Victoria
>> > Ph 61 03 9662 7136
>> > Email kbranson at wehi.edu.au
>> >
>> > ____________________________________________________-
>__________________
>> >
>> >
>> > On Wed, 15 Aug 2001, Eric T. Miller wrote:
>> >
>> > >
>> > > >About 2 months ago, I setup a small cluster =
>using Scyld. The
>> > > >developers/programmers have been keyholed into =
>another project for the
>> time
>> > > >being. I would like to do something with the =
>cluster as it's just using
>> > > >electricity & creating heat.
>> > > >Is there a way to fire up dnetc (or similar) on =
>all the nodes? I
>> apologize
>> > > >for my lack of *nix knowledge (I'm a =
>hardware/setup guy). TIA
>> > > >
>> > > >
>> > > >Dave
>> > >
>> > >
>> > > Yes! I had a similar question about a week ago =
>that didn't get much
>> > > response. I too am new to clusters, and I just =
>want to do something
>> useful
>> > > and interesting with my new creation. It is =
>currently just a very
>> > > intelligent space heater.
>> > >
>> > >
>> > > _______________________________________________
>> > > Beowulf mailing list, Beowulf at beowulf.org
>> > > To change your subscription (digest mode or =
>unsubscribe) visit
>> http://www.beowulf.org/mailman/listinfo/beowulf
>> > >
>> >
>> >
>> > _______________________________________________
>> > Beowulf mailing list, Beowulf at beowulf.org
>> > To change your subscription (digest mode or =
>unsubscribe) visit
>> http://www.beowulf.org/mailman/listinfo/beowulf
>> >
>> =
>> =
>> =
>> _______________________________________________
>> Beowulf mailing list, Beowulf at beowulf.org
>> To change your subscription (digest mode or =
>unsubscribe) visit http://www.beowulf.org/mailman/listin-
>fo/beowulf
>> =
>
>
>--__--__--
>
>Message: 12
>Date: Sun, 26 Aug 2001 12:50:56 +0200
>From: "andreas boklund" =
>To: =
>Subject: Re: Network RAM for Beowulf
>
>Just a small
>If you take a look at http://www.mosix.org/ they have a =
>different approach to Network RAM. Trying to move the =
>process to the Data instead of moving pages over the =
>network. Interesting project, i want to know where they =
>end up...
>
>Best Regards
>//Andreas
>
>
>--__--__--
>
>Message: 13
>charset=3D"iso-8859-1"
>From: Eray Ozkural (exa) =
>Organization: Bilkent University
>To: Thomas R Boehme ,
>"'Mark Hahn'" , =
>beowulf at beowulf.org
>Subject: Re: Network RAM for Beowulf
>Date: Sun, 26 Aug 2001 17:31:06 +0300
>
>-----BEGIN PGP SIGNED MESSAGE-----
>Hash: SHA1
>
>On Saturday 25 August 2001 08:51 pm, Thomas R Boehme =
>wrote:
>> There are many applications that could make =
>reasonable use of network RAM.
>> Basically everything which need more RAM then =
>currently possible and
>> therefore has to swap to disk to process the data =
>(database applications,
>> gaussian, etc.). The network latency is high compared =
>to memory latency,
>> but not compared to disk slatency. There, network =
>beats it by several
>> orders of magnitude.
>> I know a lot of applications which have swapfiles of =
>several gigabytes,
>> beeing able to keep them in memory (and even if it is =
>network ram) can
>> speed then up significantly. And not everybody can =
>afford to buy Itaniums
>> with more than 4 Gig's of memory.
>
>I don't think you could say that in general. The =
>network is fast for a few =
>large messages perhaps but not for many small ones. The =
>problem, IMHO, stems =
>from the fact that there is no low level way to =
>transform a serial program to =
>a parallel one! The more non-local memory access =
>pattern in the original
>application, the worse speed-up you will get. You would =
>get good speedup, it
>seems to me, only if the problem is embarrasingly =
>parallel. By speedup here I
>mean the ratio of running time to single node/virtual =
>memory. That is, a =
>distributed shared memory system -no matter how =
>efficient or optimal- is not =
>likely to provide a scalable way to increase memory =
>available for =
>applications, especially if you want to utilize more =
>than a single node's CPU =
>for large tasks.
>
>I think that is also the same reason why you can use =
>virtual memory for
>running some algorithms while it would be infeasible =
>for others.
>Theoretically speaking, an out-of-core algorithm can be =
>shown to be
>equivalent to a certain parallel architecture.
>
>That is not to say that DSM is a cursed enterprise, but =
>rather that such
>methods have to be complemented by parallel programming =
>support.
>
>Regards,
>
>- -- =
>Eray Ozkural (exa) =
>Comp. Sci. Dept., Bilkent University, Ankara
>www: http://www.cs.bilkent.edu.tr/~erayo
>GPG public key fingerprint: 360C 852F 88B0 A745 F31B =
>EA0F 7C07 AE16 874D 539C
>-----BEGIN PGP SIGNATURE-----
>Version: GnuPG v1.0.6 (GNU/Linux)
>Comment: For info see http://www.gnupg.org
>
>iD8DBQE7iQgqfAeuFodNU5wRAmDdAJ9fjAHeh+DZojIEMEW/jbuKnM9b-
>GACfdTP/
>L0bff8QqLzx3XqLL0B6drgM=3D
>=3DLJLN
>-----END PGP SIGNATURE-----
>
>
>
>--__--__--
>
>_______________________________________________
>Beowulf mailing list
>Beowulf at beowulf.org
>http://www.beowulf.org/mailman/listinfo/beowulf
>
>
>End of Beowulf Digest
=
More information about the Beowulf
mailing list