Archives


- Beowulf
- Beowulf Announce
- Scyld-users
- Beowulf on Debian

Memory Limits on Linux on x86

Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.

Search

Jeff Layton laytonjb at bellsouth.net
Fri Jul 19 10:42:16 PDT 2002


Mark Hahn wrote:

> > problem we have. I know that 32-bit x86 Linux has
> > a memory limit of 3 Gigs (3.5 with a patch) that it
>
> 3.75 is pretty trivial.  don't let the "patch" scare you off -
> there's nothing exotic about it, it's been around for years,
> consists of just a couple lines of code change, and some dist/kernels
> come with it as a CONFIG_ option.

Yes, I've seen the patch (very simple).


>
>
> > can address. Is that 3 Gigs per user process or 3 Gigs
> > total?
>
> ia32 hardware is inherently limited to 4G to a process, always, ever, period.
>
> the 3/3.5/3.75 comes from the fact that the kernel likes to have an
> aperture within that space so that it can do IO.  (consequently,
> doing 3.75 with lots of fast IO would be a mistake.)

I was thinking of 3.5 Gigs with some pretty hefty IO it a Ramdisk
from the extra memory. Do you think this would work OK?


>
>
> the kernel can use up to ~64G physical ram.
> even if you have just one 3G proc running, this ram may still
> be worth using, since you can do IO and have the 60G of pagecache.
> you can also use that ram for Shm, though of course no one proc
> can have more than a few gigs mapped at once.
>
> note that doing lots of IO through highmem can be a performance problem
> as well, since not all IO hardware can deal with 64b addresses.
>
> if you have 21 3G procs running, using something like MPI,
> there will be no problem using all 64G ;)  if you manage,
> please do brag to the list...

I wish! I'm hoping to do two 3.5 Gigs processes and a 4 Gig
Ramdisk for better IO throughput (instead of a disk).


Thanks!

Jeff


>
>
> > With the new E7500 and GC chipsets with large
> > amounts of memory, I'm hoping it's 3 Gigs per user
> > process.
>
> it is.




More information about the Beowulf mailing list