[Beowulf] hadoop

[Andrew Holway]

Sure. With virtualisation by KVM. (although not sure about the windows and
mac) Maybe VirtualBox?

I'm currently designing a cloud computing platform that uses NFS for the
worker virtual machines (databases and webservers etc) and the local
storage can be exported using gluster or whatever.

Say if you have 5 machines. Each machine has a RAID volume. You can use LVM
to carve up this volume so that one VM can use half of it for Gluster and
another VM could use the other half of it for hadoop.

You can also do the same with individual disks, this disk is for this VM
and this disk is for that vm..

Here is a command I use on my centos 6.3 machines to create a VM with three
disks. Each disk is an LVM logical volume. path=/dev/sdb is just as valid
however.

Took me about a month to properly get my head around KVM.

virt-install
--connect qemu:///system -n cheese36 -r 11264
--vcpus=4
--disk path=/dev/vg0/pcheese36,device=disk,bus=virtio
--disk path=/dev/vg0/cheese36,device=disk,bus=virtio
--disk path=/dev/vg1/cheese36,device=disk,bus=virtio
--vnc
--noautoconsole
--os-type linux
--accelerate
--network=bridge:br0,mac=00:00:00:00:24:00,model=virtio
--pxe
--hvm






2012/11/27 Jonathan Aquilina <eagles051387 at gmail.com>

> Sadly I have no experience in a cluster environment :( I do have my old
> laptop and hopefully have a 2nd one soon. Is it possible to have a mixed
> cluster with gluster or hadoop or any other clustering technology which is
> a hetrogenous cluster in terms of linux machines and mac machines and if
> someone wants windows machines?
>
> On Tue, Nov 27, 2012 at 9:21 AM, Andrew Holway <andrew.holway at gmail.com>wrote:
>
>> not as efficient as gluster I would venture.
>>
>>
>> 2012/11/27 Jonathan Aquilina <eagles051387 at gmail.com>
>>
>>> Hey guys I was looking at the hadoop page and it got me wondering. is it
>>> possible to cluster together storage servers? If so how efficient would a
>>> cluster of them be?
>>>
>>> --
>>> Jonathan Aquilina
>>>
>>> _______________________________________________
>>> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
>>> To change your subscription (digest mode or unsubscribe) visit
>>> http://www.beowulf.org/mailman/listinfo/beowulf
>>>
>>>
>>
>
>
> --
> Jonathan Aquilina
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.beowulf.org/pipermail/beowulf/attachments/20121127/cd41e1b0/attachment.html>