[Beowulf] hadoop

[Jonathan Aquilina]

Interesting indeed. Does LVM span across multiple storage servers?

That is another issue and im not trying to open up a can of worms but what
is the advantage of using KVM over xen or even citrix xen server

On Tue, Nov 27, 2012 at 10:32 AM, Andrew Holway <andrew.holway at gmail.com>wrote:

> Sure. With virtualisation by KVM. (although not sure about the windows and
> mac) Maybe VirtualBox?
>
> I'm currently designing a cloud computing platform that uses NFS for the
> worker virtual machines (databases and webservers etc) and the local
> storage can be exported using gluster or whatever.
>
> Say if you have 5 machines. Each machine has a RAID volume. You can use
> LVM to carve up this volume so that one VM can use half of it for Gluster
> and another VM could use the other half of it for hadoop.
>
> You can also do the same with individual disks, this disk is for this VM
> and this disk is for that vm..
>
> Here is a command I use on my centos 6.3 machines to create a VM with
> three disks. Each disk is an LVM logical volume. path=/dev/sdb is just as
> valid however.
>
> Took me about a month to properly get my head around KVM.
>
> virt-install
> --connect qemu:///system -n cheese36 -r 11264
> --vcpus=4
> --disk path=/dev/vg0/pcheese36,device=disk,bus=virtio
> --disk path=/dev/vg0/cheese36,device=disk,bus=virtio
> --disk path=/dev/vg1/cheese36,device=disk,bus=virtio
> --vnc
> --noautoconsole
> --os-type linux
> --accelerate
> --network=bridge:br0,mac=00:00:00:00:24:00,model=virtio
> --pxe
> --hvm
>
>
>
>
>
>
> 2012/11/27 Jonathan Aquilina <eagles051387 at gmail.com>
>
>> Sadly I have no experience in a cluster environment :( I do have my old
>> laptop and hopefully have a 2nd one soon. Is it possible to have a mixed
>> cluster with gluster or hadoop or any other clustering technology which is
>> a hetrogenous cluster in terms of linux machines and mac machines and if
>> someone wants windows machines?
>>
>> On Tue, Nov 27, 2012 at 9:21 AM, Andrew Holway <andrew.holway at gmail.com>wrote:
>>
>>> not as efficient as gluster I would venture.
>>>
>>>
>>> 2012/11/27 Jonathan Aquilina <eagles051387 at gmail.com>
>>>
>>>> Hey guys I was looking at the hadoop page and it got me wondering. is
>>>> it possible to cluster together storage servers? If so how efficient would
>>>> a cluster of them be?
>>>>
>>>> --
>>>> Jonathan Aquilina
>>>>
>>>> _______________________________________________
>>>> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin
>>>> Computing
>>>> To change your subscription (digest mode or unsubscribe) visit
>>>> http://www.beowulf.org/mailman/listinfo/beowulf
>>>>
>>>>
>>>
>>
>>
>> --
>> Jonathan Aquilina
>>
>
>


-- 
Jonathan Aquilina
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.beowulf.org/pipermail/beowulf/attachments/20121127/8406cbb7/attachment.html>