<div dir="ltr"><div><div><div>> Is Omega the successor?<br><br></div>John Wilkes from Google gave a presentation on Omega at Lisa '13 (video @ <a href="https://www.usenix.org/cluster-management-google">https://www.usenix.org/cluster-management-google</a>). If I recall correctly, he says in the talk that Omega was developed as a potential successor to their current cluster manager, but that they were still trialing the system and hadn't decided yet whether to switch. Or something to that effect -- I don't have time this morning to re-watch the video.<br><br></div><div>I haven't seen any publications which definitively say whether Google has chosen to move to Omega yet, but then, there wouldn't be. ;-)<br></div><div><br></div>The Borg paper also says:<br><br>> This is quite similar in spirit to the optimistic concurrency control used in Omega [69], and indeed we recently added the ability for Borg to use different schedulers for different workload types. (pg 5, section 3.4)<br><br></div>My understanding of Omega is that its major new feature is the ability to provide optimistic resource allocations to several different schedulers. So I wonder if Google has simply decided to backport the new, desired features of Omega back to Borg.<br><div><div><div><div><br></div></div></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Apr 21, 2015 at 7:51 AM, Scott Atchley <span dir="ltr"><<a href="mailto:e.scott.atchley@gmail.com" target="_blank">e.scott.atchley@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Is Omega the successor? The Borg paper mentions Omega :<div><br></div><div>
<div title="Page 12">
<div>
<div>
<p><span style="font-size:10pt;font-family:NimbusRomNo9L;font-style:italic">Omega </span><span style="font-size:10pt;font-family:NimbusRomNo9L">[69] supports multiple parallel, specialized “verti-
cals” that are each roughly equivalent to a Borgmaster minus
its persistent store and link shards. Omega schedulers use
optimistic concurrency control to manipulate a shared repre-
sentation of desired and observed cell state stored in a cen-
tral persistent store, which is synced to/from the Borglets by
a separate link component. The Omega architecture was de-
signed to support multiple distinct workloads that have their
</span></p>
</div>
</div>
</div>
<div title="Page 13">
<div>
<div>
<p><span style="font-size:10pt;font-family:NimbusRomNo9L">own application-specific RPC interface, state machines, and
scheduling policies (e.g., long-running servers, batch jobs
from various frameworks, infrastructure services like clus-
ter storage systems, virtual machines from the Google Cloud
Platform). On the other hand, Borg offers a “one size fits all”
RPC interface, state machine semantics, and scheduler pol-
icy, which have grown in size and complexity over time as a
result of needing to support many disparate workloads, and
scalability has not yet been a problem (</span><span style="font-size:10pt;font-family:CMSY10">§</span><span style="font-size:10pt;font-family:NimbusRomNo9L">3.4).</span></p><p><span style="font-size:10pt;font-family:NimbusRomNo9L"> </span></p>
</div>
</div>
</div></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Apr 16, 2015 at 12:20 PM, Deepak Singh <span dir="ltr"><<a href="mailto:mndoci@gmail.com" target="_blank">mndoci@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Great to see something about the Borg design out there. Google have also written about the successor to Borg, a framework called Omega.<div><br></div><div><a href="http://research.google.com/pubs/pub41684.html" target="_blank">http://research.google.com/pubs/pub41684.html</a></div><div><br></div><div>PDF: <a href="http://research.google.com/pubs/archive/41684.pdf" target="_blank">http://research.google.com/pubs/archive/41684.pdf</a> <div><div><br><br><div class="gmail_quote">On Thu, Apr 16, 2015 at 6:53 AM Chris Samuel <<a href="mailto:samuel@unimelb.edu.au" target="_blank">samuel@unimelb.edu.au</a>> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi all,<br>
<br>
This is a very recent (2015) paper describing the queuing system used by<br>
Google internally, called "Borg".<br>
<br>
<a href="http://research.google.com/pubs/pub43438.html" target="_blank">http://research.google.com/pubs/pub43438.html</a><br>
<br>
Full PDF available from there.<br>
<br>
Thought it might interest some folks!<br>
<br>
All the best,<br>
Chris<br>
--<br>
Christopher Samuel Senior Systems Administrator<br>
VLSCI - Victorian Life Sciences Computation Initiative<br>
Email: <a href="mailto:samuel@unimelb.edu.au" target="_blank">samuel@unimelb.edu.au</a> Phone: +61 (0)3 903 55545<br>
<a href="http://www.vlsci.org.au/" target="_blank">http://www.vlsci.org.au/</a> <a href="http://twitter.com/vlsci" target="_blank">http://twitter.com/vlsci</a><br>
<br>
_______________________________________________<br>
Beowulf mailing list, <a href="mailto:Beowulf@beowulf.org" target="_blank">Beowulf@beowulf.org</a> sponsored by Penguin Computing<br>
To change your subscription (digest mode or unsubscribe) visit <a href="http://www.beowulf.org/mailman/listinfo/beowulf" target="_blank">http://www.beowulf.org/mailman/listinfo/beowulf</a><br>
</blockquote></div></div></div></div></div>
<br>_______________________________________________<br>
Beowulf mailing list, <a href="mailto:Beowulf@beowulf.org" target="_blank">Beowulf@beowulf.org</a> sponsored by Penguin Computing<br>
To change your subscription (digest mode or unsubscribe) visit <a href="http://www.beowulf.org/mailman/listinfo/beowulf" target="_blank">http://www.beowulf.org/mailman/listinfo/beowulf</a><br>
<br></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
Beowulf mailing list, <a href="mailto:Beowulf@beowulf.org">Beowulf@beowulf.org</a> sponsored by Penguin Computing<br>
To change your subscription (digest mode or unsubscribe) visit <a href="http://www.beowulf.org/mailman/listinfo/beowulf" target="_blank">http://www.beowulf.org/mailman/listinfo/beowulf</a><br>
<br></blockquote></div><br></div>