Vmotion meets JVMs

Last night I finished reading “Land of Dreams” by James P. Blaylock (book review blog in an alternate universe) and was just wondering whether to start reading another book but instead starting thinking about vmotion.

Wouldn’t it be great, I thought, if VMs or applications could be dynamically moved between different types of processor. Now, it’s pretty awesome that we can move VMs between the same type of processors at the moment, even if Vmware’s current vmotion technology is pretty fussy about processor types. But to move between different processors, architectures even, that would be a land of dreams.

Let’s not forget that a few years ago the prospect of moving a running OS from one machine to another was pretty far out. And that virtualisation is not a new concept in computing, the current virtualisation revolution is only an evolution of how to arrange layers of abstraction…that big onion that starts with transistors and ends up with Java or something.

So what would it take to move a running program or OS from one architecture to another? Well it would probably take another layer of abstraction, like say a virtual machine target, something that had an interpreted byte code language, something like a Java Virtual Machine. I believe the catchphrase of Java was (or is) write once, run anywhere? Well, if you had a program running on a JVM on an x86 architecture and the same JVM could run on a Sparc architecture, what’s to stop a piece of vmotion technology moving that application from one to the other?

Many things, probably, and I don’t know enough about JVMs (or vmotion) to even know what they would be. The question being, would they be show-stoppers which could not be overcome?

Anyway, seems like an interesting idea, which is partly the point of this blog even if a) no-one reads it and b) it makes me look silly. At the other extreme of course, if it is do-able, someone is probably trying or has done it already. And let me remember (showing my age again) the early 80’s when I was using the UCSD p-system. Which was an interpreted Pascal based virtual machine designed to run on many different micro-processors (booting from floppy disk). http://en.wikipedia.org/wiki/UCSD_Pascal. Java, new?

Found a new book to read “Shogun”. I wonder what ideas might come out of that?

Almost there

As I hone in on a home machine configuration (I won’t go so far as to call it a lab) I can offer this very useful link on Nehalem memory configuration.

http://www.delltechcenter.com/page/04-08-2009+-+Nehalem+and+Memory+Configurations.

There’s soooo much choice on the HP website it makes it hard to choose. Even more choice of processor on the Intel website. Things were much simpler when you had to choose between a BBC micro model “A” and a BBC micro model “B”.

Anyway, it’s looking like an HP ML330 G6 with twin quad core E5504 processors and 3 additional 2G RDIMMS. I’m thinking I can use the 2G UDIMM it comes with to keep the other processor happy.

That’s probably way too much power for a typical home machine but in a few years time I bet it will look old and slow.

I’ll post the cost of it all when I get management sign off, if you know what I mean.

Academia

The years I spent in academia, learning my craft, so to speak are full of good memories. It is disappointing that these days so much less research seems to be done in an academic environment. Looking for current research on virtualisation turns up papers from EMC, IBM, HP, SUN etc. Nothing wrong with that as very good research is no doubt done and researchers are (I suspect) better paid, funded and resourced than they would be in today’s typical academic institution.

Companies however, are fundamentally different institutions from Universities and are ultimately driven by the lure of profit. I have not been in touch with academia for many years but I would like to think that the ivory towers still exist to provide an environment where researchers can follow any idea for no other reason than it is interesting to them. Call me old fashioned but I think there is great value in that and I don’t see much evidence of that taking place these days.

Perhaps it does and I am just out of touch, having spent pretty much my whole career working for large companies.

IT is lucky. “Ideas” are relatively cheap and easy to try out, either empirically by writing some code, or building some hardware or by mathematical modelling. Cheaper than building a multi million dollar particle smasher under the French/Swiss border anyway. On the flip side, being cheap and easy encourages people to work more in isolation, the early development of Linux by Linus Torvalds being an example.

Sure, there are communities and user groups but these are typically geared towards specific products and the problems and future development of them.

It’s not a question of quantity. IT by it’s very nature is constantly innovating, evolving and producing new ideas. It is the quality of the ideas I am worried about. I suspect, if the state of academic research were improved, IT would be rewarded with some truly remarkable things.

Done some reading

Over a hectic bank holiday weekend juggling DIY, childminding and my wife’s business duties (that’s another story) I managed to finish reading both ends of the spectrum: Virtualisation for Dummies and the 2003 Cambridge paper on Xen. Both are quite dated now, the academic paper much more so.

I was hoping to find some useful material in the Dummies guide for potential talks but no such luck.  The Xen paper is interesting, kinda, but is very out of date to the point of historical interest only. In those early days they were following a paravirtualised route and modifying Linux (Xenolinux) and Windows as guests. However they backed the wrong horse really as so much progress was made in hypervisor technology that Vmware became the market leader. Modifying all those guest O/S’s each time there was an update? It was never going to fly.

While I mull over my lab, I will continue to read some academic papers. More up-to-date ones! Based on that I hope to write a summary of the state of the art. Now I know myself that I don’t have a good record of finishing these things (family/work excuses etc. etc.) so I’ll see how I get on.

A quick trawl through AMDs blog

I mentioned the other day I needed to do some more research on AMD processors to use in a home lab so I was looking at the AMD blog and website. I found a post which plugs the latest version of Xen (and AMD processors) and saw thay had a link to the original Xen paper, Xen and the Art of Virtualisation http://www.cl.cam.ac.uk/research/srg/netos/papers/2003-xensosp.pdf. I like to read these academic papers, even the old ones. It helps to know where you’re going if you know where you’ve come from.

I also added to my reading list “Virtualisation for Dummies” which I also found on the AMD site. This is written and published by AMD so that has to be taken into consideration (did “Dummies” sell the rights to their format or something?). First glance looks good though and I will write some more feedback after I’ve read it. http://www.amd.com/us/Documents/Virt_for_Dummies.pdf. In an environment where I may have to explain virtualisation to “the business” I hope to find something useful in there.

It’s hardly worth saying AMD have just brought out new processors because they (and Intel and others) are doing it all the time. For my own reference (well and yours too) a good comparison page is http://products.amd.com/en-us/desktopcpuresult.aspx?f1=&f2=&f3=&f4=&f5=AM3&f6=&f7=&f8=&f9=&f10=&f11=&f12=True&f13=Active or http://products.amd.com/en-us/OpteronCPUResult.aspx?f1=AMD+Opteron%E2%84%A2+6100+Series+Processor for more server oriented chips. Fiddle around with those URLs and pages to get what you want.

I also regularly read “The register” http://www.theregister.co.uk/. Not only because it is a good source of information but it often makes me laugh out loud. They also published a “Virtualisation primer” today so I hope I get time to read that over the weekend too (DIY notwithstanding)…

Home setup

I’m following in Chad Sakac’s blogsteps here (and probably many others). Some kind of home lab is needed (and my iMac is not a good starting point).

Chad’s started in 2008 with an update in early 2009. Technology being what it is means modern hardware is a must. I already have Cat 5e installed so the other major components to consider are processors and storage. To be of most value the processors have to be something “industry” standard, as well compatible with as many products as possible…I’m not just thinking about playing with ESX/ESXi, there’s a whole world out there (http://en.wikipedia.org/wiki/Comparison_of_platform_virtual_machines).

Of course that means Intel or AMD. Obvious, yes. But this is IT so it was worth thinking about and justifying for a minute.

Intel have a plethora of processor options for every need. I’m thinking Nehalem from Intel at the moment. Opterons from AMD although I need to do more research on them. Having VT extensions is a must, of course. I started by looking for used HP proliant rack-mount servers on ebay, merely because I was familiar with them. Discussions with colleagues quickly led more to the tower servers and my favorite front runner is:

HP ProLiant ML330 G6 Tower Server

The following site looks like a good place to buy (good price and recommended by friends)

http://www.serversplus.com/servers/tower_servers/hp_tower_servers/517607-035#prod_spec

The good thing about this server is that it takes up to 144G internal memory. Nowadays 8G probably won’t be enough. Not that I intend to buy 144G straight off. I’m too scared even to work out the cost of that.

The server above has a E5504 details of which are: http://ark.intel.com/Product.aspx?id=40711

So, lets put that on the shopping list for now and turn to storage. Same arguments apply as for processors, it’s got to be something relevant and supported. I don’t think I’m going to be buying a DMX or a Clariion from ebay. The favorite here, again relying on colleagues who proceed me is a home NAS device from Qnap. Product range is  http://www.qnap.com/Products.asp. I need to do some more research on that myself.

Running out of time now so signing off for now.

Hello world!

Introduction

Duncan Baillie

Duncan Baillie

My name is Duncan Baillie. Welcome to my blog. This is my first ever blog so some background is in order. This is all going to be IT focused by the way.

I am lucky enough, and of the right age to have witnessed the revolution in home computing. The first computer I ever used was a Commodore Pet which turned up at the Maths department of my secondary school in 1979 (I think). The school, not knowing what to do with it stuck it in the cleaners broom cupboard and there I sat at break-time surrounded by pungent mops learning to program it in basic.

I had the bug and it was clear to me I wanted to study IT which I did at the University of Edinburgh from 1981 to 1988 doing a joint degree in Computer Science and Electronics and postgraduate studies in distributed operating systems.

At that time, another IT revolution was in full swing led by Xerox Parc and their amazing “workstations” with bit-mapped graphics and  those new-fangled mice. Soon to be copied by some other successful products (like Apple Macintosh) and some which disappeared (like ICL’s Perq).

I spent a lot of time at University learning Unix, firstly thanks to the Engineering department, a PDP 11 and the “learn” program (whatever happened to that). Unix (and C) went from strength to strength and when I left I was a fully qualified Unix sysadmin.

Fast forward now to the 21st century and I find myself taking part in another IT revolution, this time it’s called “Virtualisation”.

There, I’ve said it, the V word. I’ve recently been involved in a largish virtualisation project and having drunk from the cup of virtualisation I find myself liking the taste very much and wanting to drink some more. Hence this blog. This time round I hope to be able to contribute more to the revolution rather than watching other people. Partly this comes from a career in large organisations with highly inefficient IT (I wouldn’t go so far as to call it “Stupid IT”. The technology never ceases to amaze me). I don’t like inefficiency. I don’t like waste. That’s just my personality. This, no doubt, is the reason I am so enamoured with virtualisation.

So how do I hope to contribute to the world of virtualisation?

Watch this blog…