Yes, correct I will install all the appropriate services and OS to make that happen.

Here's what I recommend:
Linux centos 6 86_64
Nginx Server
Varnish in front of Nginx
APC
MySql database tuning

I will then setup the proper configuration, wether you're using Magento or Wordpress or any other dynamic PHP-based website.

Noted: Considerably decreased Loading time of 85%! Which is huge, a survey states that a small loading time have an impact on the Sales made on a website.

Maybe not a major gain in term of SEO. But in term of sales once a customer reaches your website, it will make a great User Experience.

I have tweaked 2 websites on Magento and working on others right now.

So if anybody interested, i'll give you a Quote in PM after analyzing your project.

Example Magento website loading <2sec www.mymarketplace.com Check the inner-pages also.