Yes, correct I will install all the appropriate services and OS to make that happen.
Here's what I recommend:
Linux centos 6 86_64
Nginx Server
Varnish in front of Nginx
APC
MySql database tuning
I will then setup the proper configuration, wether you're using Magento or Wordpress or any other dynamic PHP-based website.
Noted: Considerably decreased Loading time of 85%! Which is huge, a survey states that a small loading time have an impact on the Sales made on a website.
Maybe not a major gain in term of SEO. But in term of sales once a customer reaches your website, it will make a great User Experience.
I have tweaked 2 websites on Magento and working on others right now.
So if anybody interested, i'll give you a Quote in PM after analyzing your project.
Example Magento website loading <2sec www.mymarketplace.com Check the inner-pages also.