How to Build the Best Browser Test Suite

How to Build the Best Browser Test Suite
Testing a website used to be so much easier. You would develop and test your code in Internet Explorer and be totally oblivious to anything but major HTML, CSS or JavaScript errors. Even the most conscientious developers would only test a couple of other minority browsers.

Today, we are faced with 5 mainstream browsers and, to complicate matters further, each of those has multiple versions. Usage statistics vary from site to site, but the following browsers should cater for 99% of users:

  • Microsoft IE6 and IE7 (IE8 coming soon)
  • Mozilla Firefox 2 and 3 (Firefox 3.5 coming soon)
  • Apple Safari 3 (Safari 4 coming soon)
  • Google Chrome 1
  • Opera 9

Need to get closer to 100% user coverage? Throw in IE5, IE5.5, Netscape 6, Mozilla 1.7, mobile Opera mini, a PlayStation 3, a PSP, a few historical versions of Mac Safari, and a couple of screen readers. This is a daunting list: testing your web application could take longer than building it!

Fortunately, it is easy to install multiple versions of Firefox, Safari and Opera on a single PC: just choose a different installation folder. It is early days for Chrome, but I suspect Google will issue automatic updates so most users will have the latest version.

As always, the tough one is Internet Explorer. The browser is tightly integrated into Windows so only one version can be installed. Vista users can not downgrade and must use either IE7 or IE8. However, there are a number of ways to test multiple browsers on a single PC.

Online Browser Simulators

Several online systems can be used to show how your site works across various combinations of OS and browser:

There is nothing to install, however, your site must be live, testing is a slow process, and the better services charge a fee. You only see a screenshot so debugging is tricky and you certainly will not discover JavaScript errors or other subtle problems.

These systems are undoubtedly useful, but it is probably better to use them towards the end of your testing process.

Install Multiple Versions of Internet Explorer

Multiple versions of IE can be installed on a single PC. Standalone versions of IE6 (and any version back to v3.0) can be downloaded from the browser archive. XP users can simply extract the files and create a shortcut to iexpore.exe. Unfortunately, they do not work in Vista.

An alternative is the Xenocode Browser Sandbox which provides IE6, IE7, IE8, Firefox 2, Firefox 3, Chrome, Opera and Safari. These are single .exe files that use virtualization technology to ensure the browser runs in its own segregated environment without affecting your core system.

Finally, there is IETester from DebugBar. This is certainly the easiest application to install and use. It offers tabbed browsing with all versions of IE from 5.5 to 8.0 beta.

How to Build the Best Browser Test Suite

Whilst these tools are useful, you should be aware that you are not running ‘real’ installations of IE. The problems include:

  • There are some interface quirks and features such as the browser history, cookies and the cache may not work as you expect.
  • Filters and transitions fail in IE5.5/6.0 so 24-bit PNGs and transparency effects will not appear. There is a workaround for XP standalone browsers, but neither Xenocode or IETester appear to implement a solution.
  • The old browser might use the latest IE7 JavaScript engine.
  • Conditional CSS comments will fail or become confused – which is another good reason to avoid them!

Use a Virtual Machine

The most reliable way to run an old version of IE is to use a dedicated PC with a clean installation of Windows. However, it is not necessary to fill your office with clunky old desktops: you can use virtual machine software to emulate any number of PCs on a single machine. Popular VM software includes:

  • VMware: one of the first and best. Confusingly, VMware Server is free whereas VMware Workstation is a more advanced commercial product offering snapshots and cloning.
  • VirtualBox: an excellent open source product owned by Sun Microsystems. It feels as fast as VMware, although lacks a few minor features such as file drag-and-drop between the host and guest OS.
  • Microsoft Virtual PC: a solid free VM, although it is not as fast or fully-featured as its competitors.

How to Build the Best Browser Test Suite

After installing the software, you create a new PC then boot-up with an Window installation disk or ISO in the virtual CD drive. Any version of Windows from 98 to XP should be adequate for installing old versions of IE.

There are several other advantages to using virtual machines:

  • Virtual disks can be copied and backed up. You can trash the OS and revert to a previous image in seconds.
  • You can install older browsers or try out new software without polluting your main PC.
  • You can install other operating systems such as Linux and test a range of other browsers (Lynx is great for assessing accessibility).

Building your browser suite takes time and none of the solutions are perfect. However, the newly released Microsoft SuperPreview could be the answer to many browser testing problems…

Have I missed your preferred method of testing multiple browsers?


Category: programming Time: 2009-03-17 Views: 1

Related post

  • How to install the stock Browser app on Nexus 7 (2013)? 2013-12-03

    I would like to run the stock Android Browser app on a Nexus 7 (2013) tablet to make sure that websites that I develop will work properly in the stock Browser. However, a Nexus 7 (2013) tablet comes with Chrome pre-installed and not the stock Browser

  • What is the best browser for simulating? 2015-01-30

    I need a browser that is efficient at calculating sums using Javascript. Things that are required: Browser that is fast GUI not required Runs of Windows/Linux Big plus if free --------------Solutions------------- Take a look at PhantomJS. PhantomJS i

  • How usable is the Android browser on "average" web sites? 2010-09-22

    I'm thinking about buying an Android phone to use for light web browsing while traveling. How well does the Android browser work on average web pages? Besides the smaller screen and lack of flash are there other limitations? I'm particularly interest

  • What's the best Browser for Android? 2011-07-28

    I imagine most people these days use a service to remember their countless credentials that have built up over the course of their internet career. I use LastPass and while looking for the Android browser extension I stumbled on Dolphin HD. I was out

  • How to build the mainline kernel source package? 2011-12-21

    Ubuntu kernel PPA only provides linux-headers*.deb and linux-image*.deb packages. How can I build the corresponding linux-source*.deb package ? Context: I'm currently running Ubuntu 11.10 with the mainline kernel (3.2 rc6 now) to get a better support

  • How to get the best quality in Instagram with Lightroom? 2015-06-15

    How to get the best quality in Instagram? I tested this export settings to avoid Instagram compression : Instagram use these settings, but the app still compress my pictures... Why? Thanks for your help/tips. --------------Solutions------------- I th

  • How to get the best LINPACK result and conquer the Top500? 2010-06-10

    Given a large Linux HPC cluster with hundreds/thousands of nodes. What are your best practices to get the best possible LINPACK benchmark (HPL) result to submit for the Top500 supercomputer list? To give you an idea what kind of answers I would appre

  • How to run the ChromePlus browser in Ubuntu? 2012-07-19

    I'm new to Linux Ubuntu. I was using ChromePlus in Windows 7, it also has a Linux version. So I downloaded it. It's a chromeplus*.tar.gz file. I use the command tar xvzf chromeplus*.tar.gz to unzip the file and got a bunch of files. I really have no

  • How to do the "paper clip test" on an old PSU with 20-pin connector? 2012-12-30

    I have a PSU (power supply unit) of the old type with a 20-pin main power connector for the motherboard. Unlike most of the newer units with the 24-pin power connector this one does not have a green "power on" wire. What is the equivalent to thi

  • How to bring the best search results to my users? 2014-01-01

    I am creating a website similar to yel where people add information about their businesses to show they are available for clients who need them. The business table has the following fields (business name, categories, products, description, phone, pic

  • Gradle error when building the android-support-test project 2016-02-05

    I'm trying to build the Android Support Testing project. I'm following these instructions. I've got my build env setup and I've synced the Repo. When I try to build the project I get this error. $ pwd /Volumes/android/android-support-test $ ls -l -r-

  • How can I build a configurable JUnit4 test suite? 2016-01-28

    Guava has an extensive set of tests for collection implementations written in JUnit3 that look like: /* * Copyright (C) 2008 The Guava Authors * * Licensed under the Apache License, Version 2.0 (the "License"); * you may not use this file except

  • How can I build the best Cyber Cafe possible using Ubuntu (Desktop or the Server Edition)? 2013-03-13

    My question has to do with my plan/dream of opening a Cyber Cafe in Mogadishu, Somalia, my birth place. I plan to use 5 to 15 computers (all laptops) running Ubuntu. Now that you have the background to my question, I need your help, advice and expert

  • How to pick the best Android phone and tablet for testing? 2016-02-08

    Is there a golden rule on picking the best Android phone for testing? I am an Android developer. Should we go with Nexus family explicitly or there is a better way to determine "What device is the best one for testing right now"? So far I used d

  • How to select the best Stripe Size when configuring a RAID Array 2009-12-21

    There are various "references" on the Internet that delve into some discussion about what factors to consider when selecting a particular RAID stripe size (4KB to 128KB or more) for an array of disks, but none of these come across as very author

  • Is Opera 10.5 the Best Browser Ever? 2010-03-09

    Opera has one of the most rapid browser release schedules and 10.5 is now available - just in time for Microsoft's EU browser choice screen. You'll need to download it from, although automatic updates from previous versions will appear shor

  • How to choose the best approach when adding features/refactoring code 2011-03-25

    I've got a problem. I find really difficult to foresee the effect that my changes to the code will have over the whole application, either when I have to add new features or re-factor it. Very often it is not until testing time that I find out that I

  • What is the best browser usage statistics source? 2011-07-18

    I wonder about what source of browser usage statistics is most reliable and updated. I've been using Google Analytics (with use of my analytics enabled pages) W3 Counter Stat Counter but they are too different (one from each other), that I cannot say

  • How do build time and unit test time compare? 2011-07-23

    Does this depend heavily on the type of project (e.g. scientific software vs banking system vs game)? If so, in which areas is the difference the highest and lowest? In your experience, is it safe to say that as a rule, the time it takes to run unit

iOS development

Android development

Python development

JAVA development

Development language

PHP development

Ruby development


Front-end development


development tools

Open Platform

Javascript development

.NET development

cloud computing


Copyright (C), All Rights Reserved.

processed in 2.760 (s). 13 q(s)