Reviews You Can Rely On

How We Tested Vacuum Cleaners

Tuesday October 12, 2021
How do we test vacuums? We bought the top models available on the...
How do we test vacuums? We bought the top models available on the market today and tested them side-by-side.
Credit: Jenna Ammerman

We bought the best vacuum cleaners currently available on the market and put them through an exhaustive series of side-by-side tests to find the best. We put these products through a grueling series of challenges, objectively comparing their performance to determine final scores and award winners. The following sections explain the details of our testing process — what we did, what we looked for, and how we scored it.

Carpet Cleaning


The first thing that comes to mind for most people when comparing vacuums is how well they clean carpet. Consequently, this set of tests carried the most weight in the overall scores, comprising 35% of each product's final score. We conducted 8 tests in total: 4 different debris types each on a low-pile test carpet, as well as on a section of medium-pile carpet.

The first sample mess item we used was rice. We spread a predetermined amount of rice over a marked-out area, then used a floor roller to really press the rice into the carpet. We then counted how many passes it took for each vacuum to get the floor to appear clean, as well as noting how much rice was picked up on the first pass.

We love how the front roller of the Vertex keeps messes like rice or...
We love how the front roller of the Vertex keeps messes like rice or oats from getting thrown around when vacuuming hard surfaces.
Credit: Jason Peters

We thoroughly cleaned the section of carpet between each test with a dedicated vacuum that was not part of the test, to avoid unequal wear on one of the competing vacuums. This identical test was then performed on a section of fluffier, medium-pile carpet.

This same pair of tests was repeated with cereal, oatmeal, and flour, to complete our set of carpet cleaning tests.

Some of the results from our flour collection test on low-pile carpet.
Some of the results from our flour collection test on low-pile carpet.
Credit: Austin Palmer

We conducted the first three tests with rice, cereal, and oatmeal in succession, then stopped and cleaned out each vacuum cleaner thoroughly before the flour test, as it was somewhat of a torture test for these products and the vacuums were full from the first three types of debris.

Ease of Use


The set of tests for ease of use carried the second-highest weighting in the review, accounting for 25% of the overall score. This metric basically assessed how easy it was to clean a home with each vacuum, with a series of simulated scenarios to compare the performance of each product. One of the first things we looked at was the edge cleaning abilities of each vacuum. We spread rice along a wall, then ran each vacuum right up against the edge. We scored based on the thickness of the stripe of leftover materials.

The Kenmore did exceptionally well in this test, leaving practically...
The Kenmore did exceptionally well in this test, leaving practically no debris behind.
Credit: Austin Palmer

Next, we evaluated the reach of each vacuum under furniture. We created a simulated sofa out of boxes, matching the gap to the average sofa. After spreading the rice out, we measured how far each vacuum could reach and scored accordingly.

Every angle and reach was measured and recorded for each tested...
Every angle and reach was measured and recorded for each tested vacuum.
Credit: Jason Peters

We then ranked how each vacuum handled transitioning between flooring types, whether it was automatic or manual and if you had the option to turn the brush off. Then we looked at and rated the maximum reach for normal floor cleaning use, including the cord.

Finally, we looked at the noise level of each product, having someone rate the level and tone, as well as using an SPL meter to take a reading of the decibels produced by each vacuum while in operation.

Handling


Handling was the next highest weighted metric, measuring in at 20% of the total score. This metric consisted of ranking the maneuverability of each model, the pushing and pulling effort, as well as the prowess of each product at cleaning stairs.

To assess maneuverability, we used each vacuum to clean a test course filled with various obstacles. We noted any areas that were difficult to clean, regions that tripped up the vacuums, or obstacles that they became caught on.

The swivel steering on the APEX makes it a breeze to maneuver around...
The swivel steering on the APEX makes it a breeze to maneuver around furniture.
Credit: Jenna Ammerman

We then assessed the effort it took to push or pull each vacuum, ranking each vacuum side-by-side on a hard floor, low-pile carpet, and medium-pile carpet. Next, we tested the performance of each vacuum at cleaning stairs. We did this by comparing the maximum number of stairs reached, this time using the hose attachment on the upright vacuums. We also took the weight of each product into account, as well as if the base was prone to tipping over.

The Dyson Ball Animal 2 has an exceptional reach and was able to...
The Dyson Ball Animal 2 has an exceptional reach and was able to clean an entire flight of stairs without needing to be moved.
Credit: Jenna Ammerman

Hard Surface Cleaning


Cleaning hard surfaces is a relatively small portion of the final score, only accounting for 10% of the total score for each vacuum. This is primarily because these products are designed for and mainly used on carpet. We conducted a similar series of tests to carpet cleaning, once again using rice, cereal, oatmeal, and flour as our test debris particles. We also paid particular attention to the cracks in our test hardwood floor, noting if the vacuums extracted all of the debris, particularly flour.

This vacuum caused an explosion of rice on the hard floor.
This vacuum caused an explosion of rice on the hard floor.
Credit: Jenna Ammerman

Pet Hair


Finishing out our tests, this metric accounted for the remaining 10% of the total score. Conveniently, a nearby pet groomer was more than happy to give us an excess of pet hair for this test, allowing us to weigh out a constant amount of hair for each vacuum. We spread out this hair, then used the floor roller once again to grind the hair into the carpet.

Our lead tester spreading fur out for our test. This was then...
Our lead tester spreading fur out for our test. This was then pressed in with a linoleum roller.
Credit: Jenna Ammerman

We ran each vacuum for five minutes over the pet hair-covered areas, assuring that each section of the carpet had at least 10 passes. We then went over again with our fresh cleanup vacuum and weighed the hair it picked up, subtracting this from the measured amount to calculate how much pet hair the tested vacuum collected. We repeated this somewhat arduous process for each vacuum in our review.

One of the pet hair donors for our tests. He only agreed to pose for...
One of the pet hair donors for our tests. He only agreed to pose for a photo with his mortal enemies after plenty of coaxing and treats.
Credit: Jenna Ammerman