T
Tom Gresham
The Lab Bench

Repeatable Product Testing: How I Find Out What Devices Are Really Like

Repeatable Product Testing: How I Find Out What Devices Are Really Like
Repeatable product testing reveals how phones, earbuds, tablets, and watches perform after the hype, with honest methods, real results, and useful buying...

Repeatable product testing is the difference between a useful review and a box-opening reaction. Anyone can admire a bright phone screen for ten minutes or say that earbuds sound “immersive.” The harder question is whether the screen remains readable outdoors, whether the earbuds stay comfortable after a two-hour call, and whether the battery still behaves normally after weeks of use. That is where my testing begins.

I spent eight years working in a corporate quality assurance lab, evaluating phones, tablets, audio gear, and wearables before they reached store shelves. Today, I use the same basic discipline on this blog, but I add the messiness of normal life. Devices go into pockets, backpacks, cars, kitchens, bedrooms, and family hands. Spec sheets are free. Truth takes a few weeks.

What Repeatable Product Testing Actually Means

A repeatable test is one another person could perform and reasonably reproduce. That does not mean every home has a thermal chamber or a laboratory light meter. It means the procedure is clear enough that the result does not depend on my mood, a manufacturer’s preferred setting, or a convenient one-time result.

For a phone, I record the software version, display mode, brightness setting, wireless connections, battery percentage, and room temperature. I then run the same tasks in the same order: video playback, web browsing, camera use, gaming, calls, and standby time. If I compare two phones, both face the same workload. A device that lasts eight hours under light use has not “beaten” another device that spent half the test rendering a game.

The same principle applies to earbuds. I use identical source files, fixed listening levels, and familiar tracks with vocals, bass, and busy high frequencies. I check active noise cancellation, which reduces outside sound electronically, on a consistent commute or a controlled noise recording. Comfort gets tested separately because excellent sound means little if the ear tips hurt after 45 minutes.

Illustration for repeatable product testing

The Measurements I Trust More Than Marketing

Manufacturers often publish a maximum result, not a typical one. Battery claims can assume a low screen brightness, a specific codec, or a feature such as cellular connectivity turned off. Brightness figures may describe a small portion of the display rather than the whole screen. There is nothing wrong with controlled numbers, but they need context.

My repeatable product testing records both a controlled result and a practical result. A tablet might play locally stored video for a clean comparison, then handle email, browsing, streaming, and a video call across several days. A smartwatch might show excellent advertised battery life with the display mostly asleep, yet lose power quickly when location tracking and workouts are active. Readers deserve both numbers.

I also repeat tests when a result looks strange. If one pair of headphones suddenly reports unusually low latency, I check the connection, reset the device, and run the sequence again. Latency is the delay between an action and the sound or image response. A single odd measurement is a clue, not a conclusion.

How I Test Devices in Real Homes

The lab bench tells me what a product can do. Daily use tells me whether it is worth owning. I carry phones for at least two weeks before reaching a conclusion, and longer when a software update, battery behavior, or durability question needs more time. I take calls while walking, photograph moving children, use navigation in a car, and charge the device with the accessories people are likely to own.

That routine exposes problems that launch-day reviews miss. A phone can feel fast during an afternoon but develop aggressive background-app restrictions after several days. Earbuds can pair instantly at first and then struggle when switching between a laptop and a phone. A smartwatch can track one workout well but lose its fit during repeated sweat and movement.

At home, my family supplies the unplanned portion of the test. A tablet gets handled by Aaron and Lucy, not because children are destructive test instruments, but because real owners tap quickly, leave apps open, forget to charge, and occasionally drop hardware. I do not stage every mishap. I document what happens, then repeat the relevant function afterward to see whether the failure is cosmetic or meaningful.

Visual context for repeatable product testing

Repeatable Product Testing for Battery, Heat, and Durability

Battery testing needs patience. I begin with a full charge and record when the device reaches several checkpoints, such as 75 percent, 50 percent, and 20 percent. I note cellular signal, screen-on time, camera use, gaming, calls, and overnight drain. This creates a useful pattern instead of one dramatic percentage captured at an arbitrary moment.

Heat gets measured by touch only as an initial warning; a device feeling warm is not a precise temperature reading. I use an infrared thermometer for comparison and repeat the same workload. A short burst of heat during fast charging is different from a phone becoming uncomfortable during a 20-minute video call. Both observations belong in the review, but they answer different questions.

I do not deliberately destroy review units for entertainment. Instead, I inspect ports, hinges, buttons, screens, earbud cases, and watch bands after normal handling. If a product has a published water-resistance rating, I explain what that rating means without treating it as permission for careless use. Water resistance is not permanent waterproofing, and seals can weaken after impact or repair.

How I Turn Results Into Buying Advice

Numbers are useful only when they change a decision. If two phones finish a battery test within a small margin, I look at charging speed, camera consistency, software support, repair options, and price. If one phone costs $1,000 and another costs $650, the expensive model needs a clear advantage rather than a prettier specification sheet.

My repeatable product testing also includes failure notes. I record dropped connections, missed notifications, uncomfortable hardware, slow updates, confusing settings, and accessories that cost extra. A product does not receive a recommendation merely because it has a strong processor or a high-resolution camera. The question is whether its strengths survive ordinary use.

When possible, I revisit products after 30 and 90 days. That is when battery capacity, scratches, app support, and daily friction become easier to judge. Some devices improve through updates. Others reveal shortcuts that were invisible during the first week. A review that changes after longer use is not inconsistent; it is better informed.

A Simple Method You Can Use at Home

You can practice repeatable product testing before buying your next device. Choose three tasks you actually perform, such as streaming video, taking photos, making calls, or tracking a workout. Keep the settings consistent, record start and end times, and test each competing product under similar conditions.

Next, write down annoyances instead of trusting memory. Did the phone overheat in the car? Did the earbuds lose connection through one wall? Did the tablet charge slowly with your existing power adapter? Give each issue a practical cost in time, comfort, or money. A small inconvenience repeated every day can matter more than a benchmark advantage you never notice.

That is the standard I bring to every review. I am not trying to reward the loudest launch presentation. I am trying to show what happens after the packaging is gone, the excitement fades, and the device has to earn its place in your routine. I tested it. Here is what actually happened.

Last revised · 2026-09-14 13:01
Letters
Readers Write

No letters yet — be the first to write.

Write a letter