BrightSign Exec Argues Signage Benchmarks Miss What Matters: Reliability
2026-10-21 · via BrightSign
Aaron Rollins, BrightSign's vice president of product management and customer experience, has published a blog post arguing that content-performance benchmarks, the kind vendors periodically run to show their hardware can decode more video streams or run heavier web content, are the wrong way to judge a digital signage platform. The piece lands as another round of third-party content tests has circulated in the industry, and it is worth reading as a vendor's attempt to reframe how buyers should evaluate players rather than as neutral analysis.
Rollins' argument is that raw decode and playback performance stopped being the deciding factor for most buyers years ago, because each new generation of hardware is faster than the last regardless of vendor. What a spec sheet or a content test cannot show, he writes, is what happens in year three of a deployment, when a browser engine is several versions behind and a security team wants answers, or at 2 a.m. when a power outage takes down dozens of locations with no one on site to intervene.
He draws a distinction between software layers that sit on top of a device, which can make different hardware look uniform for content purposes but cannot patch the underlying OS, upgrade Chromium or Node versions, or recover a device that hangs below the application layer, and companies that own the full operating system stack and can therefore commit to fixing those problems. BrightSign, which builds its own BrightSignOS, is positioned in the piece as an example of the latter, citing what it describes as a commitment to more than five years of OS and security updates.
Rollins cites research BrightSign commissioned, through VDC Research, to back several claims: that dedicated signage players often stay in service eight to ten years versus five to seven for integrated displays, and that in a survey of signage buyers reliability and uptime scored 4.7 out of 5 in driving platform choice, ahead of performance at 4.4. The announcement does not provide the sample size or methodology behind that survey, and readers should treat the figures as BrightSign-sponsored research rather than independent data.
For operators, the practical takeaway is less about BrightSign specifically and more about the evaluation questions Rollins lists: how many years of OS and security updates a vendor commits to and who actually delivers them, whether a hardware failure means replacing a component or an entire integrated display, whether a fleet can be monitored and recovered remotely without a truck roll, and whether the platform has headroom for features like edge AI that may be demanded in a few years. None of this is new advice, but it is a useful checklist to bring into any RFP conversation, regardless of which vendor is pitching.
The announcement in full
Reproduced from BrightSign for reference. Digital Signage Magazine did not write the text below.
By Aaron Rollins Vice President, Product Management & Customer Experience, BrightSign
By Aaron Rollins Vice President, Product Management & Customer Experience, BrightSign
Performance Alone Doesn’t Translate to Success in Digital Signage
The real test of a digital signage platform plays out over the long term.
Every so often, someone runs a new round of content tests across digital signage platforms, and every time the results look promising. That shouldn’t surprise anyone. Each hardware generation is faster than the last, and if a device can’t handle your content today, next year’s probably will. However, performance alone is not an accurate measure of success in digital signage.
At BrightSign, we’ve believed this for a long time, and the latest round of testing hasn’t changed our minds. It’s good that more hardware can play more content. But a content test answers a question most signage buyers stopped worrying about years ago.
What you can’t buy off a spec sheet is what it’s like to install, manage, and maintain a signage network. Think about year three, when the browser engine on your screens is two major versions behind, and your security team wants to know why. Or think about 2 a.m., when a power blip takes down forty stores and nobody is on site. That’s where a signage network really proves itself, and no content test measures it.
A software layer can make different hardware look the same for your content, and if you run a mixed fleet, that helps. But it can’t upgrade the Chromium or Node version underneath it, ship an OS security patch, or recover a device that has hung below the application. Those things belong to whoever owns the operating system.
So, when you look at a platform, ask who owns the parts that will need fixing in year three, and whether they can fix them. If the answer is a display manufacturer focused on next year’s model, or a vendor who can only reach the app layer, you’re living on someone else’s roadmap.
Buyers know that content benchmarks alone can’t measure true success in digital signage. When signage buyers were asked what drives their choice of platform, reliability and uptime came first (4.7 out of 5), ahead of performance (4.4). 1 Operators measure a network’s success in years. Here’s what we think those years come down to:
Keeping every screen on and showing the right thing. A dark screen scores zero on every benchmark, and uptime starts at the bottom of the stack: an operating system built only for signage, fault detection and recovery that happen without anyone on site, automatic restart after a power outage, and burn-in testing before a player ever ships. One operations leader told us general-purpose equipment in this environment usually fails within two to three years, but their purpose-built players were still running after more than four.
Staying current and secure for years. A fast device that’s two years behind on patches is a liability. What matters is how long OS and security updates keep coming, and who delivers them. We build BrightSignOS™ ourselves, from the bottom up, which is why we can commit to 5+ years of OS support and the Chromium, runtime, and security updates that come with it.
Performing at fleet scale, not just on one screen. A benchmark tests one device under controlled conditions. Your network has thousands of screens in hundreds of locations. Performance that matters means pushing content or a firmware update to every screen at once, quickly seeing which ones didn’t take it, and fixing them without a truck roll.
Lasting longer and costing less to own. When the player and the display are separate, a failure or an upgrade means replacing one component. When they’re integrated, it often means replacing the whole display. Research we commissioned found dedicated signage players often stay in service eight to ten years, while integrated displays frequently need full replacement every five to seven. 1
Growing in capability for as long as you own it. What you ask of signage keeps growing, with more interactivity, synchronized video walls, and now AI at the edge . Hardware headroom helps with that. What matters more is whether the platform keeps adding capability through software for as long as you own it.
Benchmarks are useful. They tell you what a device can do on day one, but they can’t tell you whether the platform can support your network for years to come. Before you sign off on a deployment, add these questions to your evaluation:
How many years of OS and security updates are committed, and who delivers them?
What happens when a device fails: do you replace a component or the whole display?
Can you monitor, update, and recover your entire fleet remotely, without a site visit?
Does the platform work with your CMS and your displays today, and with whatever you choose next?
Will the hardware handle what you’ll ask for in three years, including AI at the edge?
A device that passes every test on install day has earned a spot on the shortlist. A platform that’s still performing, secure, and supported years later has succeeded.
We build signage players and software, so these are questions we think about every day. If you’re working through them for your own network, we’re always glad to compare notes.
Based upon research conducted with 3rd party experts by VDC Research