Our work

How Samsung put 42 launch tests live in 22 markets in three days

For the Galaxy S22 launch, we built Testful: test templates Cheil’s marketers set up themselves. What once took three months took three days.

  • 42A/B experiences, live in three days
  • 22Samsung markets
  • 3 daysfor what took three months
What we built
Platforms
Client
Samsung, through Cheil
Moment
Galaxy UNPACKED 2022, pre-order phase

Samsung launches its flagship phones in many markets at once. Cheil runs the testing behind those launches. We’re the build team behind Cheil, and for the S22 we built the product that did the heavy lifting.

The challenge

Good tests keep coming back. A countdown, a comparison, a launch banner. Each one was rebuilt by developers for every market, even when a marketer could have set it up.

A year earlier we had shipped 77 experiments in six months for seven markets. For UNPACKED 2022, Samsung’s marketing team had 42 new tests for 22 markets, and they needed them live for pre-orders.

What we built

Testful. Instead of building each test, we build a template once. Anyone on the marketing team can set it up for their market, with no code.

Four steps: pick a template, adjust it, preview it on the live site, deploy. The preview works in real time, before any testing tool is involved, and tests deploy to whichever testing tool the team already uses.

S22 launch tests, set up and previewed without a developer.
S22 launch tests, set up and previewed without a developer.

How it ran

Testful runs most of the quality checks itself. Updating and checking all 42 tests took a couple of minutes, and marketers no longer waited on developers for every change.

  • Every test rebuilt by hand→One template, set up per market
  • Developers on every change→Marketers make changes themselves
  • Three months to ship→Three days to ship

We stopped building tests and started building the thing that builds them.

Results

All 42 tests went live early in the pre-order phase.

  • 42 A/B experiences across 22 Samsung markets in three days.
  • Three months of work, done in three days.
  • Updates and quality checks in a couple of minutes.
  • Marketers set up and change tests without writing code.
  • A reusable product, ready for the next launch.

More from our work.

Tell us what you want to build.

A 30-minute call with our CTO to explore what we could build or automate for your business.