Skip to main content

๐ŸŽฏBlog # 24: Playwright Reporters Demystified: Know What Your Tests Are Saying

Whether you're running a handful of tests or scaling up to hundreds, knowing what happened, where it failed, and how to debug it fast is crucial. That’s where Playwright reporters become your best friends.

In this blog, I’ll take you on a tour of Playwright’s built-in reporters, show you sample test scripts, and (yes!) include screenshots of each report in action so you can see the difference.

๐Ÿง  What Are Reporters?

Reporters are like your test suite's storytellers. After executing your tests, they summarize the results—either in your terminal or in beautiful visual formats. Think of them as:

  • Terminal dashboards 
  • Structured outputs for CI/CD
  • Visual tools for debugging
  • Data sources for analytics

๐Ÿงช Sample Test File

Here’s the test script I’m using for this blog. Each test is designed to showcase one type of reporter:

const { test, expect } = require('@playwright/test');

test('List reporter example (updated)', async ({ page }) => {
    await page.goto('https://www.iana.org');
    await expect(page).toHaveTitle(/Internet Assigned Numbers Authority/);
});

test('Dot reporter example', async ({ page }) => {
    await page.goto('https://playwright.dev');
    await expect(page).toHaveTitle(/Playwright/);
});

test('HTML reporter example', async ({ page }) => {
    await page.goto('https://github.com');
    await expect(page).toHaveTitle(/GitHub/);
});

test('JSON reporter example', async ({ page }) => {
    await page.goto('https://www.wikipedia.org');
    await expect(page).toHaveTitle(/Wikipedia/);
});

Let’s explore how each reporter works—and what the output looks like ๐Ÿ‘‡

๐Ÿ“œ 1. List Reporter

npx playwright test --reporter=list

๐Ÿงพ Output: A clean list of each test with its status and time taken.




✅ Great for local debugging and readable summaries.

⚫ 2. Dot Reporter

Each dot represents a test, and failed tests show as F.

npx playwright test --reporter=dot


⚡ Fast, minimal, perfect for CI terminals or massive test suites.

๐Ÿ“ˆ 3. Line Reporter

npx playwright test --reporter=line

It shows real-time updates of tests as they run—visually pleasing and useful in CI logs.

๐ŸŒ 4. HTML Reporter

npx playwright test --reporter=html

npx playwright show-report

๐Ÿ“Š A beautiful, clickable HTML report showing:

  • Test names, status, duration
  • Ability to view traces and errors
  • Great for debugging failed tests

๐ŸŽฏ Ideal for team collaboration or sharing detailed results with stakeholders.

๐Ÿงพ 5. JSON Reporter

npx playwright test --reporter=json

๐Ÿ“„ Output: A structured json file with full test metadata.

๐Ÿ“Œ To specify file location, use config like:

reporter: [['json', { outputFile: 'results/report.json' }]]

๐Ÿ’ก Use this to:

  • Build custom dashboards
  • Feed test data into analytics tools
  • Automate monitoring/reporting

๐Ÿงช 6. JUnit Reporter

npx playwright test --reporter=junit

๐Ÿ—‚️ Produces an XML file compatible with tools like Jenkins, CircleCI, and GitLab CI.

๐Ÿ“Œ To specify output file:

reporter: [['junit', { outputFile: 'results/junit-results.xml' }]]

✅ Best for CI/CD integrations that expect standardized XML format.

⚙️ Configuring Reporters in playwright.config.js

Instead of passing reporters via CLI each time, you can configure them once in your playwright.config.js file:

import { defineConfig } from '@playwright/test';
export default defineConfig({
  reporter: [
    ['list'],
    ['html'],
    ['json', { outputFile: 'results/report.json' }],
    ['junit', { outputFile: 'results/junit-results.xml' }]
  ]
});

Now just run:

npx playwright test

๐Ÿ’ก Your test run will generate all configured reports in one go!

✅ Final Thoughts

Choosing the right reporter isn’t just about pretty output—it’s about clarity, debuggability, and team collaboration.

  • ๐Ÿš€ Start with html for local devs
  • ⚙️ Use junit or json in CI
  • ๐Ÿ” Combine reporters for the best of all worlds


Let me know which reporter is your favorite—or if you’ve used these in creative ways.

Thanks for reading and happy testing with Playwright! ๐Ÿ’œ๐ŸŽญ

Comments

Popular posts from this blog

Blog # 9: Say Hello to Alerts! Handling Dialog Boxes in Playwright

Alerts and dialogs are common elements in web applications that can interrupt automated test flows if not handled properly. Playwright provides straightforward methods to manage these interruptions, ensuring your tests run smoothly. In this guide, I’ll share how I learned handling three types of dialogs—simple alerts, confirmation boxes, and prompts—using Playwright’s built-in features. Why Handle Dialogs? Dialogs often appear during critical user interactions, such as form submissions, error notifications, or data input requests. If ignored, they can cause tests to freeze or fail. Playwright’s dialog-handling capabilities allow you to: Validate dialog messages. Accept, dismiss, or respond to prompts programmatically. Keep tests resilient and predictable. Let’s explore how to tackle each type of dialog. 1.  Simple Alerts: The One-Way Notification A simple alert is a basic pop-up with an "OK" button. Example Scenario : A basic alert appears, shouting, "I am an alert box!...

Blog # 20 :๐ŸŽช Playwright Hooks: Your Test Suite’s Best Friends!

๐ŸŽฉ Why Hooks? The Magic Behind the Scenes When writing automated tests, especially for web applications, repetitive tasks like logging in before each test or cleaning up after the test run can quickly clutter your code. If you've found yourself copying the same setup code into multiple tests, you're not alone! Luckily, Playwright offers a powerful feature to solve this — hooks . Imagine you’re hosting a party ๐Ÿฅณ. You wouldn’t clean the house after every guest leaves, right? Instead, you’d: ๐Ÿ—️  Setup once (decorate, cook food) → beforeAll ๐Ÿ—‘️ Clean as you go (refill snacks, wipe spills) → beforeEach/afterEach ๐Ÿ’ฃNuclear cleanup after everyone leaves → afterAll In testing terms: Hooks automate repetitive tasks so your tests can focus on what matters. ๐Ÿ”ฎ Meet the 4 Hooks ๐Ÿš€ Your Code in Action: Login/Logout Flow Let’s automate a shopping site test (your code!). Step 1: beforeEach – The “Welcome Mat” Why it rocks: Every test starts fresh, logged in, and cookie-free! test. beforeEa...

Software Testing Heuristics and mnemonics.

Software Testing Heuristics Heuristics are simply experience-based techniques for problem-solving, learning, and discovery. Where an exhaustive search is impractical, heuristic methods are used to speed up the process of finding a satisfactory solution. Examples of this method include using a rule of thumb, an educated guess, an intuitive judgment, or common sense. When you face a problem, you try some solutions that may work. For instance, if you suddenly find your mobile hang, what do you do? You may restart your mobile first. If that doesn’t work, then you may check & update the latest software and uninstall suspicious apps.if that also doesn’t work, then you reset your phone setting ( Factory reset). Most of us try a number of steps to solve our problems. These steps may not always work but we try them because we know that they may work. Following heuristics can apply to absolutely any kind of system with any kind of interface.  1.Abstract  Remove details in a model. S...

Blog # 4 : A Deep Dive into Playwright Assertions

  Ever spent hours debugging a test only to realize you forgot to check if a button was actually clickable? In web testing, the devil's in the details—and that's where assertions become your best friend. Let's explore how Playwright's assertion library can transform your testing strategy, using the popular The Internet testing playground. Why Assertions Matter Assertions are the backbone of any meaningful test. They're the checkpoints that scream, "This works!" or "Something's broken here!" Playwright's built-in expect library shines when testing real-world scenarios like authentication flows and dynamic content. Let's Start Testing: A Real-World Scenario We'll be testing key features of The Internet playground. Here's our foundation: Now let's add powerful assertions. Validating Content: Is What You See What You Get? 1. Page Titles: Your First Line of Defense Verify you're on the correct page immediately after na...

Day 15 Name five different online payment methods.

Most modern online payment services offer easy-to-use, fast and secure ways to pay Here’s a list of some of the most popular online payment services: Digital Wallet ( E wallet) A digital wallet refers to software, an electronic device, or an online service that enables individuals or businesses to make transactions electronically. It stores the payment information of users for different payment modes on various websites.                           PayPal PayPal is one of the most dominant payment methods available today. over 20 million UK shoppers use PayPal each year in the UK and  7 million businesses worldwide use their platform to accept payments. PayPal is an eCommerce payment processing company that allows users to set up a PayPal account and pay a fee for each cash transaction. Many customers prefer to checkout with PayPal because it’s so simple and quick to use. Amazon Pay Amazon Pay is another ...

Blog # 16: Diving into Screenshots with Playwright — Let’s Get Snapping! ๐Ÿš€

Hi everyone! ๐Ÿ‘‹  I’ve been exploring more of what Playwright has to offer, and I recently discovered an exciting feature—screenshots! Whether you're validating UI elements, documenting test results, or just sprinkling some eye candy into your reports ๐Ÿ˜„, screenshots can truly elevate your testing game. Let me share my recent adventures in capturing various types of screenshots using Playwright! Here’s what I tried out: A quick snapshot of the web page ๐Ÿ–ผ️ A comprehensive full-page capture, scroll and all! ๐Ÿ“œ A focused screenshot of a specific element — like that one product image you love! ๐Ÿ” Let’s dive in! ✨ 1. Quick Page Screenshot const { test, expect } = require ( '@playwright/test' ); test ( 'Save a dated screenshot for future-you' , async ({ page }) => { await page. goto ( 'https://www.demoblaze.com/' ); // Pro move: Use ISO date (no messy slashes!) const today = new Date (). toISOString (). split ( 'T' )[0]; // "2023-09...

✍️ Blog #23: What I Learned About Annotations in Playwright

When I started, I thought writing tests was just about getting them to pass. But as the number of tests grew, I realized that being able to control which ones run, which to skip, and how to debug easily — is just as important. Let me take you through everything I’ve learned so far about Playwright’s annotations. ๐Ÿ” What Are Annotations? Annotations are special helpers in Playwright that let you modify test behavior without changing the actual logic of the test. They're great for: Focusing on a single test ( test.only ) Skipping unfinished or flaky ones ( test.skip ) Flagging tests that need fixing  ( test.fixme ) Allowing known failures  ( test.fail ) Marking slow tests  ( test.slow ) Think of them like post-it notes or switches you can stick on your tests to manage them better during testing. ✅ Test-Level Annotations These annotations go directly on individual tests. ๐Ÿงช test.only – Focus on One Test test. only ( 'run this test only' , async ...