History

CheckMate 1.3.1

Hotfix

• Report export: exporting a Concise or Detailed report saves the report again, instead of a squashed copy of the dashboard.

CheckMate 1.3.0

Highlights

Case groups

Organise test cases and regression cases into named groups.

• Regression groups: every project's regression suite is now organised into groups. Your existing regression cases move into a group called General.
• Test case groups: turn on Use Test Case Groups on a phase's General tab to group that phase's test cases too. Turning it off flattens them back into one list.
• Numbering: grouped cases are numbered by group and position, e.g. 1.1, 1.2, 2.1.
• Managing groups:
  • Add a group with its first case.
  • Rename a group by clicking its title.
  • Drag groups, or drag cases between groups.
  • Delete a test case group, or archive a regression group. Archiving also archives the group's cases.
• Saving: group changes wait for Save, like every other edit, so you can make them all at once and save or cancel them together.
• Duplicate titles: regression case titles only need to be unique within their group, and capitals count, so "Login" and "login" can both exist. Group names follow the same rule. A duplicate is flagged in red under the newer case as soon as you leave the title.
• Add To Regression: on a completed phase, choose an existing group or create a new one when you add a case to the regression suite.
• Completed phases: they keep the regression cases, numbers and group names they were tested with, even if the project's suite changes later.

Full editing on active phases

Active phases now have full editing support, from an Edit button on both the Test Cases and Regression tabs. Nothing changes until you press Save.

• Test cases: add, rename and reorder groups and cases, and move cases between groups. Testers keep their results.
• Regression: switch regression cases on or off, one at a time or a whole group at once.
• Results: switching a regression case off permanently deletes its results and evidence for that phase. The save confirmation warns you first.
• Tidy lists: outside edit mode, switched-off cases and groups are hidden, and the remaining cases are renumbered with no gaps.

Deleting test cases and groups is still limited to draft phases.

Layout setting

Choose how lists look under Settings → Appearance → Layout:

• Standard: the current look.
• Slim: thinner rows that fit more on screen.
• Compact: project phases become squares, and a phase's test cases become a map of numbered tiles coloured by result. Hover a tile to see its title.

A live preview shows each option before you pick it. Your choice is saved on this device. It also applies to the case and group editing screens, where Compact uses the Slim look.

Chess-themed leaderboard

• Podium: 1st, 2nd and 3rd are a gold king, silver queen and bronze bishop, with each person's picture and score. They drop into place, with laurel wreaths that fade in as they land.
• Rankings: one Rankings panel with Score and Streaks tabs. Positions below the podium are a knight, a rook, then pawns.
• Streaks: a knight that freezes or catches fire depending on how long the streak has run, from Frozen (0 days) to Burning (4+ days).
• King Mate: Best Mate is now King Mate of the Month. The King Mate gets a gold ring around their picture in tester and member lists.
• Dashboard: the dashboard's leaderboard card and Login Streak header use the same chess pieces and streak knight.

New profile picture picker

• Photo: upload one by clicking or dragging it in, then reposition and zoom it.
• Chess avatar: pick a king, queen, bishop, knight, rook or pawn on one of eight colours, or choose a custom colour.
• Previews: see how your picture looks in the sidebar, the leaderboard and the testers stack.
• Removing a picture: use the × in the corner. Nothing changes until you press Save.

Improvements

• Editing titles: case, group, project and phase titles all work the same way. Click to edit, press Enter to save or Escape to undo, and hover to see an outline.
• Keyboard:
  • Tab now also moves through group titles, the Add Group form and the Save and Cancel buttons, and wraps round at the ends.
  • Add Group puts the cursor straight in the group name.
• Testing page: grouped cases show their group above the title, e.g. "1.1 - Castle kingside".
• Managing a phase:
  • Blocked cases are tinted orange, the way failed cases are red.
• Project cards: active projects show a pulsing red CheckMate knight, and inactive ones a faint knight in the project's colour. On the dashboard, an ● ACTIVE tab is shaped into the card's border so long names are never hidden. Sidebar phase cards get a faint knight too.
• Project colour: the colour preview shows the knight in your chosen colour, and its light and dark previews switch independently.
• Focus mode:
  • Animates in and out smoothly, with a softer glow.
  • Its buttons sit beside the arrows instead of taking up their own row.
  • The feedback column keeps its width.

Requirements

• macOS: CheckMate now needs macOS 13 Ventura or later.
• Windows: CheckMate is now 64-bit only.

For AI agents (MCP)

• Group tools: new tools to create, rename, reorder and remove test case and regression groups (regression groups are archived), and to switch regression groups on or off for a phase.
• Adding cases: add_test_cases and create_regression_cases can add cases into a group, and promote_case_to_regression can promote a case into an existing or new group.
• Case listings: they now return each case's group name and number.
• Switching off: turning a regression case or group off on an active phase deletes its results, the same as in the app.

CheckMate 1.2.0

Highlights

Focus mode

Press Ctrl/Cmd+Shift+F on the testing page, or use the new focus button, to hide the sidebar and frame the window in a soft glow in the project's colour. The feedback column keeps a comfortable width at any window size. The shortcut is listed in Testing Tips.

Redesigned testing page

• Instructions and success criteria now share one card, and feedback and evidence have their own card beside it.
• The header shows a progress bar with how many cases you've done, e.g. 4/12.

Full Markdown support

Setup instructions, test cases and results now render full Markdown:

• tables, strikethrough and highlights;
• headings, lists and images;
• code blocks with syntax highlighting.

Blocked results

When a case can't be tested, for example because an earlier case failed, testers can now mark it Blocked alongside Pass and Fail.

• The testing buttons are now Skip · Fail · Block · Pass, and Ctrl/Cmd+B submits Block.
• Blocked cases count towards a tester's progress but are left out of success rates and charts.
• Blocked cases are sent out again on redeploy, just like failures. A comment is optional.
• Blocked results have their own amber styling across case cards, member cards, progress bars and reports. There's also a new Blocked filter on the Test Cases tab.
• Project managers get a new Test blocked email. It's controlled by the existing Test failures notification setting.

Edit active phases

Project managers can now change a phase while it's being tested:

• Edit setup instructions, and any case's title, instructions or success criteria. Existing results are kept.
• Add and reorder test cases. New cases join the current round, and testers get a New test cases email.
• Add testers.
• Move the end date.
• Turn regression tests on or off. Turning them off removes the regression cases and their results, after a confirmation.

Deleting cases, removing testers and changing the start date are still limited to draft phases.

Choose what gets redeployed

Redeploy Testing Phase is now always available to managers on active phases, and it opens a new picker:

• Failed and blocked cases, plus all regression cases, are always included.
• You can tick any other case to send it out again, for example after editing it.
• Cases you ticked are marked Manually redeployed in the progress viewer and the report.

Search completed phases

The Completed section on the project page can now be filtered:

• By title: type part of a phase's name.
• By date: pick the range the phase was completed in.

The date picker also has new month and year views. Click the month heading to jump to another month, then the year heading to jump to another year.

Project colour preview

Clicking a project's colour swatch now opens a preview. It has a colour picker and shows a project card, phase row, progress bar, button and toggle in both light and dark mode, so you can check the colour before you save.

Improvements

• Weekly stats: charts and stats are now grouped by week instead of month. Weeks start on Monday, including on the login streak calendar.
• Onboarding: you can log out during onboarding.
• Project page: the chart now shows Total tests and Success rate below it.
• Charts: a chart with a single week of data gets a blank week before it, so it no longer shows a lone bar.
• Active phases: the status bubble shows the current iteration, e.g. "Active - Iteration 2".
• Settings: the organisation members list shows every member's email.
• Test case editor: Tab and Shift+Tab now move through title → instructions → success criteria → next case, and a new case opens with its title focused.
• Tester's phase page: case titles line up evenly next to their numbers.
• Reconnecting: after a lost connection you return to the page you were on, not the dashboard.

Fixes

• Scrollbars on macOS: scrollbars are shown and take up their own space again, so content no longer jumps.
• Onboarding: name fields no longer overflow off the right of the screen.
• Your phase progress: the progress bar no longer spills out of its card.
• Windows:
  • Refreshing the app works again.
  • Sharper navigation icons.
  • Developer tools open again with Ctrl+Shift+I or F12.
• Leaderboard: removed the coloured strip on top of the podium.
• Storage: evidence files are now deleted from storage when their results are removed.

For AI agents (MCP)

• Results now report an outcome of passed, failed or blocked. get_phase_results can filter by outcome: "blocked".
• reissue_phase accepts additionalTestCaseIds to redeploy extra cases.
• delete_test_case only works on draft phases.

CheckMate v1.1.0

AI agents

Connect an AI assistant to CheckMate and let it do the tedious parts — drafting test cases, setting up a phase, telling you what failed. It acts as you, with exactly your permissions, and never more.

• New AI Agents section in Settings. Agents are off until you turn them on, behind a warning that sets out whose responsibility their actions are.
• Advanced permissions lets you choose precisely what an agent may read, change and delete, area by area. Nothing is granted by default, and no preset grants delete.
• Disconnect all agents cuts off every agent connected to your account, immediately.
• Agents can never submit test results, manage your organisation, or change these settings.
• Full guide here.

Invites

• Pending invites now have a Resend invite action in the member menu, for when an email bounces or goes missing.

LAUNCH 🥳🎉

• Finally 🫠
• Added custom icon for windows
• Active phases are now properly ordered by due date
• Active phases have custom messaging for phases that are overdue or haven't officially started yet

• Fixed windows auto update issues

• Reworked the redeploy for testing phases
  • Was a bit jank before
  • Now correctly updates history and leaves non-failed cases alone
  • Redeploys all of regression regardless due to the nature of those cases
• Cancelling a phase after redeploying would keep it in the same iteration
• Added functionality for creating test cases with only the keyboard
• Non project manager users can now view the testing results of all completed testing phases in a project and download reports
• Switched project page testing phase cards to show personal progress, not global
• Fixed an issue where best mate was being correctly identified when the organisation was less than a month old
• Fixed an issue where organisations more than a month old would not actually show the previous month name for the best mate

• Fixed windows specific styling issues
  • Navbar icons were pixelated
  • Windows native menu bar was added to the top of the app, now removed
• Terms & Conditions + Privacy Policy
  • Added to the app and login page
  • Must be accepted by users when onboarding
• Custom error message is successfully signing up to Auth0 while the API is down
• Redesigned certain components in the app for better user experience and ✨Personality✨
• Dashboard project card titles would scale too much on larger screens, overlapping the active blinker

• Fixed an issue where the Cloudflared connection may drop out for a split second and cause the app to hit a reconnect page

• Same as v0.6.0
• For testing the auto update, when in doubt test in prod 🤷

• Now has auto updating for new versions

• Mac Signing
• Images are cached better, only recached on image uploads
• Email verification is also required for new users, before only invited users were blocked

Mac Soft Launch!

• Bugs 📉 Serotonin 📈
• Fixed styling issues with org members list
• Pending invites now show the user's email that the invite was sent to
• New onboarding experience that allows you to check your email is verified and resend verification email
• Deep linking support to open the app from external sources
• Untested on Windows!

There were indeed bugs :(

• Skeleton shimmer added to images as they sometimes take a bit to fully render
• Users are now informed that they must verify their email before completing sign up, before it would simply error with no information
• Org members are instantly added to the list when invited, before needed a refresh of the page

• Preliminary Release
• Connects to hosted API
• Has Application Insights
• Blood sacrifices were made
• Will still have bugs :(

Draft Release to test:

• The Release Pipeline
• Linking to the showcase website