Keep this checklist in its own tab. That is fine. It lives on newbycode.com, a different website from the app, so it does not touch the app's sign-in, its saved data or the iPhone's one-week clock.
Using this tab while you test
- Every tap saves straight away, in this browser. Phones close background tabs to save memory, and this tab will sometimes reload when you come back. Nothing is lost when it does.
- Send your results after every session. Ticks stay on this phone and nobody else sees them. Tap Email results to Eric, at the top of the page or on Overview. It opens your mail app with your results filled in. Safari also clears websites it has not seen in a week, so do not leave results sitting here.
- Open this checklist in a normal tab, never a private one. A private tab forgets everything when it closes.
- Never open the app from this page. Several tests depend on how the app was opened: typed, scanned, or from the home screen. Addresses here are text to copy, not links. Type or paste them yourself.
- Run app tests in a private tab when a test says to start clean, and keep this checklist in a normal tab. They do not share anything.
- Screen reader tests (J1, J2): switching tabs with VoiceOver or TalkBack on is awkward. Finish the run first, then turn the screen reader off and record the result.
- Two-week tests (L1 to L3): opening this checklist on the test phone is fine. Opening friendsofcjsr.com or the installed app is not, until the read day.
- On an older or budget phone, keep this checklist on a laptop if you can. A low-memory phone juggling two heavy pages can reload the app behind your back, which looks like a bug in tests D15 and F2.
Before a session
- Where: scanning tests use friendsofcjsr.com, because that is what the counter codes point to. Testing a new change happens on staging.friendsofcjsr.com first. Both use the same live data.
- Use a test account, not your own membership. Limited-offer tests use up that offer for the card year, and H5 deletes the account. Eric has test accounts.
- Every scan counts as a real visit on the station's dashboard. Write the time in the notes of each scan test so the visit can be identified later.
- Cards for 2025/26 stop working after 31 October. Test after that only with a 2026/27 test account.
- Counter codes: use the printed pilot codes. You need one with an unlimited offer and one with a limited offer (once a year or once a day). D10 needs one that Eric has switched off.
- If something fails, try it again in a private tab before recording a Fail. An old saved copy of the app looks exactly like a real bug. Then note the exact address and what was on screen just before.
- Record your phone once under Run tests, Add a phone. Use one entry per phone and browser you test in.
The full plan, with the reasons behind each test, is docs/DEVICE-TEST-PLAN.md in the project.