Tracking list of manual smoke tests before each release

[jessfraz]

Manual Tasks

Beta Give feedback

1. Electron tests: external links open an external browser #3373
   desktop-app tests +2
2. coredump will open github issue with stuff populated (from home and project page) there are different ways to trigger it as well (! button at top, bug at bottom, mod + shift + .)
3. running app.{app,exe} path/to/file opens the kcl file (all oses)
4. running app.{app,exe} path/to/dir opens the directory and any kcl file in it or creates a main.kcl if empty (all oses)
5. If someone at the office, test you can hit make from the app and it works
6. Test updating versions works
7. until we have a performance test, sanity check that time to open file directly from command line is not shit
8. Electron tests: ensure we can open files that in tauri we would not be able to #3455
   desktop-app tests +2
9. Electron test: upgrading app should not cause user to have to auth again #3469
   desktop-app tests +2
10. Electron: logging in and authing works #3465
    desktop-app tests +2
11. double click to open files from finder opens new window each time (mac/windows)
12. export from the app works and opens a file picker ux (needs to be manual since we override for playwright)

also relevant #3459

[lf94]

Can we put a process in place?

[lf94]

I was thinking maybe a spreadsheet with screenshot links that prove we have done the tests manually.

[jessfraz]

this is it haha, smoke test these for each os :)

[jessfraz]

oh that seems like a lot of work, I trust you all to actually do the thing, versus wasting time dealing w excel

[lf94]

We can save time by partitioning the tests amongst ourselves using a doc tho

[jessfraz]

fair fair set up whatever process you want :)

[franknoirot]

Maybe we auto-make a tasklist on "Cut release vXX.YY.ZZ" PRs