It’s much more important that you have something that works for most users than trying to figure out what works for all users.
It can certainly get very dodgy. In the native Qt apps I write, the mouse wheel comes in as an event with the mouse button equal to 4 or 5 for the wheel (or maybe it was 8 or 9?). Maybe that is Qt making it easier on me, IDK.
This is where a good issue/feature tracker can help. Just put it on a/z and make an issue. Then clear your mind. When you’re later trying to procrastinate doing something harder, you can circle back and attack easy issues like this one.