Another thing users have trouble with is using the mouse. Even if they are adept mousers, using the mouse precisely can be difficult.
User Interface Design for Programmers 7 talks about how to smooth out some of the hard edges of your program, by thinking about the dexterity it takes to use the mouse in UI.