Upcoming accessibility improvements from Apple sound good. A natural use of LLMs. From MacStories:

Rather than requiring a defined set of commands that need to be memorized to control a device, the feature will allow users to invoke actions with natural language, such as, “Tap the orange folder.”