Xa11y – cross-platform desktop automation via accessibility trees

Show HN: Xa11y – cross-platform desktop automation via accessibility trees

Xa11y – cross-platform desktop automation via accessibility trees operates in show hn launch.

Profile

I built xa11y to simplify cross-platform desktop automation.Originally I was interested in using computer use agents to automate testing of desktop applications. The tools I tried gave agents the ability to click a mouse and fed them screenshots, but the agents struggled to use the mouse accurately. A couple projects like OmniParser use specialized screenshot reading models and element labeling instead of pixel coordinates for interactions. But even when they work, they're slow and expensive to run since they rely on models.I then looked at accessibility APIs as a way to read the screen. Initial experiments worked and I found that accessibility APIs are a well-known tool for desktop automati

As a business in show hn launch, Xa11y – cross-platform desktop automation via accessibility trees is listed here with the public details available about it.

The company is listed at the Show HN launch stage of development.

Website: xa11y.dev