incl.ca ranks as most accessible site for accessibility experts

An independent audited ran tests against several websites for accessibility experts and found this site the most accessible

I recently received an email telling me that my website had the least accessibility errors in a pool of dozens of other accessibility experts or firms’ websites. This was interesting. And yet there were several things I disputed.

The test

In “Accessibility guru, heal thy site”, Jonathan Pool describes the tests he ran, and the results. Pool uses a new automated testing suite called “Autotest”. This testing prototype tests for a whole bunch of things that the big accessibility testing tools, such as axe-core, or WAVE , appear not to test.

It tests things such as movement on a page, 3-D layering, deprecated roles, nonstandard navigation, and several other things.

I think this is an interesting approach, but it’s far from ready fror prime time.

Results for incl.ca

The results for my site gave a score of 51, which is apparently the lowest of all the sites Mr. Pool ran for his test. The highest was AccessiBe, with 6615!

Broken things

The tests found a couple things actually broken on the page:

Both of those came from an update to CSS styling that came through via CDN. I did not know it had happened and I had no direct control over it. I fixed it by manually changing the class name. Moral of the story: Don’t rely on 3rd party stuff without regularly checking!

Disputed items

My conclusion

It was interesting to see that my homepage ranked best from dozens of other accessibility experts or accessibility firms. My site also happens to be fairly simple.

It was no surprise to see overlay providers ranking rather low in these tests.

But automated testing will only find some of the errors on a page. And of the errors found, they need to be considered, analyzed, and evaluated. Not all issues automatically found by automated tools are actual problems. Then there’s the bias of the tool maker, weighing different items differently, giving more, or less, importance to results.