#StackBounty: #lyx #texmaker #accessibility What accessibility APIs do different latex editors have including Lyx?

Bounty: 50

I am currently working with a couple others on a system for writing math by voice. An early demo here: https://www.youtube.com/watch?v=z-iHvPmjcas&feature=youtu.be

In order to decide on the best editors to do this in, I want to know what accessibility APIs different latex editors have e.g. Lyx (my favorite), Tex maker, and others. In particular, I’d like to know if any latex editors have the IAccessible2 API, since that is the best one for voice recognition right now https://accessibility.linuxfoundation.org/a11yspecs/ia2/docs/html/

A slightly less preferable API but still potentially good for voice recognition is the Linux AT-SPI API.

That’s pretty much my question so you can stop reading here, but if you’re interested in why why the accessibility API matters here, I explain below.

Dragon (the world’s leading voice recognition software, sold by Nuance) is especially powerful in certain applications – those applications in which Dragon is said to have “full text control” (sometimes also called “Select-and-Say”). Currently, neither Lyx nor Tex maker is one of those applications, but I would like them to be which is the main purpose of this post (see below). Here is a demonstration of me using some of the features made possible by full text control in Microsoft Word, an application in which Dragon does have full text control:
https://www.youtube.com/watch?v=5kyO6KVMbuw&feature=youtu.be

James at handsfreecoding.org has made some progress on extending full text control to more applications. His blog post discusses the issue with far more expertise than I have. (for our purposes here the 2nd half of the the blog post is probably most important): http://handsfreecoding.org/2018/12/27/enhanced-text-manipulation-using-accessibility-apis/

According to the blog post, an important requirement at the moment for making full text control work in an application is that the application in question use the accessibility API called IAccessible2 API.
Linux AT-SPI API may become supported eventually for full text control but this has not happened yet.


Get this bounty!!!

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.