Hand to Mouth: Assistive Technology

Entries from February 2009

Bypassing text fields in mouseless browsing

February 18, 2009 · Leave a Comment

My list of Vocola commands for Firefox is getting pretty long, so I figure I should start breaking it up. Since a lot of Firefox use with Dragon involves mouseless browsing, I thought it would be a good idea to post specific Vocola commands that allow you to take advantage of more mouseless browsing capabilities than you’d be able to if you were just using Dragon alone.

You may have noticed that if your cursor is in a text box, and you want to say a link, saying “numeral [whatever]” puts those numbers in the text box instead of clicking the link you want. Not terribly helpful. The 1st thing you want to do is go into Tools — Add-ons — Mouseless Browsing (or, if you have your mouseless browsing options in your Tools menu separately, just Tools — Mouseless Browsing — Open Configuration). Then, choose “ID types.” Check the option “use numpad exclusively for mouseless browsing.” As per the description, this allows you to bypass text fields and go directly to the link. For Dragon, however, you need Vocola or another scripting program in order to make use of this feature.

The reason is that Dragon cannot natively press more than one keypad key in succession. You need to make a command that will force Dragon to press only the keypad keys, and in such a way that you can enter multiple digit link numbers. Like so:

0..9..0..9..0..9..09 = {NumKey$1}{NumKey$2}{NumKey$3}{NumKey$4};
0..9 0..9 0..9 = {NumKey$1}{NumKey$2}{NumKey$3};
0..9 0..9 = {NumKey$1}{NumKey$2};
0..9 = {NumKey$1};

So, for example, if I say “2  7  3″ while my blinking cursor is in the text box, Dragon will press those three keys on the keypad as if you had pressed them manually. The focus will now transfer to the link and press it. Perfect. (NOTE: under the mouseless browsing options, make sure the option “execute automatically without pressing enter” is checked.)

Categories: Disability · Technology
Tagged: , , , , , ,

Vocola commands for Foxit Reader

February 18, 2009 · Leave a Comment

These commands work equally in version 2.3 and 3 except for the typewriter command — in version 2.3, the sent key press is {Alt+8}. This is not an exhaustive list of commands; it’s just the ones I use frequently. If there are any discrepancies between the 2 versions that I’ve missed, let me know.

# Voice commands for foxit reader

open doc = {Ctrl+o};
save doc = {Ctrl+s};
print doc = {Ctrl+p};
close tab = {Ctrl+w};
next tab = {Ctrl+Tab};
search for <_anything> = {Ctrl+Shift+f} $1 {Enter};
close search pane = SetMousePosition(1, 1011, 91) ButtonClick();
auto scroll (on | off) = {Ctrl+Shift+h};
typewriter = {Alt+t}{t}{Enter};
font menu = SetMousePosition(1, 112, 94) ButtonClick();
change font size = SetMousePosition(1, 241, 94) ButtonClick();
notes = {Alt+t}{c}{n};
text view (on | off) = {Alt+9};
choose text = {Alt+6};
highlight text = {Alt+t}{c}{h};
Zoom in = {Alt+5};
Zoom out = {Alt+4};
hand = {Alt+3};
jump to page 1..100 = {Ctrl+Shift+n} $1 {Enter};
Zoom to = {Ctrl+m};

Categories: Disability · Technology
Tagged: , , , , ,

Let me rephrase that: mouseless browsing and Dragon

February 12, 2009 · Leave a Comment

I was muttering to myself (and my computer) all morning about what I thought was a bug in mouseless browsing in Firefox 3, or Dragon 10, or all of these (considering Dragon’s rickety built-in support for things like this). See, my habitual phrase for accessing anything numbered is “numeral [whatever]“. This worked, until I started trying to select multiple checkboxes in Gmail. The 1st box checked fine. But when I spoke the number for the next box, my previous checkmark was removed. It was driving me nuts.

Finally, I just started running through every possible phrase. Evidently, I wasn’t saying the magic words — if you want to consistently select checkboxes, you have to say “press [number].” If you do it that way, you can check more than one box at a time. I have no idea what the rephrase had to do with it, because as far as I can see they’re just synonyms for the same function. Maybe it is a mild Dragon bug; who knows. Oh well.

Of course Nuance and Mozilla could solve the whole thing by collaborating for better compatibility, but I’ll take this in the meantime. Especially because I downloaded the beta of the latest mouseless browsing version, 0.5.2. It’s really cool — it supports more elements now, like tabs and frames. Dragon can click tabs for you if you say a word in the tab title, but just in case that’s a little dodgy — and it is sometimes, especially if those number flags pop up for duplicate words and Dragon clicks the opposite of your choice — the latest mouseless browsing version provides an alternate way.

Categories: Disability · Technology
Tagged: , , , , ,

Dragon and Firefox 3

February 5, 2009 · 2 Comments

I know I’m late to this post, and you’ve probably already figured out the compatibility issues yourself, but I’ll post it anyway. A few weeks ago, I finally decided to download Firefox 3. I was (mostly) pleasantly surprised with the way it worked with Dragon 10, with the ever present mouseless browsing add-on. (Mr. Noe, you are a genius.) I still wouldn’t try to go without mouseless browsing altogether, because there are numerous actions that cannot be accomplished without it, such as getting into text fields or clicking checkboxes and radio buttons.

The ability to navigate toolbar menus by natural language is much improved for the most part; you can say both main and subheadings, and Dragon will move the mouse cursor to that option and click it. However, between versions 2 and 3, the settings menus under Tools — Options became inaccessible by natural language. [See the Vocola commands I posted to remedy this.]

The good news is that Firefox 3 is wonderfully configurable. Since all of the toolbars are accessible vocally, you can customize the toolbars to give you one word access to favorite websites or features. For example, when you mark a page to the bookmarks toolbar, try to name it a single key word. This does 2 things — allows you to include more bookmarks on the toolbar, and clearly delineates one bookmark from another so that when you say the word, Dragon will only click that bookmark.

Even the navigation toolbar is a boon. You may have read in the Dragon help file that some commands have become longer — e.g. “stop” became “stop loading page,” “reload” became “reload page,” etc. If you’re accustomed to the more terse commands, Firefox lets you keep them. Since the toolbar buttons are labeled “reload” and “stop” and “back” and “forward,” if you say those labels, Dragon will click them, allowing you to forgo the longer commands.

If you right-click the navigation toolbar and say “customize,” you have the option of dragging additional buttons into your toolbar space. Some are default, like Copy and Paste, and some may be associated with add-ons you have installed, e.g. Stylish. I moved Copy, Paste and Print into mine, giving me vocal shortcuts that Dragon hadn’t built in. Stylish allows you to find tweaks to webpages and Firefox itself, so I have that in my toolbar also. That way, if I see a page that’s driving me nuts visually or vocally, I can say “stylish,” then “find styles for this page.” Pretty cool. My favorite style is the one that allows you to permanently turn off Google search suggestions — that stupid drop-down will no longer interfere with your dictation.

Another Firefox extension allows you to choose additional toolbar buttons. I chose the “customize toolbar” button, which lets you bypass right clicking the toolbar, “profile,” which takes you to your userChrome.CSS folder faster than finding it in your documents so that you can paste in some useful snippets, and “about:config,” which takes you to Firefox’s registry editor without having to enter it in the address bar, as well as “Gmail.” There are also buttons for eBay and PayPal, among others.

For me, being a minimalist, one of the best options for customizing the toolbars was being able to show text-only, no icons. This accomplishes 2 things: it uses up less space than text and icons both, and allows me to remember exactly what I’ve called my bookmarks. However, as long as you know the labels associated with the different toolbar buttons, you can still access them vocally even if you choose icons only instead.

You might want to make some changes to the address bar. The new auto complete feature makes it a little bit hard to dictate into. If you want to turn the auto complete off altogether, enter about:config into the address bar (or click the toolbar button if you have it. That’s a colon in between, by the way, not a period.) Find the entry browser.url.maxrichresults and right-click it, or highlight it and say “press Shift-F10″ (or “context”, if you have the command for it.) Set the integer to 0.

CSS tweaks are another useful idea. I have used them to shrink my address bar (after getting rid of the Google toolbar) to allow more space for toolbar shortcuts; to get rid of the star; to get rid of the RSS icon; and to get rid of the Edit and Help menus because there are voice commands or buttons for those. Here they are, corresponding to the order in which I’ve mentioned them.

#urlbar, #urlbar-container {min-width: 300px !important;max-width: 300px !important;}
#star-button {display: none !important;}
#feed-button[feeds] { display: none !important; }
#helpMenu, #edit-menu { display: none !important; }

If you need instructions on how to create your userChrome.CSS file:

1. Your userChrome folder (in Windows XP) is located in C:/Documents and Settings/your name/Application Data/Mozilla/Firefox/Profiles.

2. Choose the default profile that comes up when you open that folder. Then open the Chrome folder. There should be a file called userchrome.example.CSS.

3. Open this file, and erase the example paragraph. Paste whatever snippet you want to use.

4.Go to File, then Save As. Name the document userChrome.CSS.
Anytime you want to make a change to how Firefox looks or acts, this will be the file in which you will paste the script.

Despite Nuance’s somewhat spotty built in support for Firefox, which frustrates me — if we can write commands in Vocola, why couldn’t Nuance program the same right into Dragon? — the configuration options available in Firefox 3 make up for it. It’s been a very long time since I’ve used IE, and I don’t see that changing.

Categories: Disability · Technology
Tagged: , , , ,

Vocola commands for Firefox

February 3, 2009 · Leave a Comment

This list is very much a work in progress — Firefox works surprisingly well vocally if you have mouseless browsing installed, and your toolbars are customized the right way. The “click link” command allows you to go without mouseless browsing if you want to, though — for the most part. You can speak any part of the link as long as it’s a pronounceable word. I haven’t figured out the whole text field or button/checkbox thing, except to get the mouse coordinates or count tab keys.

UPDATE: I’ve pared this down to the essentials, to be updated as I find things.

# Voice commands for firefox

Middle click = ButtonClick(4,1);
Enable select say = SetNaturalText(1);
[Click] Link <_anything> = “‘” $1 {Enter};
Organize bookmarks = {Ctrl+Shift+b};
Clear private data = {Ctrl+Shift+Del};
options menu = {Alt+t} Wait(400) {Up} {Enter};

#mouseless browsing

0..9 0..9 0..9 = {NumKey$1}{NumKey$2}{NumKey$3};

0..9 0..9 = {NumKey$1}{NumKey$2};

0..9 = {NumKey$1};

Open 1..1000 new tab = $1{+}{Ctrl+Enter};

(Disable | enable) mouseless browsing = {Alt+NumKey.};

#autoscrolling (bookmarklet)

Stop scrolling = {Esc};

Scroll faster = {Ctrl+Shift+NumKey+};

Scroll slower = {Ctrl+Shift+NumKey-};

Categories: Disability · Technology
Tagged: , , , , , ,

Vocola commands for Media Player 10

February 2, 2009 · Leave a Comment

Here are my commands for Windows Media Player (version 10). If you want to use the captioning command, you have to wait until a couple seconds after the movie actually begins to play. If you want to, you could make the “eject” command global so that it would open the drive whenever you wanted.

# Voice commands for wmplayer

Eject = {Ctrl+e};
Stop = {Ctrl+s};
Fast-forward = {Ctrl+Shift+f};
Rewind = {Ctrl+Shift+b};
Pause = {Ctrl+p};
Play = {Ctrl+p};
Captions = {Alt+p}{b}{e};
Burn = {Alt+b};
Full-screen = {Alt+Enter};

Categories: Disability · Technology
Tagged: , , , ,

Vocola commands for Jarte Plus

February 2, 2009 · Leave a Comment

So far, here are my Vocola commands for Jarte Plus. You need to have the find bar showing for the find-and-format commands. If you want to search backwards, you’ll need to click the backwards arrow on the find bar. (By default, Jarte searches from the top down.) I do that before I even begin dictating, and for the rest of my session I can format anything I’ve missed a few paragraphs ago. After you fix something backwards, you’ll be returned to the bottom of your document where you left off. I couldn’t use “italicize” or “bold” or “underline” by themselves, because Dragon interpreted that as its own Microsoft Word command, which registers in Jarte but does not execute. Also, you need to have the status bar showing if you want to use the “go to page” command.

Also, please note that the keystrokes Dragon sends for many of these commands are based on the shortcuts found using the “use alternate main menu” setting under Options, using the Minimal interface.
# Voice commands for jarte

# Document control
Blank document = {Ctrl+n};
Open doc = {Ctrl+o};
Save doc = {Ctrl+s};
Save as = {Ctrl+Shift+s};
Close tab = {Ctrl+w};
Next tab = {Ctrl+Tab};
Previous tab = {Ctrl+Shift+Tab};
Close all = {Shift+Ctrl+F4};
Close delete = {Alt+f}{e};
Print doc = {Ctrl+p};
Quick print = {Shift+Ctrl+p};
(Close | open) find bar = {Ctrl+f};
(Show | hide) status bar = {Alt+v}s;
Backwards arrow = SetMousePosition(1, 230, 61) ButtonClick();
Forward arrow = SetMousePosition(1, 289, 58) ButtonClick();

# Text and page formatting
Italic <_anything> = {Ctrl+f} $1 {Enter} {Ctrl+i} {Ctrl+End};
Bold word <_anything> = {Ctrl+f} $1 {Enter} {Ctrl+b}{Ctrl+End};
Underline word <_anything> = {Ctrl+f} $1 {Enter} {Ctrl+u}{Ctrl+End};
Scratch <_anything> = {Ctrl+f} $1 {Enter} {Backspace}{Ctrl+End};
Double Space = {Alt+p}{l}{2} {Enter};
Copy doc = {Ctrl+a} {Ctrl+c};
Backspace all = {Ctrl+a} {Backspace};
Copy = {Ctrl+c};
Paste = {Ctrl+v};
Italics (on | off) = {Ctrl+i};
Bold (on | off) = {Ctrl+b};
Underline (on | off) = {Ctrl+u};
Increase font size = {Ctrl+Shift+Up};
Decrease font size = {Ctrl+Shift+Down};
Page break = {Ctrl+Enter};
Center = {Ctrl+Shift+c};
Align left = {Ctrl+Shift+l};
Align right = {Ctrl+Shift+r};
Set font (Verdana | Times New Roman) = {Alt+n}c WaitForWindow(“Font”) $1 {Enter};
Font size 6..72 = {Alt+n}c WaitForWindow(“Font”) {Alt+s} $1 {Enter};
Go to page 1..20 = SetMousePosition(1, 260, 702) ButtonClick() {Backspace} $1 {Enter};

Categories: Disability · Technology
Tagged: , , , , ,

Vocola commands for navigation (XP)

February 2, 2009 · Leave a Comment

These are pretty self-explanatory, except for perhaps the 1st one — I use it for control clicking, but you could also say “shift click,” for example.

# Global voice commands

(Shift=1 | Control=2 | Alt=3) Click = ShiftKey($1) ButtonClick();
Middle click = ButtonClick(4, 1);
TaskManager = AppBringUp(“C:/windows/system32/taskmgr.exe”);
Device manager = AppBringUp(“C:\Windows\system32\devmgmt.msc”);
Disk cleanup = AppBringUp(“C:\Windows\system32\cleanmgr.exe”);
Context = {Shift+F10};
Updates = AppBringUp(“C:\windows\system32\wuaucpl.cpl”);
Control panel = AppBringUp(“C:\windows\system32\control.exe”);
Safely remove hardware = SetMousePosition(0, 936, 750) ButtonClick();
Delete for sure = {Shift+Del};
Defrag = AppBringUp(“C:\Windows\system32\dfrg.msc”);
Rename this = {Shift+F10} Wait(400) {Down_1} ActiveMenuPick(“Rename”);
Get properties = {Shift+F10} Wait(400) {Down_1} ActiveMenuPick(“Properties”);

Categories: Disability · Technology
Tagged: , , , ,

Vocola and Dragon = instant compatibility

February 2, 2009 · 5 Comments

Edited for clarity. Okay, I’m officially never griping about Dragon incompatibilities again. (Unless in the case of some rare glitch.) The other night I downloaded the files that eventually make up Vocola, which is a free scripting program designed to add almost any natural language command you want to Dragon NaturallySpeaking. While it would be nice if Nuance would build in more commands that seem very basic to me, such as control clicking and middle clicking, not to mention fully supporting Firefox without the bugs, Vocola combined with Dragon has immensely improved my ability to navigate my computer by voice, and essentially every program I have installed is now vocally accessible.

There are multiple files to install, the instructions for which can be found here. The latest version is 2.6, but I may have downloaded 2.5 because when I tried to download 2.6 I got an error message. 2.5 works absolutely fine, though, even if that’s the case. There is also a basic tutorial file, which is incredibly easy to understand for the most part — even if you don’t use the examples verbatim, you can look at them and see how you’re supposed to structure your own commands. The mouse commands are somewhat more difficult to understand, because the tutorial does not provide you with what numbers stand for what clicks — I had to look them up. A middle click, for example, translates as ButtonClick(4, 1). To get my current mouse coordinates, I used AutoIt WindowSpy, which comes with AutoHotKey, which I was using for another experiment. I think there is also a Vocola command for that, however.

For the most part, though, almost everything can be done by creating keystroke commands, which are the easiest kind. The basic syntax, minus the square brackets, is [what you say] = {[modifier key]+ [key]};. The keystroke command can have multiple keystrokes.

Another useful command is AppBringUp, which does exactly what it sounds like — runs an application or file from its specified path. You might have to do a search in order to find the file’s location. Once you have, go to the address bar of Windows Explorer and copy what’s there, then paste it into your command. The file extension is usually .exe, though it can also be .lnk or another. There is a list of common Windows filenames here.

I don’t want to make this post overly long, but I do want to give you some of my commands in case they’d be of use to you — save you some dictation. So, in my next several posts, I’ll post commands for Jarte Plus, Windows Media Player, and others. (NOTE: Vocola CANNOT create commands for OpenOffice as is, at least not for the portable version, which is the only one that I have now. However, you may be able to download a Python extension for that; see the discussion here. I haven’t bothered. Jarte’s good enough.)

Much of the blogged info on Vocola is dated, and I think SpeechWiki is still down, but there are discussions of it almost every day at Speech Computing.

Categories: Disability · Technology
Tagged: , , , , ,