Category: Technology

Categories
Technology

Be My AI Review: Identifying Food Labels Nonvisually

From mid-February to mid-March 2025, while my parents were on a 30-day Viking cruise in Southeast Asia, I relied on accessible technology to handle daily tasks independently. One of the most useful tools I discovered during this time was Be My AI, an artificial intelligence-powered feature within the Be My Eyes app.

As a blind iPhone user who relies on VoiceOver, I often need assistance with identifying food labels. Whether I was grabbing a jar from my pantry or selecting a Clean Eatz pre-packaged frozen meal that I had thawed in the fridge, I needed a nonvisual way to confirm what I was holding. My primary goal wasn’t to get detailed ingredient lists or cooking instructions—I simply needed to determine:

  • The name of the meal (e.g., “Basic Chicken with Asparagus”) so I could accurately log it into MyFitnessPal
  • Nutritional facts, including calorie counts and protein content
  • The type of jar or package I was grabbing from my pantry (e.g., peanut butter, jelly)

This review details my experience using Be My AI, explains how to navigate the Be My Eyes app with VoiceOver, and discusses the advantages and limitations of this AI-powered tool.

What Is Be My Eyes?

Be My Eyes is a free accessibility app designed to assist blind and low-vision users by connecting them with sighted volunteers through live video calls. These volunteers help users with tasks such as:

  • Reading labels and packaging
  • Identifying objects
  • Navigating unfamiliar environments
  • Checking expiration dates

In addition to human assistance, Be My Eyes offers Be My AI, a built-in feature powered by artificial intelligence. Instead of connecting with a volunteer, users can take a picture, and Be My AI will generate a text-based description of the object or text in the image.

Be My AI is particularly useful for tasks like:

  • Reading food labels
  • Checking nutritional information
  • Identifying products in a pantry or fridge

Navigating Be My Eyes and Be My AI with VoiceOver

As a VoiceOver user, I found the Be My Eyes app easy to navigate. Here’s a step-by-step guide on how to use Be My AI:

1. Open Be My Eyes

  • If you haven’t already, download Be My Eyes from the App Store.
  • Open the app, and VoiceOver will automatically read the interface elements.

2. Locate Be My AI

  • On the home screen, swipe right with one finger until you hear “Be My AI.”
  • Double-tap to select it.

3. Capture an Image for AI Analysis

  • When Be My AI opens, swipe right until you hear “Take Picture.”
  • Double-tap to capture an image of the food package or jar.
  • Make sure the label is facing the camera and well-lit.

4. Read the Description

  • After taking the picture, wait a few seconds while Be My AI processes the image.
  • VoiceOver will then read the AI-generated description aloud, including the product name and any readable text.

5. Repeat if Needed

  • If the description isn’t clear, try adjusting the camera angle or distance and taking another picture.
  • Swipe right to find an option to retake the photo if necessary.

Using Be My AI to Identify Food Labels

How I Used Be My AI While My Parents Were Traveling

During my parents’ month-long Viking cruise, I used Be My AI primarily for:

  • Identifying Clean Eatz meals – I needed to determine the exact meal name (e.g., “Basic Chicken with Asparagus”) so I could log it in MyFitnessPal. These meals are pre-packaged frozen and I had thawed them in the fridge for later use.
  • Reading nutritional information – I checked calorie counts, protein content, and serving sizes.
  • Confirming pantry items – I used Be My AI to ensure I grabbed the correct jar from the pantry, such as peanut butter or grape jelly.

This allowed me to quickly and independently select the right meal or pantry item and track my food intake without relying on sighted assistance.

How Be My AI Worked in Practice

  • Opened Be My Eyes and navigated to Be My AI.
  • Took a picture of the food label or jar.
  • Waited a few seconds for Be My AI to process the image.
  • Listened as VoiceOver read the description aloud, providing the meal name or nutritional information.

This method was fast and effective, allowing me to complete my tasks independently.

Pros of Using Be My AI

1. Fast and Convenient

Instead of waiting for a sighted volunteer, I received instant results by taking a picture. This was especially useful when grabbing a meal from the fridge or selecting an item from the pantry.

2. Accurate Meal Names and Nutritional Info

Be My AI reliably identified:

  • The meal name (e.g., “Basic Chicken with Asparagus”)
  • Nutritional details (e.g., calories, protein content)

This made logging meals in MyFitnessPal much easier.

3. Increased Independence

Be My AI allowed me to identify and track my meals without needing a sighted person’s help, making me more self-sufficient in my daily routine.

Challenges and Limitations

1. Camera Positioning Matters

The biggest challenge was holding my phone at the correct angle and distance. If I positioned the camera too close or too far from the label, the AI sometimes struggled to read the text.

2. No Live Adjustments

Unlike sighted volunteers who can guide camera positioning in real time, Be My AI only processes still images. If my photo wasn’t clear, I had to retake it multiple times.

3. Limited Context Beyond Text

Be My AI was great for reading meal names and nutrition facts, but it didn’t always provide context beyond the text on the label. If I had needed additional details (like preparation instructions), I would have had to take multiple photos.

Best Use Cases for Be My AI in Food Label Identification

From my experience, Be My AI is best for:

  • Identifying pre-packaged frozen meals – It provided the exact meal name, making it easy to log into MyFitnessPal.
  • Reading nutritional facts – It quickly gave me calorie counts, protein content, and serving sizes.
  • Confirming pantry items – It helped me ensure I grabbed the right jar, like peanut butter or jelly.

Final Thoughts

Overall, Be My AI proved to be an invaluable tool for identifying food labels nonvisually. It made meal tracking and pantry organization significantly easier while my parents were away.

  • Fast and accessible – I could identify meals and labels in seconds.
  • Accurate results – The AI provided reliable meal names and nutrition facts.
  • Independent experience – I didn’t need to rely on sighted assistance.

Although positioning the phone correctly required some trial and error, once I got the hang of it, Be My AI worked flawlessly. If you’re a blind or low-vision user looking for a fast and accessible way to identify food packaging, I highly recommend giving Be My AI a try!

Have you used Be My AI to identify food labels or other items? Share your experience in the comments below!

Categories
Technology

Navigating Microsoft Outlook Nonvisually

Microsoft Outlook is an essential tool for managing emails, contacts, calendar events, and more. For those who are blind, visually impaired, or have other print disabilities, using keyboard shortcuts offers a more efficient way to navigate and manage Outlook features.

The following is a comprehensive list of Microsoft Outlook keyboard shortcuts that work for Outlook 2010 and later versions. These shortcuts help users access key features without relying on the mouse, enhancing productivity and accessibility.

General Navigation and Views

  • Ctrl+1 = Switch to Mail
  • Ctrl+2 = Switch to Calendar
  • Ctrl+3 = Switch to Contacts
  • Ctrl+4 = Switch to Tasks
  • Ctrl+5 = Switch to Notes
  • Ctrl+6 = Switch to Folder List in Navigation Pane
  • Ctrl+7 = Switch to Shortcuts
  • Ctrl+Shift+B = Open Address Book

Navigating the Message List and Viewing Emails

Message List and Main Window Navigation

  • Tab = Move forward through screen elements
  • Shift+Tab = Move backward through screen elements
  • Ctrl+Shift+I = Go to Inbox
  • Ctrl+Shift+O = Go to Outbox
  • Ctrl+Y = Go to another folder
  • F3/Ctrl+E = Go to the Search box
  • Ctrl+M/F9 = Check for new messages
  • Alt+Left Arrow/Alt+Right Arrow = Go back/forward to previous/next view
  • Ctrl+N = Create a new message
  • Ctrl+Shift+M = Create a new message from any view

Navigating the Navigation Pane

  • Arrow Up/Arrow Down = Move between folders in the Navigation Pane
  • Shift+Tab = Jump between the Message List and Navigation Pane
  • Arrow Left/Arrow Right = Collapse/Expand message groups in the Navigation Pane
  • A-Z = Jump to folder starting with a specific letter
  • F2 = Rename a folder
  • Delete = Delete a folder

Navigating the Message List

  • Arrow Up/Arrow Down = Move between messages in the list
  • Shift+Arrow Down/Up = Select multiple adjacent messages
  • Ctrl+Arrow Up/Down + Space = Select multiple non-adjacent messages
  • Ctrl+Shift+V = Move selected messages to a different folder
  • Insert = Flag the message
  • Ctrl+Shift+G = Add a custom flag to a message
  • Ctrl+Q/Ctrl+U = Mark message as read/unread
  • Ctrl+Alt+M = Mark a message for download
  • Alt+Enter = Show message properties
  • Ctrl+Shift+S = Post a message to a folder
  • Ctrl+Shift+Y = Copy a message to another folder
  • Space/Shift+Space = Page up/down through message text
  • Ctrl+./Ctrl+, = Jump to the next/previous message in the current view

Composing and Formatting Email

  • Tab = Cycle through To, Cc, Subject, and Message Body
  • Alt+M = Choose a From account
  • Alt+S = Send the message
  • Ctrl+S/Shift+F12 = Save the message
  • Ctrl+X/Ctrl+C/Ctrl+V = Cut/Copy/Paste
  • Ctrl+B = Bold text
  • Ctrl+I = Italicize text
  • Ctrl+U = Underline text
  • Ctrl+Shift+L = Add or remove bullets
  • Ctrl+L = Align text to the left
  • Ctrl+R = Align text to the right
  • Ctrl+E = Align text to the center
  • Ctrl+T/Ctrl+Shift+T = Increase/decrease indent
  • Ctrl+Space = Clear formatting

Creating Items

  • Ctrl+Shift+A = Create an appointment
  • Ctrl+Shift+C = Create a contact
  • Ctrl+Shift+L = Create a distribution list
  • Ctrl+Shift+Q = Create a meeting request
  • Ctrl+Shift+M = Create a new message
  • Ctrl+Shift+N = Create a new note

Calendar and Task Shortcuts

Calendar Shortcuts

  • Ctrl+N = Create a new appointment (Calendar view)
  • Ctrl+Shift+A = Create a new appointment (any view)
  • Ctrl+Shift+Q = Create a new meeting request
  • Ctrl+G = Set up recurrence for an appointment or task

Calendar Navigation

  • Ctrl+Alt+1 = Switch to Day view
  • Ctrl+Alt+2 = Switch to Work Week view
  • Ctrl+Alt+3 = Switch to Full Week view
  • Ctrl+Alt+4 = Switch to Month view
  • Arrow Left/Arrow Right = Move to the previous or next day
  • Home/End = Go to the beginning or end of the calendar view

Contact Shortcuts

  • F3/Ctrl+E = Search for a contact or other items
  • Ctrl+A = Select all contacts
  • Ctrl+F = Create a new message to the selected contact
  • Ctrl+N = Create a new contact (Contacts view)
  • Ctrl+Shift+C = Create a new contact (any view)
  • Ctrl+Shift+B = Open Address Book
  • Ctrl+Shift+F = Use Advanced Find

Task Shortcuts

  • Ctrl+E = Search for tasks or other items
  • Ctrl+Y = Open Go To Folder dialog box
  • Ctrl+N = Create a new task (Tasks view)
  • Ctrl+Shift+K = Create a new task (any view)
  • Insert = Flag task or mark it complete
  • Ctrl+P = Print the selected item

Additional Useful Shortcuts

  • Ctrl+Alt+S = Define Send/Receive groups
  • Ctrl+Alt+Shift+F12 = Save Form Design

      Additional Keyboard Commands

      Microsoft Outlook has tons of keyboard shortcuts to make navigating easier, especially for those who rely on the keyboard instead of a mouse. While this list covers a lot, there might be some commands I missed.

      If you know of any additional keyboard shortcuts that aren’t listed here, drop me a comment! I’ll be sure to add them so we can keep this list as useful and up-to-date as possible.

Categories
Technology

QuickBooks for the Blind

For most people, QuickBooks is a familiar tool for managing their finances. The software is designed for visual use, relying on point-and-click techniques for tasks such as generating invoices, writing checks, and reviewing reports.

But what about those who are blind, low vision, or print disabled?

Before 2013, managing finances with QuickBooks Desktop was a major challenge for blind users, especially those relying on screen readers. The software was not designed to be compatible with screen reading technology, making it difficult or impossible to complete key tasks such as writing checks, generating invoices, and reviewing financial reports.

I know this firsthand. To use QuickBooks Desktop, I had to combine ZoomText (screen magnification software) with JAWS (Job Access with Speech screen reader), but the experience was frustrating and inefficient. Navigating QuickBooks was a complex process, and I spent much more time than I should have completing simple bookkeeping tasks.

The Turning Point: MyBlindSpot’s QuickBooks Blind Scripts

In 2013, everything changed when MyBlindSpot, Inc., a nonprofit organization focused on accessibility, introduced the QuickBooks Blind project. They developed a set of JAWS scripts specifically for QuickBooks Desktop, making it accessible for blind and low vision users. These scripts transformed the experience of using QuickBooks by enabling screen reader users to easily navigate the program with keyboard shortcuts.

Before the release of these scripts, blind QuickBooks users faced major barriers in performing even the most basic tasks. Now, thanks to QuickBooks Blind, blind users could access and utilize the software in a way that was previously impossible. Some of the tasks that became accessible included:

  • Writing and printing checks
  • Creating and sending invoices
  • Managing accounts payable and receivable
  • Running financial reports
  • Organizing and tracking business expenses

The QuickBooks Blind scripts not only made QuickBooks Desktop accessible but also helped me become more efficient in managing my personal company, Mackey Enterprises, LLC. They also opened doors to leadership positions within the National Federation of the Blind (NFB):

  • Affiliate Treasurer of the National Federation of the Blind of New Jersey (2016–2018)
  • Affiliate Bookkeeper for the NFB of New Jersey (2019–present)
  • Affiliate Treasurer for the National Federation of the Blind of Pennsylvania (2019–2024)

Accessibility in QuickBooks Online (QBO)

While QuickBooks Desktop required JAWS scripts for full accessibility, the cloud-based version, QuickBooks Online (QBO), is now built with accessibility features that are designed to work out of the box with screen readers. This development makes QuickBooks Online a great option for blind, low vision, and print-disabled users who prefer a more flexible, cloud-based solution.

Thanks to improvements made by Intuit in partnership with MyBlindSpot, QuickBooks Online has become fully compatible with popular screen readers like JAWS, NVDA, and VoiceOver. This means users can now access their QuickBooks account through their browser and utilize a variety of bookkeeping features without additional tools or scripts.

For those who prefer QuickBooks Desktop, the QuickBooks Blind scripts are still necessary, but QuickBooks Online offers a more streamlined experience for users who rely on screen readers for day-to-day bookkeeping tasks.

Learn QuickBooks Blind with MyBlindSpot’s Virtual Lessons

To help blind users become proficient with QuickBooks Desktop and QuickBooks Blind, MyBlindSpot offers over 60 Self-Paced Virtual Lessons. These lessons are designed to guide users step-by-step through key processes in QuickBooks, such as writing checks, managing invoices, and reviewing reports.

The virtual lessons cover essential tasks in QuickBooks Desktop and closely mirror the MyBlindSpot MBS User’s Guide, both of which were created by blind professionals with decades of experience in accessibility. The materials are based on 20 years of traditional documentation, ensuring that blind users receive training equivalent to that provided to sighted users.

Here are two example lessons:

Lesson 50 Writing a Check:

Lesson 56 Sending an Email Directly from an Invoice Screen:

These lessons are incredibly beneficial for individuals who want to master QuickBooks and build their confidence when using the software for personal or professional purposes.

Powerful Testimonials and More Resources

MyBlindSpot’s QuickBooks Blind project has been transformative for many users in the blind community. For an in-depth look at how QuickBooks Blind has changed lives, watch this powerful testimonial:

Additionally, for more lessons and detailed guidance on using QuickBooks with accessibility tools, check out the MyBlindSpot YouTube channel:
Visit MyBlindSpot on YouTube

To learn more about QuickBooks Blind, MyBlindSpot, and their commitment to making QuickBooks accessible for everyone, visit their official website:
www.myblindspot.org

Categories
Technology

Blind People Reading Print They Can’t See? There’s an App for That!

I am a legally blind individual with an eye condition called Bardet Biedl Syndrome and have difficulty reading printed materials. Typically, I read using electronic magnifiers such as a Close Circuit TV or Freedom Scientific’s Ruby magnifier. But, these have downsides. A CCTV, especially a desktop version, is not portable, and the Ruby, though it’s portable, is generally for quick reading and it is just one more item for the user to carry with them.

Now, thanks to the advances of mobile technology, there is another way! The National Federation of the Blind has made the dream of reading print for blind, low vision, and print-disabled individuals into a reality with the OneStep Reader (formerly known as the KNFB Reader), a fast, accurate, and easy to use app for an iOS or Android smartdevice. The OneStep Reader mobile app reads print aloud and can be used to read just about any printed material accurately and almost instantly.

It’s so easy. You simply take a photo of the words with your mobile device, and the app reads these aloud with high quality text-to-speech through optical character recognition (OCR). The OneStep Reader has tilt guidance and a field of view report to tell you if you are getting the right photo. It doesn’t matter if you can see that you have the whole page in range or even if it happens to be upside-down. Talk about the miracles of technology!

The OneStep Reader app is really a great tool. I have used it to read my pay stubs and the printed mailing addresses on envelopes. OneStep Reader reads the text flawlessly. I first use the field of view report to make sure I have as much of the document captured as possible, then take a picture. You can also use the tilt guidance feature to make sure the camera is level with the document. If you are scanning a lot of documents, I recommend purchasing a stand to rest the phone or tablet on. The National Federation of the Blind’s Independence Market sells one for $12. We all have smartdevices with us all the time these days, so this app gives you the ability to independently read printed material wherever you are, which is very convenient!

The OneStep Reader can be used to read bills, class handouts, PowerPoint presentations, business cards, song listings on CD cases, books, and so much more. The original device, which was invented in the 1970s by Ray Kurzweil, was the size of a kitchen freezer and it was not portable! Now it is portable and can be downloaded onto any device.

The OneStep Reader is available for Apple and Android devices for varying prices. You can visit the Apple AppStore or the Google PlayStore to find current pricing. The manual is available within the app itself. Step-by-step instruction videos can be viewed at www.perkins.org/resource/knfb-instructional-videos.

You can live the life you want with OneStep Reader!

Please download the KNFB Reader from:

Categories
Technology

Siri and the Visually Impaired: Call Me Apple!

When Apple first introduced the voice assistant Siri with the iPhone 4S in 2011, I can tell you that many people I know were thrilled to say the least. Siri with its ability to translate voice commands has the potential to make life so much easier for blind and low vision individuals. Using voice commands to look up phone numbers and make phone calls is just the tip of the iceberg. In surveying my colleagues in the National Federation of the Blind of New Jersey’s Technology Division (now the NFBNJ Technology Committee), I heard countless other use cases, including creating appointments with reminders, setting wake-up alarms, sending text messages, getting directions, checking the weather, getting word spellings and definitions and even performing basic math.

In short, Siri assists those of us who can’t see by allowing us to use our voices to get things done just by asking. The wonders of modern technology never cease to amaze me.

Many individuals use Siri on their iDevices, but only know a handful of commands. I discovered a complete listing of Siri commands compiled by applevis.com, a website for blind and low-vision users of Apple products, including Mac computers, the iPhone, iPad, iPod Touch, Apple TV and Apple Watch. You will find Siri commands for all kinds of inquiries. Here are some of the categories:

  • Making phone calls (including calling 911 and the fire department)
  • Managing phone conversations and voicemails
  • Using Apple’s FaceTime
  • Finding contacts
  • Reading, sending and replying to messages
  • Scheduling meetings and conference calls
  • Checking calendars
  • Receiving reminders
  • Making notes
  • Posting to Facebook and Twitter
  • Using maps and getting directions
  • Finding local businesses and restaurants
  • Playing music
  • Listening to podcasts
  • Making mathematical calculations
  • Searching the Web
  • Looking up photos and videos
  • Managing iDevice settings
  • Taking dictation
  • Getting the latest news, sports, weather, entertainment and stock market information
  • And the list goes on.

Despite the wonder of this amazing technology, there are definitely areas for improvement from my perspective. For example, those of us with speech impairments get frustrated with Siri. You know you said a word clearly enough, but Siri doesn’t interpret it correctly. Sometimes my “g” sounds like a “d” so Siri might have trouble that way even when I am speaking clearly. After several repetitions, I usually give up and enter my inquiry manually. I have read that researchers are working on technology that better recognizes unusual voices or speech patterns, so hopefully one day Siri will be able to learn how a particular individual speaks. This would make a big difference to those with speech impairments or people who speak with a hard-to-understand accent and allow us to use Siri more.

No doubt, the next iteration of Siri will bring even more improvements that address some of the existing deficiencies. In the meantime, perhaps Apple developers would like to talk to some of us “real users” with disabilities? We see and hear things from a different perspective and can definitely offer some opinions and useful feedback. Call me Apple!