Be My Eyes brings AI Image Description to Windows!
Since its creation, Be My Eyes has been a must-have free app for both iOS and Android smartphone users. Thanks to modern advances, their AI powered visual description system: Be My AI, provides reliable results and quickly answers difficult or complex follow-up questions asked via prompt. But now its developer OpenAI has taken this success to the big screen! Well, the computer screen at least.
Our resident Assistive Technology Expert: Cory, will explain how to use Be My Eyes on your Windows computer, specifically how to get AI descriptions from your computer screen display generally or specific visual files.
Unfortunately, Luke has been missing ever since he took the MagniLink Tab out camping in the wilderness. Thankfully, Cory just received an email from Luke with a photo of his environment. Hopefully Cory can use Be My Eyes to identify where Luke has ended up, and devise some method of rescuing him!
0:00 Start
0:40 Introducing Be My Eyes
1:25 Introducing Be My Eyes for Windows! Free on the Microsoft Store!
2:30 Describe our Screen, an unexpected email from Luke,
4:00 Follow-Up Questions for Be My AI
5:00 Describe a Visual File on your computer, such as a Jpg
8:00 Luke Returns Rescued! Using a built in camera for AI description
9:30 Wrap-Up Review or Be My Eyes, specifically Be My AI describing pictures
10:30 Contact Info, Upcoming Live shows and Events!
If you have any additional questions about Be My Eyes or Be My AI, please add those down in the comment section and we will endeavor to help!
Join us next time on Tech Connect, and be sure to leave your thoughts down in the comments below and ask plenty of questions!
Vision Forward's Tech Connect continues to bring you the information you need to make the most out of your devices. Our experts know there are many factors to consider, so if you have any follow up questions please post them in the comments and we will help you find the assistive tech that's best for you.
Join us, find the schedule by visiting out website:
https://vision-forward.org/techconnect
Contact Vision Forward Association:
Call us: (414-615-0103)
Email us: infocus@vision-forward.org
Visit us online: https://www.vision-forward.org
Online Store: https://www.vision-forward.org/store
Want more Tech Connect in your life? Try us Live! Be sure to join us for the upcoming YouTube Live! show on June 20th at 11am CST.
Looking for the full playlist?
https://www.youtube.com/playlist?list=PLdZ61dAGaL_k3I-_LcTPozan9upCqY8Yc
Catch-up with our most recent episodes!
"Glide from Glidance, with Amos Miller"
https://www.youtube.com/watch?v=42KuD0uuZls
"RIM - Accessible Remote Training & Support"
https://www.youtube.com/live/mFIZwaIo0CE
"You Tube? Me Tube! How to Access YouTube with a Screen Reader!" https://www.youtube.com/watch?v=HCLZwyxFGSE
Before that:
"OrCam Read 3.0 Update with Corinne Nero"
https://www.youtube.com/watch?v=_X8Pp2Ok2-M
Earlier this year: "Accessible Video Games with Jesse Anderson" htt
Our resident Assistive Technology Expert: Cory, will explain how to use Be My Eyes on your Windows computer, specifically how to get AI descriptions from your computer screen display generally or specific visual files.
Unfortunately, Luke has been missing ever since he took the MagniLink Tab out camping in the wilderness. Thankfully, Cory just received an email from Luke with a photo of his environment. Hopefully Cory can use Be My Eyes to identify where Luke has ended up, and devise some method of rescuing him!
0:00 Start
0:40 Introducing Be My Eyes
1:25 Introducing Be My Eyes for Windows! Free on the Microsoft Store!
2:30 Describe our Screen, an unexpected email from Luke,
4:00 Follow-Up Questions for Be My AI
5:00 Describe a Visual File on your computer, such as a Jpg
8:00 Luke Returns Rescued! Using a built in camera for AI description
9:30 Wrap-Up Review or Be My Eyes, specifically Be My AI describing pictures
10:30 Contact Info, Upcoming Live shows and Events!
If you have any additional questions about Be My Eyes or Be My AI, please add those down in the comment section and we will endeavor to help!
Join us next time on Tech Connect, and be sure to leave your thoughts down in the comments below and ask plenty of questions!
Vision Forward's Tech Connect continues to bring you the information you need to make the most out of your devices. Our experts know there are many factors to consider, so if you have any follow up questions please post them in the comments and we will help you find the assistive tech that's best for you.
Join us, find the schedule by visiting out website:
https://vision-forward.org/techconnect
Contact Vision Forward Association:
Call us: (414-615-0103)
Email us: infocus@vision-forward.org
Visit us online: https://www.vision-forward.org
Online Store: https://www.vision-forward.org/store
Want more Tech Connect in your life? Try us Live! Be sure to join us for the upcoming YouTube Live! show on June 20th at 11am CST.
Looking for the full playlist?
https://www.youtube.com/playlist?list=PLdZ61dAGaL_k3I-_LcTPozan9upCqY8Yc
Catch-up with our most recent episodes!
"Glide from Glidance, with Amos Miller"
https://www.youtube.com/watch?v=42KuD0uuZls
"RIM - Accessible Remote Training & Support"
https://www.youtube.com/live/mFIZwaIo0CE
"You Tube? Me Tube! How to Access YouTube with a Screen Reader!" https://www.youtube.com/watch?v=HCLZwyxFGSE
Before that:
"OrCam Read 3.0 Update with Corinne Nero"
https://www.youtube.com/watch?v=_X8Pp2Ok2-M
Earlier this year: "Accessible Video Games with Jesse Anderson" htt
Category
🤖
TechTranscript
00:00Oh, am I glad to see you guys. I went camping two weeks ago, and I've been lost ever since. I've been walking non-stop
00:07I have no idea where I am, but I'm tired. I'm down to my last food ration. Luckily
00:12I still have my Magna Link tab at least, but I really need to get out of here. I stumbled across this strange pyramid
00:18I don't know what it is, but I'm hoping Corey is gonna be able to recognize it. So I'm gonna take a picture
00:23I'm gonna email it to Corey and pray that he can come and save me. Here we go
00:30Hi all, welcome back to another Tech Connect. Luke's not with us today. If you saw our last video, he was enjoying a little camping. Although, enjoying might not be the word I would use. It didn't seem like it was going well. To be honest, I'm a little nervous. He has not been back to work all week, so I'm hoping he'll be back soon.
01:00So he's not with us today, but we wish him best, and we just need to keep soldiering on. So today we are looking at the Be My Eyes app, but we're looking at it specifically for Windows Platform. So we've done a lot already with Be My Eyes on iOS and Android, but they've now released a version for Windows, and that's what we'll be taking a look at today.
01:23As I mentioned, it is a Windows app, which means we're gonna need to use the Microsoft Store to go and download Be My Eyes. So you're gonna want to make sure you have that Microsoft account, you're logged into the store app. Go ahead and use the search function, find it, download it. It is free, so there's really no reason you shouldn't go and get it on your machine.
01:45Once you've downloaded and installed the app, you're gonna see that there's really kind of four main functions. Today we're really gonna be looking at three, because you're gonna see that a lot of them are kind of the same. It's all about having a image or picture described to you.
02:00So we have the ability to have our current screen, so what's currently on the computer screen described to us. We have the ability to use the integrated camera. So if you've got a laptop with an integrated camera or maybe you have a webcam connected, you can use that to take a picture and have it described to you.
02:19You can also have a picture that's already on your computer via File Explorer described to you. Or last, if you've got an image on your clipboard, you can have that described to you.
02:31Let's take a look at describe our screen and oh, we got an email. Let's see if it's from Luke, maybe telling us why he's not at work here.
02:39Emails from Luke Ballard at visionforward.org. Outlook, list box, unread, attachment, Luke Scriven, help, I'm lost.
02:47Ah, it is from Luke, and as I thought, he's lost. Let's take a look. Maybe he gave us an image here.
02:54Corey, I've been lost in the jungle since the last video. This is the last time I go camping. Check the attached picture. You have to find out where I am and save me.
03:03Now, I find it interesting that he had enough internet to send us an image and an email and didn't call for help. But let's take a look at the image and we'll see if we can get Be My Eyes to figure out where he is.
03:15We've opened up the photos simply in our photos app. Now, we're going to use the keyboard shortcut, control, alt, h, and that's going to allow Be My Eyes to explain our computer screen, and since the photo's up, that's what it's going to describe to us.
03:38Control, h, Be My Eyes, Be My Eye tab, one of two, question to ask the AI at it. Please wait, Be My Eyes writing a message, dot, dot, dot. The image shows a large, ancient pyramid structure with a staircase leading to the top. The sky is mostly clear with a few clouds.
03:57All right, so we got a little bit of information. It said that it appears to be a large, ancient pyramid with a staircase, but to be honest, that's not enough for me to figure out where he is. But if you're familiar with Be My AI on the iOS and Android app, you know that we have the ability to ask a follow-up question. So maybe we can say, where is this? And let's see if it'll give us some information.
04:20Back button, question to ask the AI at it.
04:23So let's type in, where is this? Enter, message. And we'll wait for our message back.
04:30The structure in the image is the Pyramid of Kukulkan, also known as El Castillo, located in the ancient Mayan city of Chichen Itza in Mexico. It is one of the most famous and well-preserved pyramids from the Mayan civilization.
04:42Somehow he's in Chichen Itza, Mexico, which is a long way away. I have no idea. He really must have gotten lost and has been hiking for days. Must be hiking pretty fast, too. But we now know where he is. Let's see if we can keep using Be My Eyes to help get him saved.
05:02All right, so we know where Luke is, but now we got to keep using Be My Eyes to see if we can save him. And the only way I know how to do it is by buying a helicopter and flying down to Mexico to save him.
05:17Now, luckily, I planned for this. I knew someday he would get himself lost. So I've had helicopter prices stored on the computer just in case of this emergency. The problem is that it's a JPEG. It's a picture.
05:35So we are going to use one of the other features of Be My Eyes, and that is choosing an image on your computer via File Explorer and have it described to us. And hopefully it can read us some options on copter prices. So we are in the Be My Eyes app. Now, I'm going to simply tab over to the option we're looking for.
05:56Take picture using built-in capture. Describe picture from File Explorer. Shortcut Control plus Alt plus K button.
06:02And that's what we want. We also hear that there is a keyboard shortcut, but we'll go ahead and just hit Enter.
06:08Enter. Be My Eye tab. One of two. File name.
06:12It's opened up a simple dialog box here, and let's go look for our copter prices.
06:16Explorer pane. Vision Forward Association. Chopper prices dot JPEG.
06:21There it is.
06:22Enter. Be My Eye tab. One of two. Please wait. Be My Eye is writing a message dot dot dot. Question to ask the eye edit.
06:30And let's see what it gives us.
06:32The image shows a list of helicopters for sale, each with details such as the model, price, year, serial number, total time, airframe, TTAF, and the date the listing was updated.
06:43Here are the details for each helicopter.
06:45One. Airbus slash Eurocopter EC 135 T2 plus. Price. Dollar two million three hundred.
06:52OK, so we've got a number of options here. The first option is two million dollars.
06:56Now, I really enjoy Luke both as a friend and a coworker, but I'm not spending two million dollars to find him.
07:02So let's use the ask a question and let's ask how much option three is.
07:08And maybe that's a little bit more affordable. So we'll make sure that we're in the edit box and we'll say.
07:17How much is option three?
07:20Three. Enter. Message sent. Please wait. Be My Eye is writing a message dot dot dot.
07:26Option three, which is the Airbus slash Eurocopter BK 117 B1 from the year 1988, is listed for dollar five hundred ninety five thousand.
07:36All right. So nineteen eighty eight.
07:39That's a thirty five year old helicopter still in great condition, just under six hundred thousand dollars, which is right in our budget.
07:48Vision Forward has no problem investing six hundred thousand dollars to go get Luke.
07:54So let's go purchase it and head off and save them.
07:59Great news. I was able to fly that helicopter like nobody has ever flown a helicopter before.
08:06Swooped in, dropped the ladder, saved Luke.
08:10He's getting checked out by the doctors right now, both from our little bumpy flight back, but also some of those snake bites and stuff.
08:17But he should be here any moment.
08:20Thank you so much for coming to rescue me.
08:23I don't know how I got so lost. That was the craziest camping trip I've ever taken.
08:27It was the only camping trip I've ever taken.
08:30I kind of recommend maybe it being your last camping trip.
08:33Definitely. Especially because. Yes.
08:36If you hadn't rescued me when you did, I would have been forced to eat my very last food item, Corey.
08:42OK. And you will never guess what I was down to.
08:45I don't have to guess because I can use Be My Eyes and take a picture and find out what it is.
08:51No way.
08:53I'm so happy how enthused you are.
08:56All right, here we go. Let's hold it up. And again, we're using the integrated camera on my laptop.
09:00The image shows a person holding a box of Betty Crocker's super moist white cake mix.
09:05Oh, no.
09:08I don't think I could have saved you any sooner.
09:11I can't imagine you having to eat moist cake again.
09:14No, I probably should have just left the cake mix there.
09:17Yeah. Can you imagine a hundred years from now when some archaeologist is digging underneath the pyramid and they come across Betty Crocker?
09:25It would really throw them for a loop.
09:27Even the Mayans didn't want to eat this Betty Crocker.
09:30So Be My Eyes has been, you know, it's been around forever.
09:34It's been on the smartphones and now it's on the Windows app.
09:39I like it. I think that for a first version, it's pretty good.
09:44You know, I think it's a lot of the features all around the same kind of thing, explaining pictures mostly to you.
09:51Although you saw with the helicopter sample, that was actually all text and it was still able to read it to us.
09:59Although we weren't able to like navigate through that text.
10:02I'd love to see it maybe start to incorporate some more almost OCR like features.
10:07Although that's kind of what it's doing.
10:09But being able to navigate through maybe if you've got an inaccessible PDF, that would really be kind of cool.
10:15Because right now you're limited to just the picture, just to JPEGs or PNGs.
10:20So all in all, it's free. Why wouldn't you add it to your toolbox?
10:24Yeah, I mean, I would love to comment, Corey, but I have no idea what you're talking about because I was lost in Mexico apparently.
10:30Well, and it saved you.
10:31So at the end of the day, how can I give this app a bad review when you are sitting back with us?
10:3810 out of 10, best app ever. Go download right now.
10:42Exactly.
10:43Alright, so if you've used Be My Eyes both on the Windows side or if you've used it on Android, iOS, please put it down in the comments.
10:52Let us know what are your big use cases.
10:54Maybe give us your top three reasons or three ways that you like to use Be My Eyes.
11:00If you've been to Chichen Itza, then please put in the comments whether you enjoyed it, what your favorite temple was,
11:06and whether you happen to see me looking lost while you were there.
11:09Have you ever eaten moist cake in Mexico?
11:11Oh, I certainly hope not.
11:14We've got a number of different things that you can keep track of what we're doing.
11:18We've got a learning management platform, which is really fancy for just a website you can go to to get more content.
11:26Webinars with free ACVREP credits.
11:29You can head over to techconnect.vision-forward.org and you're going to be able to get all of that information.
11:36And don't forget we have a live show.
11:38That's right.
11:39You can catch Corey and I live every two weeks.
11:42So we recently did an episode with, let's see, Glidance, Amos Miller from Glidance.
11:48Yeah, that was a really good one.
11:49Yeah, so that was a few weeks back and he was telling us all about the Glide Mobility.
11:53So if you want to check out the live show, then all you have to do, Corey, is go to youtube.com forward slash vision forward tech connect.
12:00Did you know that?
12:01I did and guess what?
12:02So did they because that's where they are right now.
12:04Oh, yeah, good point.
12:05So you're probably watching this video right there.
12:06So head to our homepage of our channel and you'll be able to check out those live shows.
12:10They are on Thursdays every two weeks and they are at 11 a.m. Central.
12:15Corey, did you know if you prefer to not see us and listen to it instead,
12:20we do have a podcast versions of those Tech Connect lives in your favorite podcast app.
12:25Just search for Vision Forward Tech Connect.
12:27You'll find our podcast.
12:29We always post those right after our live video show.
12:33So go ahead and check those out.
12:35Indeed. And with that, I think we'll wrap up the video.
12:37Corey, it's been quite a long day here.
12:40Do you want to kind of kick back and relax and go camping?
12:43Nope, but I can't wait for you to be back to work on Monday and start working again.
12:47Stay tuned out.