Since 2015, Be My Eyes has worked to connect our 6.9 million volunteers to users to assist them with everyday tasks. Our mission is to make the world more accessible for people who are blind or have low vision, which is why, seven months ago, our team began working with the blind community to incorporate AI into the existing Be My Eyes platform. Since then, over 19,000 blind and low-vision beta testers contributed to the design and function of our new AI feature.

Today we are thrilled to announce that Be My AI is officially entering an open beta phase for iOS users and in coming weeks will be available for hundreds of thousands of Be My Eyes users worldwide.

Using Be My AI in your everyday life is quick and simple. Once you have access, open the Be My Eyes app, click on the ‘Be My AI’ tab, and take a picture. Be My AI will give you a detailed description about it, and you can chat and ask Be My AI further questions to get more information. If you like what Be My AI described, you can send its response and photo to others, or use its description in social media.

And don’t worry - if Be My AI can’t answer all your questions, if you want to check its results, or if you just need a little more description than Be My AI can provide or crave the magic and humanity of working with people, you still can easily reach one of our dedicated volunteers, just like before. They will always be there, in 150 languages all across the globe.

If you want to learn more about Be My AI and how to use it at its best, we have collected the most common questions (and answers!) in our Help Center. Make sure to check them out!

  • geosoco@kbin.socialOP
    link
    fedilink
    arrow-up
    15
    ·
    9 months ago

    Yes, it’s a press release, but I think this is maybe a an interesting use for some of the AI to augment that of volunteers who help describe and annotate for people who have vision challenges.

  • just_another_person@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    ·
    9 months ago

    Wondering what the catch is here. How does this company make money? The resources needed to run something like this at scale is crazy.

    • raptir@lemdro.id
      link
      fedilink
      English
      arrow-up
      12
      ·
      9 months ago

      They make their money through private partnerships. Google licenses their technology to provide customer support to blind customers, for example.

    • geosoco@kbin.socialOP
      link
      fedilink
      arrow-up
      8
      ·
      9 months ago

      I have no idea what their business model is, but this would be a great way to collect more data for training various forms of AI. Arguably without harvesting people’s personal data or their creative works.

      I also suspect that because it’s an assistive tool, it can probably get a fair bit of grant money.

  • whodatdair@lemm.ee
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    1
    ·
    edit-2
    9 months ago

    What a great idea! However, as a person who’s day is made by being able to help people via this app, I hope this doesn’t reduce the amount of calls I get sent! 😮

    • insaneinthemembrane@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      9 months ago

      Same but I wonder how well it will do… lots of calls are me saying to move the thing so I can read it or whatever. The calls tend to need back and forth communication.

      • bob_wiley@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        9 months ago

        How many of the calls involve colors? I signed up for the app, but I’m always worried I’m going to answer a call and it will be someone asking me what color something is and I won’t be able to give them a good answer, because I’m red/green colorblind. So I usually hesitate and then someone else grabs it.

        • insaneinthemembrane@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          9 months ago

          I don’t recall any being about colour. Usually it’s about reading something, like which type of batteries are for this thing or how long to cook this for… that kind of thing.

        • geosoco@kbin.socialOP
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          9 months ago

          Yeah as the other person suggested i suspect it’s more like “when do these expire?” “does this have mold on it?” “what does this sign say?”

          You might get some about “does this match?” but i don’t know