"Aurora team on Transformers AI Online Hackathon Hackathon"

Team Idea

A team of beginners from Sarajevo
Dario
Dario Petric
Dario

kanna
Kanita Rakovac
kanna

ZerinaA
Zerina Ahmetovic
ZerinaA

rakovka
Sadzida Rakovac
rakovka

Submission

mEYE Buddy App

mEYE Buddy App

mEYE Buddy app is an application whose main role is to play part as your very own PERSONAL assistant who will make the world a little bit more accessible for anyone who is in any way visually impaired and requires assistance. The BEST SIDES OF THIS APP are that IT is highly affordable, with a premium version and is based on a loyalty program (business model). With mEYE buddy, not only would the life of blind people be much easier, but they could have the privilege of INDEPENDENCE - they would not need to rely on their caretaker or service dog to help them withq everyday chores.The state of the art tool for assistance to visually impaired persons! This state of the art AI technology will assist you in your everyday life. How app works: For first login you would have to register, and you'd do that using your fingerprint. Everytime the app is opened, the voice will tell you where everything is located on the screen. The design was made simple and the buttons were made big for easy access. The user can always press the icon in the middle of the screen for a reminder of the locations of the buttons. The voice assistant is the main function of the app. It will activate the AI, which will use a connected camera to describe the surroundings and warn the user of hazards. The key places tab will take the user to a tab where they can activate a guide to registered locations that are important to the user. (workplace, supermarket, hospital, home, coffee shop, etc.) They can also register new locations and remove old ones. The hazards that were noted by the ai could also be registered here. The devices tab is simple. It is used to connect the device to an external camera, preferably one on the glasses of the user or attached to their body. The user can also connect to their smart watch for easy access. The settings tab is pretty self-explanatory. However, besides the settings, it will also contain emergency information about the user, in case they need help from someone. The “mEYE Buddy” app will be connected to a camera on the glasses or on your body, and will describe everything important going in front of you - every peculiar movement that triggers its sensors or warn you against any potential hazards that may come in your way. The app can also be asked to describe something specific in more detail. Our Buddy also stores any hazard or newly recognized item in its already vast and enriched database. The app can also be told where certain points of interest are located (workplace, supermarket, hospital, home, coffee shop, etc.) for easier access to it later. The app comes with a simple UI with big buttons for input, and can be instructed through the AI voice as well. Also comes with a 3x3 keyboard for simpler accessibility.