About the challenge

The WhatsAI Hackathon invites you to explore the exciting intersection of generative AI and accessibility! This 2-day event focuses on leveraging the WhatsAI framework to develop innovative solutions that empower blind and low-vision individuals. Participants will work with Meta Ray-Ban glasses and cutting-edge AI technologies to create Accessible Artificial Intelligence Implementations (AAlls) that address real-world visual accessibility challenges.

Get started

  1. Form a team: Collaborate with fellow hackers to bring your ideas to life.
  2. Explore the WhatsAI framework: Familiarize yourself with the provided tools and resources. Visit the server github: Znasif/HackTemplate and the client page: Screen Capture Client | Nasif Zaman
  3. Identify a challenge: Pinpoint a specific visual accessibility need you want to address.
  4. Build and innovate: Create a functional and impactful solution during the hackathon. 

Requirements

What to Build

Develop an Accessible Artificial Intelligence Implementation (AAll) using the WhatsAI framework. Your project should aim to enhance visual accessibility for blind and low-vision users. Consider solutions that utilize the Meta Ray-Ban glasses to provide functionalities such as:

  1. Real-time scene description 
  2. Object detection 
  3. Optical Character Recognition (OCR) 
  4. Navigation assistance 
  5. Information retrieval 
  6. Other creative solutions to accessibility challenges

What to Submit

To submit your project, you must provide the following:

  1. A project description (including the problem you addressed and your solution). 
  2. A demo video showcasing your project's functionality. 
  3. A link to your project's code repository (which was forked at from https://github.com/Znasif/HackTemplate at the start of the Hackathon). 
  4. Any relevant documentation or instructions for setup.

Hackathon Sponsors

Prizes

1 non-cash prize
TBD
1 winner

1. Potential cloud credits: (genai credit, hosting credit)
2. Potential technical support for 3 months (weekly 1-hour sessions on progress and guidance)

Devpost Achievements

Submitting to this hackathon could earn you:

Judges

Brandon Biggs

Brandon Biggs
Smith-Kettlewell Eye Research Institute

Venkatesh Potluri

Venkatesh Potluri
University of Michigan

TBD

TBD

Judging Criteria

  • Accessibility Outcome
    Originality of the solution, Accessibility impact potential, Functionality and robustness of the implementation. Ability to be expanded or adapted for future use. Clarity and effectiveness of the project demo and submission materials.

Questions? Email the hackathon manager

Tell your friends

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.