Build an Image Captioning Tool for Visually Impaired Users with Gemini
1h 8mIntermediate2024-05-29
Authors

Fikayo Adepoju
Technical Writer | Software Developer
Course details
When you’re designing for the web, it’s imperative that your designs are accessible to as many people as possible, and this includes visually impaired users. While there are many tools available to help you in this design task, artificial intelligence is making this easier than ever. In this course, software developer Fikayo Adepoju shows you how to use Google’s Gemini API to build an image caption generator that helps visually impaired users to better experience the web. Get hands-on experience with the Gemini API as Fikayo guides you through the building of the application from start to finish. Learn how to build the interface, connect the backend to Gemini, and then connect the frontend to the API. Whether you’re a developer, data scientist, or just have an interest in AI, join Fikayo to see how the Gemini API can make life easier for both you and your users.
Skills covered
GeminiAccessibilityNeural Networks and Deep LearningDiversity, Equity, and Inclusion (DEI)AI Productivity ToolsGenerative AIUser ExperienceGoogleArtificial Intelligence (AI)Business Software and ToolsOne-Off
Concepts
0. Introduction
- 01 - Image captioning with AI
- 02 - What you should know
- 03 - Who this course is for
1. Setting Up Access to Gemini API
- 04 - Understanding Gemini models
- 05 - Gemini pricing
- 06 - Signing up for an Google AI Studio account
- 07 - Getting your API key
2. Building the Interface
- 08 - Cloning the seed project
- 09 - Project code walkthrough
- 10 - Adding the image upload functionality
- 11 - Adding the prompt functionality
- 12 - Writing the caption display
3. Building the Backend - Connecting to Gemini
- 13 - Building out the Express.js API
- 14 - Configuring the Generative AI SDK
- 15 - Adding routes
- 16 - Setting up file upload functionality
- 17 - Writing the prompt request and response
4. Bringing It All Together
- 18 - Connecting the frontend to the API
- 19 - Adding a progress indicator
- 20 - Using the Web Speech API to read captions
Conclusion
- 21 - Next steps
Related courses
- Prompt to Product in under an Hour: AI Apps with Nano Banana
- AI Workshop: Text-to-Image Generation
- Deep Learning: Image Recognition (2018)
- Machine Learning for iOS Developers
- Advanced SEO: Developing an SEO-Friendly Website
- AR for iOS Developers: RealityKit and Reality Composer
- Introduction to Graphic Design: Photoshop
- Real Estate Photography: Marketing Pricing and Client Relations
Related learn paths
- Build for Digital Accessibility
- A Developer's Guide to Google Gemini
- Develop Your SEO Skills
- Advance Your Skills in Product Photography
- Develop Your Skills with the OpenAI API
- Master Substance Designer and Substance Painter
- Prepare for the CompTIA PenTest+ (PT0-001) Exam
- Building Generative AI Skills for Web Developers