ghrepo - ShinyGeminiPro

A Multimodal Google Gemini Pro Chat App Built with R Shiny

By Tolga

ShinyGeminiPro is an interactive R Shiny application that lets you chat with Google’s Gemini Pro multimodal model in real-time. It supports both text prompts and image uploads, allowing you to explore Gemini’s powerful vision capabilities alongside conversational AI—all from a clean, browser-based interface built entirely in R.

Text Chat Screen

Vision Chat Screen

Key Features:

  • Text input for standard chat queries
  • Image upload for multimodal interactions (Gemini Pro Vision)
  • Real-time response generation via the Google Gemini API
  • Chat history displayed in a clear tabular format
  • User-friendly design with examples for text and vision modes

This is one of the first open-source R Shiny apps to integrate Google’s Gemini Pro multimodal model, making it easy for R users to experiment with advanced generative AI without leaving their preferred ecosystem.To run it locally, you’ll need an Google Gemini API key, install the required R packages, and launch the app—perfect for quick prototyping or demos.

Try the live version or check out the code!

View on GitHub View Repository on GitHub

  Try Live Demo on shinyapps.io Try the Live Demo on shinyapps.io

Share: X (Twitter) Facebook LinkedIn