EcoXplorer AR is an augmented reality game that encourages players to explore their environment. Players scan real-world objects related to nature or the environment, triggering short, engaging stories narrated by AI-generated characters. These stories provide educational content about the environment in an entertaining way.
-
Object Recognition
- Utilizes existing AR technology to recognize environmental objects (e.g., trees, plants, recycling bins).
-
AI Storytelling Agent
- Generates short, educational stories about recognized objects.
- Stories include facts, environmental impact, or imaginative tales with educational elements.
-
AI Voice Actor
- Converts generated story text to speech for a more immersive experience.
-
Character System
- Features simple character models (e.g., wise owl, curious squirrel, adventurous leaf) that appear in AR to narrate stories.
- AI voice actor provides different voices for each character.
-
Progress Tracking
- Tracks objects discovered and stories heard.
- Unlocks new character narrators as the player progresses.
-
Image Recognition Endpoint
- Input: Image from AR scan
- Output: Identified object
-
AI Game Storytelling Agent Endpoint
- Input: Identified object
- Output: Short, educational story about the object
-
AI Voice Actor Endpoint
- Input: Generated story text
- Output: Audio file of narrated story
- Player scans an environmental object using their device.
- The image is sent to the Image Recognition Endpoint.
- The identified object is passed to the AI Game Storytelling Agent Endpoint.
- The generated story is sent to the AI Voice Actor Endpoint.
- The game displays an AR character who narrates the story using the generated audio.
- Story Collection: Players can revisit unlocked stories.
- Character Customization: Players can choose their favorite narrator.
- Environmental Challenges: Occasional suggestions for objects to find, encouraging exploration.
- Maintains educational focus while enhancing engagement through storytelling.
- Interactive without relying on quizzes.
- AI-generated content keeps the experience fresh and interesting.
- Modular three-endpoint structure allows for future expansions.
- Leverages existing AR technology while adding new, engaging elements.