ZenPass

Demo

About

ZenPass is a next-generation POAP (Proof of Attendance Protocol) platform that transforms event participation into a dynamic, interactive digital experience. By combining geo-fencing, augmented reality (AR), AI-Agent powered booth recognition, and multi-chain support via NodIt, CCIP/Chainlink, ZenPass enables attendees to collect unique, branded POAPs that serve as verifiable proof of their participation—minted on the ideal blockchain network based on the intent.

How it's made

**ZenPass** is a full-stack, geo-fenced, AR-powered, multichain POAP platform designed for real-world event engagement. It bridges Web3, AI, and immersive experiences by combining various bleeding-edge tools and protocols. --- ## 🔧 Core Tech Stack - **Frontend**: Built using **React**, **TailwindCSS**, and **TypeScript** for responsive, strongly-typed UI components. We also use **React Fibre** and **Three.js** to render dynamic AR overlays in the browser. - **AI Booth Recognition**: The camera captures booth banners which are sent to a lightweight vision model hosted via **Replicate** (or local fallback inference). The model identifies which booth the user is facing (e.g., “Nodit”, “Polygon” or "World-Coin"). - **Geo-Fencing**: Browser-based Geolocation API ensures the user is within the defined event zone before proceeding with any interaction. We use GPS radius checks around event coordinates. - **Stylized Image Generation for Social Sharing**: Post-interaction, we pass the booth snapshot through a style transfer pipeline (e.g., Ghibli or pixel-art GAN). The output is cached and offered as a shareable image, ideal for socials. --- ## 🌉 Smart Contract + Blockchain Infra - **Source Chain (Mint Trigger)**: A smart contract is deployed on **Base Sepolia**. Once AI + geo verification is done, the mint function is triggered here. - **Ai MultiChain POAP Minting using Intents**: **Chainlink CCIP** handles the secure routing of mint instructions to the appropriate destination chain (e.g., Polygon). This ensures that POAPs are minted natively on the brand’s chain of choice. - **POAP Contracts**: These live on the target chain and handle minting of NFTs that include: - Booth identifier - Geo-coordinates - Stylized image (stored via IPFS) --- ## 🔔 Nodit Protocol Integration - **Webhook Notifications**: We integrate **Nodit Webhooks** to notify users in real-time when their POAP mint is successful—this includes toast messages and push notifications. - **Web3 Data APIs**: Nodit’s APIs power the user dashboard, showing a list of collected POAPs including metadata (location, style, event name). This enables a dynamic profile experience. --- ## 🧪 Hacky But Cool - We used a **base64-encoded visual classifier** prompt to switch between on-device and cloud AI recognition, reducing latency while retaining flexibility. - All validations (AR + Geo + AI) are performed **off-chain**, and only the validated payload is submitted on-chain—cutting gas costs and failures. - The image stylizer uses a **cascaded two-model pipeline** (scene simplifier → pixel-art / Ghibli style) to generate ready-to-share art in ~2-3s. --- ## 🤝 Partner Tech Benefits - **MultiChain with Polygon**: Abstracted away cross-chain logic, allowing us to focus on UX without sacrificing decentralization. - **Nodit Protocol**: Supercharged notifications and data sync. No need to roll our own infra for real-time alerts or historical POAP tracking. - **World ID Integration**: Used at the app level as **proof of personhood**, ensuring that only unique human users can mint POAPs. This added a Sybil-resistant layer of trust to our AR-based, real-world engagement flow. ---