0rbit
0rbit is a Web3 platform that combines AI image editing with blockchain tokenization.
About
0rbit is a decentralized image editing and AI token generation platform that combines Web3 technology with AI-powered creative tools. Users can upload images, enhance them with AI processing, generate meme token metadata, and mint intelligent NFTs while maintaining full provenance and creator ownership. Key Features: AI-powered image editing and enhancement Automatic meme token generation with AI-created metadata NFT minting with on-chain provenance Decentralized storage via IPFS/Lighthouse Web3 wallet integration Creator XP tracking system Tech Stack: Next.js 14 with TypeScript Smart contracts on Ethereum Fluence integration for secure AI processing 0G Labs infrastructure for compute and storage IPFS for decentralized file storage The platform serves as a bridge between traditional image editing and Web3, allowing creators to monetize their work through tokenization while maintaining the security and decentralization benefits of blockchain technology.
How it's made
# How It's Made ## Architecture Overview **0rbit** is built as a full-stack Web3 application that integrates decentralized infrastructure with traditional web technologies. The platform uses Next.js for the frontend, smart contracts for blockchain logic, and multiple decentralized services for processing and storage. ## Core Technology Stack ### Frontend & Backend - **Next.js 14** with App Router for server-side rendering and API routes - **TypeScript** for type safety across the entire application - **Tailwind CSS** + **shadcn/ui** for modern, responsive design - **React** with custom hooks for state management ### Web3 Integration - **Wagmi** + **Viem** for Ethereum interactions - **WalletConnect** for multi-wallet support - **Custom smart contracts** for NFT minting and token generation ### Decentralized Infrastructure - **Fluence** for secure AI processing (VM ID: `01998e2a-a8a5-7643-af46-1fdf20afd01c`) - **Lighthouse** for IPFS storage and file management - **0G Labs** for compute and storage primitives ## The Complete Pipeline ### 1. Image Upload & Processing **Image Normalization**: Custom algorithm that standardizes images across different formats (RAW, JPEG, PNG) **EXIF Extraction**: Uses `exifreader` library to extract camera metadata, GPS data, and editing history **XMP Sidecar Generation**: Creates XML metadata files that track every edit operation for audit trails ### 2. AI Processing via Fluence **Why Fluence?** - **Security**: API keys never exposed to frontend clients - **Decentralization**: Distributed AI processing across multiple nodes - **Reliability**: Fault-tolerant network with automatic failover - **Privacy**: User data processed through decentralized network ### 3. AI Token Generation Pipeline **AI Processing Steps:** 1. **Image Analysis**: AI examines the uploaded image for visual elements, style, and content 2. **Metadata Generation**: Creates creative token name, symbol, description 3. **Social Links**: Generates relevant Twitter, Telegram, and website suggestions 4. **JSON Parsing**: Extracts structured data from AI response ### 4. Decentralized Storage with Lighthouse **Storage Strategy:** - **Original Images**: Stored on IPFS with permanent links - **Edited Versions**: Each edit creates new IPFS entry - **XMP Sidecars**: Metadata files linked to original assets - **Audit Trails**: Complete history of all operations ### 5. Smart Contract Integration **Blockchain Logic:** - **NFT Minting**: Each creation becomes a unique NFT - **Provenance Tracking**: On-chain record of creator and timestamp - **Metadata Storage**: IPFS hashes stored on-chain - **Royalty System**: Built-in creator royalties ### 6. 0G Labs Integration **0G Labs Benefits:** - **Verifiable Compute**: AI operations with cryptographic proofs - **Decentralized Storage**: Permanent, censorship-resistant storage - **INFT Support**: Intelligent NFTs with dynamic behaviors - **Audit Trails**: Immutable records of all operations ## Manual Editing Features **Editing Capabilities:** - **Real-time Preview**: Live editing with instant feedback - **Edit History**: Complete undo/redo functionality - **XMP Tracking**: Every edit recorded in metadata - **Batch Operations**: Multiple edits in sequence ## Hacky Solutions & Notable Implementations ### 1. Base64 Image Processing Efficient base64 handling for large images with compression for API calls ### 2. XMP Sidecar Generation Custom XMP metadata tracking that records every edit operation with timestamps and parameters ### 3. Fluence Integration Hack Direct endpoint routing through Fluence network, bypassing OpenAI's servers entirely for better security and performance ## Partner Technology Benefits ### Fluence Network - **Decentralized AI**: No single point of failure - **Privacy**: User data never leaves decentralized network - **Cost**: Lower processing costs than centralized providers - **Reliability**: Distributed processing with automatic failover ### Lighthouse IPFS - **Permanent Storage**: Files stored permanently on IPFS - **Fast Retrieval**: Optimized for web applications - **Metadata Support**: Rich metadata and search capabilities - **Cost Effective**: Affordable decentralized storage ### 0G Labs - **Verifiable Compute**: Cryptographic proofs of AI operations - **Decentralized Storage**: Censorship-resistant asset storage - **INFT Support**: Intelligent NFTs with dynamic behaviors - **Audit Trails**: Immutable records of all operations ## Performance Optimizations ### 1. Image Compression Smart image compression for API calls while maintaining quality ### 2. Lazy Loading Lazy load images and components for better performance ### 3. Caching Strategy Cache AI responses and IPFS data for faster retrieval ## Security Measures ### 1. API Key Protection - **Server-side Only**: API keys never exposed to frontend - **Fluence Routing**: All AI requests go through decentralized network - **Environment Variables**: Secure key management ### 2. Data Privacy - **Local Processing**: Images processed locally before upload - **Encrypted Storage**: All data encrypted before IPFS storage - **Audit Trails**: Complete transparency of all operations ## Notable Technical Achievements ### 1. Seamless Web3 Integration The platform successfully bridges traditional web development with Web3 technologies, making blockchain interactions feel native to users. ### 2. Decentralized AI Processing By routing AI requests through Fluence, we've created a truly decentralized AI processing pipeline that maintains privacy and security. ### 3. Comprehensive Metadata Tracking The XMP sidecar system creates a complete audit trail of every edit operation, ensuring full provenance and transparency. ### 4. Cost-Effective Storage By combining IPFS with 0G Labs storage, we've created a cost-effective, permanent storage solution that scales with the platform. This architecture creates a robust, decentralized platform that maintains the user experience of traditional web applications while providing the security, transparency, and ownership benefits of Web3 technology.