What's Built-in AI
Built-in AI is a cutting-edge technology designed to integrate powerful AI models directly into browsers, allowing web applications to perform AI-driven tasks locally. This approach enhances privacy by processing data on the client side and improves performance by reducing latency. Built-in AI is particularly beneficial for implementing large language models (LLMs) like Gemini Nano, which can run efficiently on modern desktop and laptop computers.
Benefits of Built-in AI
For Web Developers
- Ease of Deployment: The browser distributes and updates AI models, reducing the burden on developers to manage large model downloads and updates.
- Hardware Acceleration: Optimized for various hardware, including GPUs and NPUs, ensuring optimal performance across devices.
For Users
- Privacy: Local processing of sensitive data enhances privacy through end-to-end encryption.
- User Experience: Eliminating server round trips can offer near-instant results, improving user satisfaction.
- Offline Access: Users can access AI features without an internet connection, ensuring functionality in offline or variable connectivity scenarios.
How to Use Built-in AI
Client-side and Server-side Integration
- Hybrid Approach: Utilize client-side AI for straightforward tasks and server-side AI for complex use cases. This approach ensures resilience and a graceful fallback when client-side capabilities are limited.
Browser Architecture and APIs
- Task APIs: Access built-in AI capabilities with APIs like Translator and Summarizer, designed for efficient on-device execution.
- Exploratory APIs: Experiment with APIs like the Prompt API to explore additional use cases and improve model performance through techniques like LoRA.
When to Use Built-in AI
Built-in AI is ideal for enhancing both content consumption and creation on the web. It can be used for summarization, translation, writing assistance, and more, providing a seamless AI-powered experience directly within the browser.