Real-time on-device text-to-image and image-to-image Semantic Search with video stream camera capture using USearch & UForm AI Swift SDKs for Apple devices 🍏
Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.
Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels
Code for High-Capacity Expert Binary Networks (ICLR 2021).
Experimental Android app designed to showcase Android's Built In on-device AI. Utilises the Gen-AI Prompt API to interface locally with Google's Gemini Nano model, featuring a modern architecture built entirely in Kotlin and Jetpack Compose.
Privacy first Android music player & recommender with on-device ML and YouTube Music support.
A Mac OS menu bar utility that runs on-device Computer Vision models for simple, fun tasks
On-device AI framework inspired by LangChain, purpose-built for mobile. Build, compose, and extend AI features using platform-native models — all processing happens locally on the device.
[SenSys '26] PELM: Power Efficient On-Device LLM Inference with Speculative Decoding and Dynamic Voltage Frequency Scaling
It's an embodiment of Kanha (Krishna), in your mobile applications, to gain knopwledge about Gita, and talk directly to the image of Kanha himself.
subMFL: Compatible subModel Generation for Federated Learning in Device Heterogeneous Environment
SerenAI is a self-hosted AI chatbot platform that turns your documents into intelligent conversational assistants. Upload PDFs, Word docs, or text files—and instantly create chatbots that can answer questions about your content using RAG (Retrieval-Augmented Generation).
Android LocalAI is an Android application that allows you to use generative AI models locally or remotely via APIs. This project is designed to be flexible, secure, and easy to configure.
A local-first, privacy-respecting AI study companion
Flutter based Photo Gallery Mobile App offering auto suggestions for deleting non-essential images on the device
Example desktop app for running ai models without internet
On-device DLP security for AI prompts and file uploads. Scan, mask, warn, or block sensitive data before it reaches AI tools.
BlackwellGPT uses a cloud or on-device large language model (Llama 2) to increase the accessibility of basic medical information even in areas with limited internet connectivity.
To associate your repository with the ondeviceai topic, visit your repo's landing page and select "manage topics."