> ## Documentation Index
> Fetch the complete documentation index at: https://geniex.aihub.qualcomm.com/llms.txt
> Use this file to discover all available pages before exploring further.

# What is GenieX

> On-device AI inference runtime for Qualcomm Snapdragon — run frontier LLMs and VLMs across CLI, Python, Android, and Docker.

GenieX is an on-device Gen AI inference runtime built for Qualcomm platforms. It is the easiest way to run frontier language and vision-language models locally on Hexagon NPU, Adreno GPU, or CPU with a few lines of code. It is the community version of Qualcomm GENIE.

> [!NOTE]
>
> **GenieX is in developer preview.** We'd love your feedback — [open an issue](https://github.com/qualcomm/GenieX/issues) or [join Slack](https://aihub.qualcomm.com/community/slack).

## **Architecture**

![GenieX architecture stack: CLI, Python API, Java API, Docker, and Serve interfaces sit on the GenieX SDK, which dispatches to the llama.cpp runtime (GGML over CPU/GPU/HTP kernels) or the Qualcomm AI Engine Direct runtime on NPU. Targets Windows, Android, and Linux.](https://mintcdn.com/qualcomm-0801e48b/ewrmU9zMnfZyH0O6/Mintlify-image/geniex_arch_v2.png?fit=max\&auto=format\&n=ewrmU9zMnfZyH0O6\&q=85\&s=332ac0c099324f4820ddb8581c67cd68)

GenieX exposes **five entry points**, all over a single SDK:

* **CLI** — run and serve models straight from the terminal.
* **Python** — embed inference in your apps with the Python SDK.
* **Java/Kotlin** — the Android SDK for on-device mobile apps.
* **Docker** — a containerized image for reproducible deployments.
* **OpenAI-compatible server** — a drop-in local server for existing OpenAI clients.

Under the hood, that SDK dispatches to either the **llama.cpp runtime** (GGML kernels for CPU / GPU / Hexagon HTP) or the **[Qualcomm® AI Engine Direct](https://www.qualcomm.com/developer/software/qualcomm-ai-engine-direct-sdk) runtime** (NPU-only). The same SDK runs on Windows ARM64, Android, and Linux ARM64.

> [!NOTE]
>
> **Qualcomm AI Engine Direct** is the official name of what is also known as the *Qualcomm AI Engine Direct SDK*, *Qualcomm AI Runtime*, and *QAIRT*. Throughout these docs we use the official name.

## **Why two runtimes?**

So you get both **broad model coverage** and **optimal performance** in one stack:

* **Most models just work** — point GenieX at almost any GGUF on Hugging Face and it runs on CPU / GPU / NPU via llama.cpp.
* **Qualcomm® AI Hub Models run optimally** — models published to [Qualcomm AI Hub](https://aihub.qualcomm.com/) are pre-compiled per chipset and run through Qualcomm AI Engine Direct on the Hexagon NPU for peak on-device performance.

See [Platforms & runtimes](https://geniex.aihub.qualcomm.com/en/get-started/platforms.md#geniex-runtimes) for when to pick which.

## **What you can do with GenieX**

* **Run models locally** on Snapdragon X (Windows ARM64), Snapdragon 8 Elite (Android), and Dragonwing IoT chipsets.
* **Pick a runtime** — `llama.cpp` for any community GGUF model, Qualcomm AI Engine Direct (`qairt`) for Qualcomm AI Hub pre-compiled NPU bundles.
* **Build apps** through the CLI, an OpenAI-compatible local server, the Python SDK, the Android SDK, or a Docker image.

## **Pick where to start**

> [card] [Quickstart](https://geniex.aihub.qualcomm.com/en/get-started/quickstart.md)
>
> Choose your interface and get to first inference in minutes.

> [card] [Platforms & runtimes](https://geniex.aihub.qualcomm.com/en/get-started/platforms.md)
>
> Snapdragon platforms GenieX supports, and when to pick llama.cpp vs Qualcomm AI Engine Direct.

> [card] [Models](https://geniex.aihub.qualcomm.com/en/models/supported.md)
>
> Tested LLMs and VLMs across the llama.cpp and Qualcomm AI Engine Direct runtimes.

## **Community**

> [card] [Report an issue](https://github.com/qualcomm/GenieX/issues)
>
> File a bug, request a feature, or browse open issues on GitHub.

> [card] [Join Slack](https://aihub.qualcomm.com/community/slack)
>
> Collaborate with the GenieX team and other developers.

## **Legal**

> [card] [License](https://github.com/qualcomm/GenieX/blob/main/LICENSE)
>
> GenieX is released under the BSD 3-Clause License.

> [card] [Terms of Use](https://www.qualcomm.com/site/terms-of-use)
>
> Qualcomm site terms of use.

Was this page helpful?

![Thumbs up](https://mintcdn.com/qualcomm-0801e48b/VijZ6eXFSGIGNc9Z/Images/FeedBack/thumbs-up.svg?fit=max\&auto=format\&n=VijZ6eXFSGIGNc9Z\&q=85\&s=9fa1e132909ee8667d02f775cd8bc108)

Yes

![Thumbs down](https://mintcdn.com/qualcomm-0801e48b/VijZ6eXFSGIGNc9Z/Images/FeedBack/thumbs-down.svg?fit=max\&auto=format\&n=VijZ6eXFSGIGNc9Z\&q=85\&s=7f5f8865b502b5262849a700e6989278)

No


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.