OpenRocky

# OpenRocky

[![Website](https://img.shields.io/badge/Website-openrocky.org-blue)](https://openrocky.org)
[![TestFlight](https://img.shields.io/badge/TestFlight-Join%20Beta-0D96F6?logo=apple&logoColor=white)](https://testflight.apple.com/join/GZtbEpXN)
[![Discord](https://img.shields.io/badge/Discord-Join-5865F2?logo=discord&logoColor=white)](https://discord.gg/SvvsaDA4nE)
[![Telegram](https://img.shields.io/badge/Telegram-@openrocky-26A5E4?logo=telegram&logoColor=white)](https://t.me/openrocky)
[![License](https://img.shields.io/badge/License-Apache%202.0-yellow)](LICENSE)

**Rocky** is a voice-first AI Agent app for iPhone. Not a chat wrapper. Not a Linux container crammed into a phone. Rocky organizes voice interaction, task execution, system bridging, and result review into a native iPhone agent experience.

> **Rocky** is the user-facing product name. **OpenRocky** is the open-source project name — like Chrome vs. Chromium.

<p>
<img src="screenshots/screenshot_ios1.PNG" alt="Screenshot 1" width="200">
<img src="screenshots/screenshot_ios2.PNG" alt="Screenshot 2" width="200">
<img src="screenshots/screenshot_ios3.PNG" alt="Screenshot 3" width="200">
<img src="screenshots/screenshot_ios4.PNG" alt="Screenshot 4" width="200">
</p>

## Features

- **Voice-first** — voice is the primary interface, not a chat list
- **Single-track voice** — OpenAI Realtime is the one voice entry-point; complex, tool-heavy work is offloaded to a back-end Chat agent via `delegate-task`
- **30+ native iOS tools** — contacts, calendar, health, weather, location, reminders, camera, photos, browser, crypto, and more
- **Multi-provider Chat backend** — OpenAI, Anthropic, Gemini, Azure, Groq, xAI, OpenRouter, DeepSeek, Doubao, aiProxy
- **Custom skills** — built-in skills plus user-importable custom skills
- **Local execution** — controlled shell and Python runtime on-device via `ios_system`
- **Characters & Souls** — configurable AI personality and voice

## Architecture

```
User Voice → OpenAI Realtime → ROS Runtime → ┬─ iOS native tools (direct)
                                              └─ delegate-task → Chat agent → tools → result
                                                                         ↓
                                              UI + Voice ←──────────────┘
```

The voice model owns latency-sensitive turns (greetings, weather, timers, simple tools). Anything multi-step or research-y is delegated to a back-end Chat agent so the voice model stays snappy.

**ROS (Rocky OS) Runtime** is the central execution core:

| Module | Description |
|--------|-------------|
| **Sessions** | Conversation and task contexts with state machine management |
| **Tools** | 30+ iOS native bridge services registered in `OpenRockyToolbox` |
| **Skills** | Built-in and custom importable skills via `OpenRockySkillStore` |
| **Voice** | OpenAI Realtime — the single voice entry-point |
| **Sub-agents** | `delegate-task` routes complex work to a Chat back-end agent |
| **Characters & Souls** | Personality and voice configuration |
| **Memory** | Persistent context across sessions |

**Three Execution Layers:**

1. **iOS Native Bridge** — Swift code calling system APIs (contacts, calendar, health, etc.)
2. **AI Tool Layer** — actions dispatched through provider APIs
3. **Local Execution** — controlled shell/Python in sandbox via `ios_system`

**Two-tier provider model:**

- **Realtime Voice** — OpenAI Realtime (`gpt-realtime` family). The single live voice session.
- **Chat Backend** — any of 10 providers (OpenAI, Azure, Anthropic, Gemini, Groq, xAI, OpenRouter, DeepSeek, Doubao, aiProxy). Drives text chat *and* the back-end agent that the voice model delegates to.

## Getting Started

### Try Rocky

Download via [TestFlight](https://testflight.apple.com/join/GZtbEpXN) to try the latest beta on your iPhone.

### Build from Source

See **[DEVELOP.md](DEVELOP.md)** for requirements, build instructions, project structure, and deployment details.

## Related Repositories

| Platform | Repository |
|----------|------------|
| iOS | [openrocky/openrocky](https://github.com/openrocky/openrocky) |
| Android | [openrocky/openrocky_android](https://github.com/openrocky/openrocky_android) |

## Community

- **Discord** — [Join server](https://discord.gg/SvvsaDA4nE)
- **Telegram** — [@openrocky](https://t.me/openrocky)
- **X / Twitter** — [@everettjf](https://x.com/everettjf)
- **WeChat** — Scan to follow for updates

  <img src="wx.png" alt="WeChat" width="150">

## Contributing

Found a bug or have a feature request? [Open an issue](https://github.com/openrocky/openrocky/issues/new). See [DEVELOP.md](DEVELOP.md) to set up your development environment.

## Star History

[![Star History Chart](https://api.star-history.com/svg?repos=openrocky/openrocky&type=Date)](https://star-history.com/#openrocky/openrocky&Date)

## License

Apache 2.0 — see [LICENSE](LICENSE) for details.