Apple Intelligence & Siri Commands

Hands-Free Intelligence

ARMES integrates deeply with Apple's App Intents framework and modern Apple Intelligence schemas. Whether you are driving, cooking, or on the go, you can interact with your AI agents and knowledge base entirely by voice through Siri, or automate workflows using the iOS Shortcuts app.

Shipped Voice Commands

ARMES registers six core App Shortcuts with the operating system upon installation:

1. Spoken AI Queries

"Hey Siri, ask ARMES [your question]"

• Spoken Answer: Siri speaks a concise, conversational answer aloud.
• Visual Snippet Card: A clean snippet card appears on the Siri interface displaying the formatted answer.
• The 4-Second Server Race: To keep voice interactions lightning-fast, ARMES races your query against a 4-second budget. If an agent requires deep reasoning or web research that takes longer than 4 seconds, Siri smoothly informs you: "ARMES is thinking — I'll send you a notification with the answer." When generation completes, a notification lands on your device and opens directly into the thread.

2. Targeting Specific Agents

ARMES synchronizes your installed bots into native BotEntity definitions in the shared iOS container. This allows Siri and Apple Intelligence to understand queries addressed to specific agents:

"Hey Siri, ask ARMES with Deep Research..."
"Hey Siri, ask ARMES with Code Architect..."
"Hey Siri, ask ARMES with Legal Counsel..."

If you do not specify an agent, ARMES automatically routes the query to your configured Default Agent (set in your ARMES profile).

3. Voice Note Dictation

"Hey Siri, take an ARMES note about [topic]"

• Siri prompts you for the note title and content if not provided in the initial command.
• The note is saved immediately into your ARMES Notes knowledge base.
• If you have enabled Spotlight Indexing in Settings → Security, the new note is immediately indexed locally on your device.

4. Finding Notes

"Hey Siri, find my ARMES note about [keyword]"

• Siri opens the ARMES application directly into the Notes knowledge base with your search query pre-populated in the search bar.

5. Starting a Conversation

"Hey Siri, start a new ARMES chat"

• Launches the app directly to a fresh, clean conversation tab.

6. Continuing Where You Left Off

"Hey Siri, continue with ARMES"

• Opens the app and automatically resumes your most recently active conversation thread.

Action Chaining in Shortcuts & Apple Intelligence

Under the hood, ARMES leverages modern App Entities (BotEntity and NoteEntity):

• Structured Output: When CreateArmesNoteIntent runs, it returns a strongly typed NoteEntity containing the note's ID, title, and snippet.
• Workflow Chaining: In the iOS Shortcuts app, you can pass the output of ARMES actions into other apps. For example:
  1. Summarize article with Safari
  2. Create ARMES note with the summary
  3. Send the created note link via Apple Mail or Messages

Secure Headless Authentication

Unlike basic web apps that require launching the browser to authenticate, ARMES Siri commands operate completely headless:

• Your authentication credentials (Firebase refresh token) are securely mirrored to the Apple Keychain (armes_native-firebase-refresh-token).
• When Siri runs a headless background query, native Swift code exchanges the refresh token for a fresh session token in milliseconds.
• Your credentials never leave your device's Secure Enclave, ensuring maximum security and zero-click ease of use.