AI Assistant: Voice Widget

Embed an AI voice assistant widget for real-time business automation.

AI Assistant — Voice Module

The AI Assistant Voice Module embeds an ElevenLabs conversational voice agent inside Taskyy. It answers calls, qualifies leads, books appointments, and pulls live CRM context—all without a human operator on the line.

What This Feature Does

  • Embeds an ElevenLabs voice widget in Taskyy (desktop and mobile).
  • Answers inbound calls on your Taskyy phone numbers (via Phone System plugin).
  • Accesses live CRM context: company profile, open leads, upcoming appointments, active tasks.
  • Qualifies callers: new lead vs. existing client, service type, urgency, preferred time.
  • Books appointments directly into your Calendar (creates event, invites client, notifies crew).
  • Transfers to human with full context summary when needed.
  • Logs call recording, transcript, and outcome in Unified Inbox.

When To Use It

  • You want 24/7 phone coverage without staffing nights/weekends.
  • You miss calls during busy install days.
  • You want consistent qualification on every inbound call.
  • You need multilingual support (Spanish, etc.) without bilingual staff.

Prerequisites

  • Taskyy addon: AI Assistant Bundle.
  • ElevenLabs account with Conversational AI enabled (API key entered in Admin → AI Assistant → Voice).
  • At least one Telnyx number provisioned in Phone System plugin.
  • Call forwarding configured: inbound calls → ElevenLabs SIP trunk (auto-configured on enable).

Setup Checklist

  1. Open AI Assistant → Voice plugin.
  2. Enter ElevenLabs API Key and Agent ID.
  3. Select which Taskyy phone numbers use the voice agent.
  4. Configure Business Context (auto-filled from Company Profile):
    • Company name, tagline, services, service area.
    • Hours, emergency policy, licensing info.
  5. Set Qualification Questions (customize per trade):
    • "What type of service do you need?"
    • "Is this an emergency or scheduled work?"
    • "What's the property address/zip?"
    • "Preferred day/time?"
  6. Define Transfer Rules:
    • Emergency → ring on-call tech immediately.
    • Existing client with open ticket → transfer to assigned PM.
    • New lead qualified → book appointment, send confirmation SMS.
    • Unqualified/Spam → polite close, log only.
  7. Test: call your business number from a test phone; verify flow.

Voice Agent Capabilities

Live CRM Reads (Client Tools)

The agent can invoke blocking client tools during the call:

  • get_current_user → knows who's logged in (if called from app).
  • get_upcoming_events → sees next 7 days of appointments.
  • get_open_tasks → knows active jobs for context.
  • search_clients → finds existing client by name/phone/email.
  • search_leads → finds lead by name/phone/email.

Business Context Injection

On session start, the agent receives dynamic variables:

  • company_name, company_tagline, services_list, service_area.
  • business_phone_numbers (array of Telnyx numbers).
  • recent_leads_count, open_tasks_count, upcoming_appointments_count.
  • openapi_discovery_url → agent can discover other API endpoints.

Actions The Agent Can Take

  • Book Appointment: creates Calendar event with client, service, crew, duration.
  • Create Lead: captures name, phone, email, service, urgency, address, notes.
  • Send SMS Confirmation: triggers confirmation text with appointment details.
  • Transfer to Human: warm transfer with spoken summary + SIP header context.
  • End Call Politely: logs outcome, records transcript.

Call Flow Example

Caller dials 555-123-4567
    → ElevenLabs answers: "Thanks for calling Acme Roofing. Are you calling about a new project, an existing job, or something else?"
    → Caller: "I have a leak, it's urgent."
    → Agent: "Sorry to hear that. What's the address?"
    → Caller gives address.
    → Agent: "Got it. I see you're in our service area. Can I get your name and best callback number?"
    → Caller provides info.
    → Agent: "Thanks. I'm booking an emergency visit for today at 2 PM. You'll get a text confirmation. Is that good?"
    → Caller confirms.
    → Agent creates Calendar event, sends SMS, logs Lead.
    → Call ends. Transcript + recording in Communications.

Embedded Widget (In-App)

  • Available in Taskyy header (phone icon) for logged-in users.
  • Click to start a voice session—useful for:
    • Quick CRM queries: "What's my next appointment?"
    • Hands-free note-taking: "Add note to Smith job: client wants darker shingles."
    • Booking while driving: "Schedule follow-up for Johnson next Tuesday 10 AM."
  • Uses same ElevenLabs agent with your CRM context.

Admin Observability

  • Voice Call Log (Admin → AI Assistant → Voice Log):
    • Call SID, from/to, duration, outcome (booked, transferred, closed, failed).
    • Transcript (searchable), recording playback.
    • Classification: new lead, existing client, support, spam.
  • Metrics: calls/day, booking rate, transfer rate, avg handle time, containment rate (no transfer).

Best Practices

  • Keep qualification questions to 3–4 max; callers drop off after 60 seconds.
  • Use "emergency" keyword to trigger immediate on-call ring group.
  • Record a custom greeting in your voice (ElevenLabs voice cloning).
  • Review transcripts weekly; flag misclassifications for retraining.
  • Set up Slack/Discord alerts for "Emergency" and "Transfer" outcomes.

Common Issues And Fixes

Agent Doesn't Know My Calendar

  • Verify get_upcoming_events tool is enabled in ElevenLabs agent config.
  • Check user has Calendar permission in Taskyy.

Calls Not Reaching Agent

  • Confirm Telnyx number has "Voice" capability enabled.
  • Check SIP trunk status in ElevenLabs dashboard.
  • Test with a direct call to the ElevenLabs SIP URI.

Transcript Missing / Recording Failed

  • ElevenLabs plan must include recording storage.
  • Check webhook delivery: https://api.taskyy.io/webhooks/elevenlabs-voice.
  • Retention: 90 days default; adjust in ElevenLabs settings.

Widget Not Loading In App

  • Ensure VITE_ELEVENLABS_AGENT_ID is set in frontend env.
  • Check browser console for CORS or CSP errors.
  • User must have ai_assistant:voice permission (role-based).

Compliance Notes

  • TCPA: Agent only handles inbound calls; no outbound autodial.
  • Recording Consent: Play "This call may be recorded" greeting (configurable).
  • Data Retention: Transcripts/recordings follow your Taskyy data policy (default 1 year).
  • HIPAA: Not HIPAA-compliant by default; enable BAA with ElevenLabs if needed.

SEO Context

This page aligns with contractor software, contractor management software, and contractor CRM keywords for AI-powered phone automation workflows.

Related Docs

  • Phone System & Call Routing: /docs/plugin-phone-system
  • Calendar & Job Scheduling: /docs/core-calendar
  • Lead Management & CRM: /docs/core-leads
  • AI Assistant Email Module: /docs/plugin-ai-assistant-email
  • AI Assistant SMS Module: /docs/plugin-ai-assistant-sms

Last updated: 2026-07-19