Lokendra Singh.
← ALL PROJECTS

Enterprise GenAI · Customer Operations

CygnusAlpha

Multi-tenant GenAI platform: RAG and multi-agent automation for enterprise customer operations on chat, email, social, voice bots and automated follow-up calls.

TEAM LEADDjangoFastAPILangGraphKafkaPineconeRedis

10,000+concurrent requests
<200 msp95 latency
60%faster support response
Client
Enterprise clients incl. Badho.in and Ferns N Petals
Domain
AI customer support
My role
Led the platform
01

The problem

  1. Repetitive, expensive supportMost tickets were routine status questions, handled one by one by human agents.
    FixAI agents answer routine questions on every channel, including voice bots and automated follow-up calls.
  2. Answers live in other systemsOrder status, balances and account details sit in CRMs and internal APIs, not in documents.
    FixAgents read live data from each client's CRM and order systems.
  3. Acting safely, not just talkingLetting AI change records is only acceptable if every action passes the rules a human would.
    FixA short list of allowed actions, each checked against the client's business rules.
  4. One platform, many clientsEach client needs its own data, prompts and limits on shared infrastructure that holds up under load.
    FixOne multi-tenant core: per-client data, prompts and limits on an event-driven backbone.
02

How it works

Chat · WhatsApp Chat · WhatsApp Voice call Voice call SupportTenant A · AI agentagent trace · tenant A Where is my order?✓✓ read Out for delivery,arriving today.AI agent · just now ✓ Answered in seconds 1.0sRECEIVEWhatsApp messagetenant A 1.6sGUARDRAILSpassed ✓input checked 2.2sCLASSIFYorder statusintent 2.9sROUTER→ Router agentLangGraph 3.5sTOOLorder lookupread-only · CRM 4.1sRESULTout for deliveryfrom CRM 4.7sRULESpassed ✓nothing to write 5.3sRESPONDreply sentWhatsApp ✓ answered in seconds, without a human agent Voice callTenant C · voice agent00:42agent trace · tenant C · voice Upgrade my plancustomer · speaking Done, your plan isupgraded from today.voice agent · spoken 1.0sRECEIVEvoice calltenant C 1.6sSPEECH→TEXT“Upgrade my plan”transcribed 2.2sGUARDRAILSpassed ✓input checked 2.9sCLASSIFYplan upgradeintent 3.5sROUTER→ Action agentLangGraph 4.1sTOOLupdate planwrite · CRM 4.7sRULESallowed ✓business rules 5.3sTEXT→SPEECHreply spokenvoice ✓ handled on the call, with a rule-checked change Chat · WhatsApp Chat · WhatsApp Voice call Voice call SupportTenant A · AI agentagent trace · tenant A Where is my order?✓✓ read Out for delivery,arriving today.AI agent · just now ✓ Answered in seconds 1.0sRECEIVEWhatsApp message 1.6sGUARDRAILSpassed ✓ 2.2sCLASSIFYorder status 2.9sROUTER→ Router agent 3.5sTOOLorder lookup 4.1sRESULTout for delivery 4.7sRULESpassed ✓ 5.3sRESPONDreply sent ✓ answered in seconds, without a human agent Voice callTenant C · voice agent00:42agent trace · tenant C · voice Upgrade my plancustomer · speaking Done, your plan isupgraded from today.voice agent · spoken 1.0sRECEIVEvoice call 1.6sSPEECH→TEXT“Upgrade my plan” 2.2sGUARDRAILSpassed ✓ 2.9sCLASSIFYplan upgrade 3.5sROUTER→ Action agent 4.1sTOOLupdate plan 4.7sRULESallowed ✓ 5.3sTEXT→SPEECHreply spoken ✓ handled on the call, with a rule-checked change
How a request flows
  1. 01A tenant's customer writes on WhatsApp, email or social and reaches that tenant's own agent; voice calls and follow-up calls go to a separate voice agent.
  2. 02The agent hands it to the tenant's workflow: receive, guardrails, classify, fetch, rule check, respond.
  3. 03The workflow calls the agents on the LangGraph runtime (Router, Knowledge, Action), which read and write the data stores and the client's tools.
  4. 04The answer or a rule-checked action goes back; hard cases go to a person, follow-up calls go out automatically.
03

The agents

Each request is handled by a small team of agents. Every agent gets only the tools its job needs, and only Action can write.

  • Router

    Reads the request and picks the right agent.

    no tools, routes onlyNO TOOLS
    e.g. "refund" goes to the Action agent
  • Knowledge

    Answers from the client's own content, with retrieval.

    search client contentREAD-ONLY
    e.g. A return-policy question
  • Live data

    Reads the client's CRM and order systems, read-only.

    order lookupREAD-ONLYaccount lookupREAD-ONLY
    e.g. "Where is my order?"
  • Action

    Takes only allowed actions, each checked by business rules.

    create ticketWRITE · RULE-CHECKEDupdate recordWRITE · RULE-CHECKED
    e.g. Raises a support ticket
  • Voice

    Voice bots answer calls, and automated follow-up calls go out, on the same agents.

    speech in and outVOICEfollow-up callsVOICEsame tools as chatREAD-ONLY
    e.g. An automatic follow-up call
  • Hand-off

    Passes hard cases to a person, with full context.

    human queueWITH CONTEXT
    e.g. A disputed refund
03

Key insight

An AI assistant becomes production-ready when it is allowed to do less: a short list of actions, every one checked by rules it cannot override.
Allowed
  • order lookup
  • create ticket
  • update record
Not allowed
  • any refund
  • delete data
  • change prices
Business rulescheck every action; the AI cannot override them
Production-readysafe to run for real clients
Lokendra Singh · Team lead, CygnusAlpha
04

The hard parts

  • AI that changes data. Every change is checked against the client's business rules.
  • Production, not a demo. High load, many clients, strict uptime, all at once.
  • Quality over time. Changes are evaluated locally before reaching a client.
  • The trade-off. Two vector stores - Pinecone for the managed production path, ChromaDB for local iteration and evals - some duplication in exchange for not running vector infrastructure ourselves.
05

My part

I led the platform: the event-driven service architecture, the RAG and multi-agent pipelines, and taking it to production for 5+ enterprise clients on a 99.9% uptime SLA.

06

What I took away

  1. Give an assistant a short list of allowed actions, not open access.
  2. Keep business rules where the model can't override them.
  3. The cheapest regression is the one a client never sees.

Want the detail behind the numbers - architecture, failure modes, what I’d change? Happy to walk through it.

Talk about this project →