Introduction
ServiceNow has redefined itself as the "AI control tower for business reinvention," unveiling updates at its Knowledge event. This guide walks you through implementing these advanced capabilities in your organization. By the end, you’ll have a step-by-step plan to leverage the AI Control Tower, integrate with major cloud providers, connect AI agents via the Action Fabric, gain observability with Traceloop, deploy autonomous workforce agents across IT, CRM, employee services, and security, and finally roll out the unified EmployeeWorks portal with the Otto AI assistant. Follow these steps to modernize your workflow management and drive enterprise reinvention.
What You Need
- A current ServiceNow subscription with platform access (Washington DC release or later recommended)
- Administrator credentials to configure integrations and install plugins
- API keys or service accounts for Azure, AWS, GCP, and any other LLM providers you plan to connect
- Access to third-party applications (SAP, Oracle, Workday) if integrating control
- An understanding of your current agentic workflows and non-human identities
- A test environment before production deployment
Step-by-Step Guide
Step 1: Assess Your Current Governance and Identity Landscape
Before diving into new integrations, evaluate what you already have. Review existing AI agents, cloud services, OT (operational technology) devices, and IoT endpoints. Identify non-human identities like service accounts and connected devices that currently lack centralized governance. This assessment will form the foundation for the AI Control Tower's discovery capabilities.
Step 2: Integrate AI Control Tower with Major Cloud and LLM Providers
ServiceNow’s AI Control Tower (introduced at last year’s Knowledge event) now supports integrations with Microsoft Azure, AWS, Google Cloud Platform, and additional LLM providers beyond OpenAI and Anthropic. To set this up:
- Navigate to the AI Control Tower plugin in your ServiceNow instance (activate it if not already).
- Add each cloud provider by providing necessary API credentials and configuration endpoints.
- Connect enterprise applications such as SAP, Oracle, and Workday, enabling cross-platform governance.
- Enable the discovery module to automatically find non-human identities and connected devices, bringing OT and IoT under the same oversight as AI agents and cloud services.
- Test connectivity in a sandbox before rolling out to production.
Step 3: Connect AI Agents via the Action Fabric and MCP Server
ServiceNow Action Fabric opens your platform to any AI agent, regardless of origin. It uses a Model Context Protocol (MCP) server to standardize interactions. To implement:
- Install the Action Fabric plugin from the ServiceNow Store.
- Configure the MCP server endpoint and define the context schema for agents.
- Integrate both ServiceNow-native agents (e.g., from the Autonomous Workforce) and third-party agents by providing API endpoints.
- Test agent communication and routing using the Action Fabric logs.
Step 4: Establish Observability and Compliance with Traceloop
Thanks to the acquisition of Traceloop, you now gain runtime observability into agent behavior – crucial for debugging and compliance. Follow these steps:
- Enable Traceloop integration in your instance (available under AI Control Tower settings).
- Configure detailed tracing for each agent, including input/output, latency, and error logs.
- Activate one or more of the five new risk frameworks aligned with NIST and EU AI Act standards. These provide compliance controls and reporting.
- Set up alerts for anomalous agent behavior or policy violations.
- Review dashboards regularly to refine agent performance.
Step 5: Deploy Autonomous Workforce Agents
ServiceNow’s Autonomous Workforce expands from a single L1 IT service desk agent to multiple specialist “AI teammates.” Deploy them in phases:
- IT cohort: Activate agents for AIOps (anomaly detection, event correlation, remediation), site reliability engineering (incident triage, postmortems), asset lifecycle management, and portfolio planning.
- CRM cohort: Enable agents for sales qualification, quoting, order fulfillment, invoice dispute management, and service/renewal.
- Employee services cohort: Deploy AI specialists acting as digital employees for HR, workplace services, legal, finance, procurement, supplier management, and health & safety.
- Security & Risk cohort: Activate agents that scan the threat landscape, find vulnerabilities, and assess third-party vendor risk.
- Set up EmployeeWorks portal, integrating it with existing HR, IT, and facilities systems.
- Enable Otto in the platform – it works across the entire enterprise, not just a single app. Configure Otto to understand intents, route work to the right agent (human or AI), and execute tasks to completion.
- Customize Otto’s knowledge base and conversational flows for your organization’s domain.
- Train employees to use the unified portal and Otto via help documentation or short demos.
- Monitor adoption and continually refine routing rules.
- Start small: Pilot one AI agent cohort (e.g., IT service desk) before expanding to CRM and security.
- Governance first: Ensure the AI Control Tower is fully deployed and monitoring before introducing many agents; this prevents chaos.
- Align with standards: Activate NIST/EU compliance frameworks early to avoid retrofitting.
- Human-AI collaboration: Design workflows where AI handles repetitive tasks and humans handle exceptions – clearly define escalation paths.
- Monitor costs: Integration with multiple LLM providers can increase API usage; set usage limits and monitor via Control Tower dashboards.
- Security validation: Regularly audit non-human identities and agent behaviors using Traceloop logs.
- Employee communication: Announce the new EmployeeWorks portal and Otto assistant with clear benefits – improved self-service, faster resolution.
- Iterate: Use observability data to fine-tune agent policies and expand to new areas like supply chain or finance.
For each agent, define its scope, permissions, and escalate to human workers as needed. Train staff on how to collaborate with these “teammates.”
Step 6: Implement EmployeeWorks and Introduce Otto AI Assistant
ServiceNow EmployeeWorks serves as the conversational front door for the enterprise. Now generally available, it unifies self-service and support. Complement it with Otto, the new AI assistant that merges Now Assist, Moveworks, and AI Experience. To roll out: