Resource

SIGNALS

Unified signals view with chatbot analytics, website health, API reliability, and compliance posture in one public command surface.

Group

KPIs

Executive KPIs for platform performance, service outcomes, and delivery posture.

+0.06%

API Availability

99.98%

-114ms

P95 Latency

812ms

-12

Open Compliance Issues

54

+2.7%

AI Answer Quality

91.4%

-3

Critical Alerts

2

-7m

Mean Time To Resolve

19m

Group

AI / Conversation Observability

Conversation quality, retrieval signals, policy guardrails, and assistant operations health.

Conversation Analytics

Full chatbot metrics set: usage, quality, retrieval, feedback, and failures.

Demo metrics preview

Total Conversations

Today120
Week840
Month3,600

Active Users

Now7
DAU72
WAU294
MAU900
Returning42%
New58%

Messages Sent

User3,960
Assistant4,140
Total8,100

Engagement

Avg conversation length6.4 msgs
Avg session duration5.8 min

Avg Response Latency

P95929 ms
Serieschat_router_latency

Conversation Success

Resolved12
Abandoned431
Success rate2.7%

Device Breakdown

Mobile58%
Desktop39%
Other3%

Peak Usage Times

9-11am210
12-2pm260
3-5pm190

Top Entry Pages

/report-issue312
/payments248
/utilities210
/contact185

Model Usage

gpt-4.1740
gpt-4.1-mini420
gpt-4o-mini210

Tokens & Cost

Input tokens1,872,000
Output tokens2,304,000
Cost per convo$0.04
Total$144.00

Quality & Retrieval

Fallback / hallucination4.2%
Confidence score0.92
Missing knowledge50 (3.4%)
Retrieval success95.8%

Tool Call Frequency

search420
summarize240
form_fill110

Top Documents Cited

Services2
Departments2
Utilities2
Payments2

Most Searched Topics

permits455
payments368
report issue359
contact181

Citation Engagement

Clicks1,108
Impressions6,245
Click rate17.7%

Index Freshness

Last ingestMar 8, 2026 08:41
Age (hrs)1.1
Docs ingested4,218
Failed docs9
Indexcity-guide-v3

Failed Responses

Count22
Rate0.9%

Errors By Type

timeout9
upstream_5037
empty_context6

User Feedback Ratings

Helpful1,248
Not helpful126
Flagged14

Escalations To Human

Count168
Rate4.7%

Guardrail Triggers

Total37
policy_limit14
safety_block11
pii_block12

Rate Limit Events

Count6
Rate0.2%

Top Users

resident_104284
resident_55965
resident_20362

Top Organizations

Palo Verde2,102
CivIQ Demo1,080
Austin Pilot418

AI Admin Command Center

Est. 30-day window

Executive KPIs

Deflected

98%

Hours Saved

275

After-Hours

100%

Cost / Interaction

AI $0.45 vs Call $6.25

-93% vs call center

Quality & Guardrails

Escalations

98

3.5% of questions

Refusals

113

4.04% of questions

Flagged Answers

1

0.04% of questions

Top Policy Trigger

185

answer mismatched question type

Top Policy Trigger Reasons

  • answer mismatched question type185
  • numeric sensitive policy103
  • legal or dispute98

Group

Platform Observability

Website reliability, API health, latency, traffic mix, and infrastructure dependencies.

Website Health + Reliability

Site traffic, latency, runtime errors, lambda dependencies, and OpenSearch posture.

Last refresh: Mar 8, 2026 13:09 UTC

Site Hits (Invocations)

Current window18,204
Window60 minutes

Resident Questions

30 days3,412
Daily avg114

Router Errors

Count28
Error rate0.15%

Degraded Downstream

Lambda functions1
OpenSearchhealthy

Top Runtime Errors

timeout11
upstream_5039
vector_query_fail6

OpenSearch Health

Clustergreen
Nodes3
Active shards62
Unassigned0

Latency Over Time

12 points • min 493ms • max 644ms

Traffic Mix

  • Payments32%
  • Permits24%
  • Utilities19%
  • 311 Requests15%
  • Other10%

Downstream Lambda Status

  • chat-router

    State: Active • Update: Successful

    healthy

  • knowledge-fetch

    State: Active • Update: Successful

    healthy

  • site-extraction-runner

    State: Active • Update: InProgress

    warming new index segment

  • wcag-scan-executor

    State: Active • Update: Successful

    healthy

API Up / Down Board

APIStatusUptimeP95Err%
Chat Router APIup99.99%734ms0.12%
Knowledge APIup99.97%641ms0.09%
News Feed APIdegraded99.88%1.38s0.71%
Compliance APIup99.96%882ms0.21%
Dispatch APIup99.95%947ms0.31%

Channel Health (API Section)

Live health layout from Signals: chat router, downstream lambdas, and OpenSearch.

Chat Router

Avg latency: 929 ms

Error rate: 0.15%

18,204 invocations / 28 errors (last 60m)

12 points • min 493 ms • max 644 ms

Downstream Lambdas

chat-router

State: Active • Update: Successful

healthy

knowledge-fetch

State: Active • Update: Successful

healthy

site-extraction-runner

State: Active • Update: InProgress

warming new index segment

wcag-scan-executor

State: Active • Update: Successful

healthy

OpenSearch

Cluster status: green

Nodes: 3

Active shards: 62

Unassigned shards: 0

API Endpoint Health Snapshot

Endpoint status rollup per configured API base.

EndpointStatusLatencyLast Check
GET /admin/assistant-statushealthy214 ms09:12
GET /admin/channel-healthhealthy241 ms09:12
GET /admin/chat-analyticsdegraded876 ms09:11
POST /admin/accessibility/scanhealthy312 ms09:10
POST /public/pdf-accessibility-uploadhealthy228 ms09:10
POST /public/pdf-accessibility-checkhealthy344 ms09:09
POST /public/pdf-accessibility-unlockhealthy262 ms09:09
GET /admin/knowledge-freshnesshealthy193 ms09:10

Last refreshed: Mar 8, 2026 13:09 UTC

Group

Alarms

Alerting rules, severity states, and recent incident activity.

Alarm Center

Alarm sets mirrored from Signals alert groups for incident and quality monitoring.

Active alarms: 1Monitoring: 1Resolved today: 1

Alarm Rules

Critical Alarms

criticalactive

Chat router error rate > 2.5% for 10m

Last triggered: Mar 8, 2026 09:11 UTC • Owner: SRE on-call

Quality Regressions

highmonitoring

Confidence score < 0.82 or fallback > 6%

Last triggered: Mar 8, 2026 08:43 UTC • Owner: AI operations

Daily Summary

mediumresolved

Scheduled daily digest of unresolved incidents

Last triggered: Mar 8, 2026 00:05 UTC • Owner: Ops reporting

Recent Alarm Activity

  • 09:11

    Critical alarm opened

    Error budget burn crossed threshold in /chat.

  • 09:18

    Escalation routed

    Assigned to SRE on-call with incident bridge link.

  • 09:34

    Mitigation applied

    Read-only fallback enabled while dependency recovered.

  • 09:47

    Quality monitor stable

    Fallback and confidence metrics returned to baseline.

Group

Compliance Observability

WCAG 2.1 AA posture, remediation workflow, and governance reporting.

PDF Scan Operations

Document scan throughput, remediated draft delivery, and recent scanned-PDF jobs.

Open PDF Scanner

PDFs Scanned This Week

148

Public forms, notices, and permit packets processed through the document scanner.

Average Post-Fix Score

93

Average accessibility score after automated remediation and export normalization.

Auto-Fixed Findings

238

Language tags, metadata, export settings, and document structure fixes applied automatically.

Manual Review Backlog

19

Scans still waiting on heading, reading-order, or semantic review by compliance ops.

Scan Pipeline Health

Upload Success Rate

99.4%

Signed upload handoff success across the last 30 days of public document intake.

Median Processing Time

44s

Median time from upload to preview report availability.

Unlock Conversion

68%

Share of completed scans that convert into full report + remediated PDF unlocks.

Remediated Drafts Delivered

112

Download packages generated for records, planning, building, and utilities teams.

Public Scanner Flow

Upload, preview, unlock, and remediated draft delivery all map into the same document operations surface shown here.

Recent PDF Scan Jobs

Last 4 jobs

palo_verde_residential_application.pdf

Permits • 1 page • 2.5 KB

Completed

Score

98

Issues

3

Auto-Fixed

1

Manual Review

2

Preview, full report, and remediated draft generated successfully.

Mar 19, 2026 16:14 UTC

palo_verde_electrical_permit.pdf

Utilities • 1 page • 3.7 KB

Completed

Score

94

Issues

5

Auto-Fixed

4

Manual Review

1

Tagged export profile applied before draft delivery to department reviewers.

Mar 19, 2026 15:42 UTC

palo_verde_variance_application.pdf

Planning • 1 page • 3.3 KB

Needs Review

Score

87

Issues

6

Auto-Fixed

2

Manual Review

4

Heading structure and logical reading order still require manual remediation.

Mar 19, 2026 15:09 UTC

palo_verde_special_inspection_statement.pdf

Building • 1 page • 3.8 KB

Running

Score

Processing

Issues

-

Auto-Fixed

-

Manual Review

-

OCR, tag structure analysis, and remediation draft generation in progress.

Mar 19, 2026 16:18 UTC

Compliance Dashboard

WCAG 2.1 AA operations center with severity analytics, remediation workflow, governance reporting, and evidence tracking.

Tenant: primiq

Overall WCAG Score

91

Pages Scanned

142

Pages Passing

128

Total Issues

54

Critical Issues

4

Last Scan

Latest

Mar 8, 2026 13:02 UTC

Status

At Risk

Trend

+2 score vs previous scan

Severity Breakdown

Critical4
Serious17
Moderate21
Minor12

WCAG Principles

Perceivable

19
  • Missing alt text
  • Low contrast
  • Missing captions
  • Missing transcripts

Operable

14
  • Keyboard traps
  • Missing focus indicators
  • No skip link
  • Hover-only interactions

Understandable

11
  • Form errors not described
  • Missing labels
  • Inconsistent navigation
  • Missing language declaration

Robust

10
  • Invalid ARIA attributes
  • Landmark misuse
  • Invalid HTML structure
  • Screen reader compatibility issues

Automated WCAG Rule Checks

Images missing alt text

Serious

Category

Perceivable

Affected pages

11

Status

Failing

Suggested fix

Add descriptive alt text or mark decorative images with empty alt.

Decorative images not marked correctly

Moderate

Category

Perceivable

Affected pages

7

Status

At Risk

Suggested fix

Use empty alt and aria-hidden for purely decorative media.

Empty links

Critical

Category

Operable

Affected pages

3

Status

Failing

Suggested fix

Remove empty anchor tags or provide meaningful labels.

Links without discernible text

Serious

Category

Operable

Affected pages

6

Status

Failing

Suggested fix

Provide visible text or aria-label for icon-only links.

Missing H1

Moderate

Category

Understandable

Affected pages

5

Status

At Risk

Suggested fix

Ensure each route contains one primary H1.

Incorrect heading order

Moderate

Category

Understandable

Affected pages

8

Status

At Risk

Suggested fix

Normalize heading levels to maintain semantic order.

Form inputs missing labels

Serious

Category

Understandable

Affected pages

9

Status

Failing

Suggested fix

Bind labels via for/id and descriptive field text.

Placeholder used instead of label

Moderate

Category

Understandable

Affected pages

4

Status

Needs Review

Suggested fix

Keep placeholder supplemental and add persistent labels.

Invalid ARIA usage

Serious

Category

Robust

Affected pages

6

Status

Failing

Suggested fix

Remove unsupported aria-* attributes and values.

Missing landmarks

Moderate

Category

Robust

Affected pages

5

Status

At Risk

Suggested fix

Add main/nav/header/footer landmarks for page structure.

Missing skip navigation

Serious

Category

Operable

Affected pages

4

Status

Failing

Suggested fix

Include skip-to-content link as first focusable element.

Focus visibility failures

Critical

Category

Operable

Affected pages

2

Status

Failing

Suggested fix

Restore focus indicators with accessible contrast levels.

Table header issues

Moderate

Category

Robust

Affected pages

3

Status

Needs Review

Suggested fix

Assign th headers and scope for data relationships.

Missing lang attribute

Minor

Category

Understandable

Affected pages

2

Status

At Risk

Suggested fix

Set page language at the document root.

Button name issues

Serious

Category

Operable

Affected pages

5

Status

Failing

Suggested fix

Provide accessible button names for icon/action controls.

Dialog accessibility issues

Critical

Category

Robust

Affected pages

2

Status

Failing

Suggested fix

Set role=dialog, accessible name, focus trap, and escape handling.

Color & Contrast

Text Contrast Failures

13

Link Contrast Failures

8

Button Contrast Failures

6

Background Contrast Issues

5

Normal text threshold: 4.5:1 • Large text threshold: 3:1

Keyboard Accessibility

Keyboard Accessible Pages

122

Keyboard Failures

20

Focus Order Issues

11

Focus Visibility Issues

7

Keyboard trap detections: 2

Screen Reader & Structure

Landmark Usage

89%

Controls With Accessible Names

93%

ARIA Validation Failures

9

Screen Reader Compatibility

90%

Dialog role and naming issues: 2

Forms Accessibility

Labels Connected

92%

Required Fields Identified

95%

Accessible Validation Errors

88%

Grouped Controls Labeled

91%

Form completion barriers: 12

Media Accessibility

Video Captions

86%

Audio Transcripts

79%

Autoplay Issues

1

Media Control Issues

4

Document Accessibility

Tagged PDFs

82%

Document Titles Present

94%

Heading Structure

88%

Alt Text In Documents

80%

Accessible export status: Partial - remediation in progress

Page-Level Compliance

/accessibility

Non-Compliant

Score

74

Issues

12

Severity summary

Critical 2 • Serious 5 • Other 5

Last scanned

Mar 8, 2026 13:02 UTC

/services/permits

Non-Compliant

Score

82

Issues

8

Severity summary

Critical 1 • Serious 3 • Other 4

Last scanned

Mar 8, 2026 13:02 UTC

/payments

At Risk

Score

84

Issues

7

Severity summary

Critical 0 • Serious 3 • Other 4

Last scanned

Mar 8, 2026 13:02 UTC

/departments

Needs Review

Score

86

Issues

6

Severity summary

Critical 0 • Serious 2 • Other 4

Last scanned

Mar 8, 2026 13:02 UTC

/utilities

Non-Compliant

Score

88

Issues

5

Severity summary

Critical 1 • Serious 1 • Other 3

Last scanned

Mar 8, 2026 13:02 UTC

Issue Tracker / Remediation Queue

WCAG-1842

2.4.7 Focus Visible

In Progress

Page URL

/utilities/payments

Severity

Critical

Owner

Frontend Platform

Identified

Mar 9, 2026

Suggested remediation

Restore visible focus ring for payment method controls.

WCAG-1838

1.1.1 Non-text Content

Open

Page URL

/services/permits

Severity

Serious

Owner

Content Ops

Identified

Mar 9, 2026

Suggested remediation

Provide meaningful alt text for permit checklist diagrams.

WCAG-1829

3.3.1 Error Identification

Needs Manual Review

Page URL

/forms/report-issue

Severity

Serious

Owner

Forms Team

Identified

Mar 8, 2026

Suggested remediation

Expose validation error summary with field-level references.

WCAG-1814

4.1.2 Name, Role, Value

Resolved

Page URL

/departments/public-works

Severity

Moderate

Owner

Design System

Identified

Mar 7, 2026

Suggested remediation

Correct aria-expanded state and button name semantics.

WCAG-1806

1.4.3 Contrast (Minimum)

Accepted Risk

Page URL

/services/permits

Severity

Moderate

Owner

Brand + UX

Identified

Mar 6, 2026

Suggested remediation

Legacy PDF render fallback accepted until Q2 template migration.

Scan Score Over Time

Last successful: Mar 8, 2026 13:02 UTC

Open Issues Over Time

Last failed: Mar 2, 2026 03:20 UTC

Resolved Issues Over Time

Remediation throughput weekly

Compliance Evidence & Audit

  • scan completed

    wcag-scan-executor: Weekly scan finished with 54 open violations.

    Updated Mar 8, 2026 13:02 UTC

  • manual review saved

    compliance.lead: Keyboard flow checklist updated for /payments and /services/permits.

    Updated Mar 8, 2026 12:41 UTC

  • conformance export

    compliance.ops: PDF conformance statement generated and attached to audit workspace.

    Updated Mar 8, 2026 11:18 UTC

  • rescan requested

    platform.engineer: Triggered targeted re-scan for /accessibility route.

    Updated Mar 8, 2026 10:52 UTC

ADA / Title II Governance

WCAG 2.1 AA Readiness

WCAG 2.1 AA - At Risk

Department Coverage

87%

Remediation Progress

74%

Public Service Coverage

92%

Deadline status: On track for April readiness gate

Legal exposure: Moderate - concentrated in Utilities and Public Works

Department / Service Compliance

Utilities

High

Score

83

Issues

18

Last scan

Mar 8

Permits

Moderate

Score

86

Issues

13

Last scan

Mar 8

Police

Low

Score

92

Issues

6

Last scan

Mar 7

Parks

Moderate

Score

89

Issues

9

Last scan

Mar 7

Public Works

High

Score

82

Issues

16

Last scan

Mar 8

AI Remediation Suggestions

  • Payment form submit button has no accessible name

    Set explicit aria-label from visible intent label and remove hidden duplicate icon text.

    Button: aria-label='Submit utility payment' + icon aria-hidden=true

    Recommendation Confidence: High
  • Permit checklist PDFs missing semantic heading structure

    Regenerate PDFs using tagged export profile and mapped heading styles.

    Export preset: tagged PDF + heading mapping + alt text retention

    Recommendation Confidence: Medium
  • Keyboard trap in date picker modal

    Add escape close, focus return target, and tab loop guards.

    Dialog trap util + onClose restoreFocus('#date-input')

    Recommendation Confidence: High

Automated Fix Tracking

AI Fixed

37

Manual Fixed

52

Remaining

54

Fix Rate Over Time

Combined AI + manual fix closure rate

Risk / Executive Impact

Legal Risk Level

Moderate

Critical Blockers

4

Top Departments At Risk

Utilities, Public Works, Permits

Posture

Compliance posture is improving but high-impact resident services still need closure.

Public service impact: Permit and utility workflows still contain critical operable and contrast defects.

Critical Alarms

criticalactive

Quality Regressions

highmonitoring

Daily Summary

mediumresolved
Compliance operations note

This dashboard is designed as an accessibility operations layer: continuous scans, severity-driven remediation, evidence retention, and governance reporting for WCAG 2.1 AA and ADA Title II readiness.

Demo note

This page is intentionally not connected to live APIs and is designed as a public walkthrough surface that mirrors the Signals workspace structure.