Monitor quality and agent performance.

Domain analytics, golden-SQL execution scores, and negative feedback, the same agent-monitoring views your team already uses to keep self-serve answers trustworthy.

Analytics for domain: Sports

Aggregated analytics and insights for domain "Sports"

Total Questions

15

Unique Users

3

Success Rate

100.0%

10 / 10 queries

Satisfaction Rate

75.0%

Response rate: 26.7%

Questions & Users Over Time

Success & Satisfaction Rates

Feedback Distribution

Model Usage Distribution

Domain analytics

  • Questions, unique users, success rate, and satisfaction for each domain, with charts over the window you pick.

Execution score

  • Score generated SQL against golden tests: execution match, row count, column match, and value match.

Trends over time

  • Watch pass rates recover after you add metadata, then export every failed question from a run.

Negative-feedback review

  • See which topics miss (joins, aggregations, ordering) and open the interaction that got the thumbs-down.

Score the agent against golden test SQL

Run evaluations and see pass rates for execution match, row count, column match, and value match, then improve the score from the database view.

Execution Score

Run evaluations against golden test SQL and view detailed results

Execution Score Summary

Metric pass rates across all runs

Databases 2
Total Runs 8

Execution Match

Generated SQL runs and returns the same result set as the golden SQL.

Row Count

Number of rows from generated SQL matches the golden SQL row count.

Column Match

Result columns (names and types) match between generated and golden SQL.

Value Match

Cell values in the result set match between generated and golden SQL.

Watch quality progress over time

Track execution, row, column, and value match across runs. Group history by domain or tag, and export every failed golden question.

Execution score by time

Average score (%) for each metric by day, based on runs in the selected date range.

Review the questions that missed

Negative user feedback is grouped by topic (Aggregation, Join, Ordering), with the user’s comment, database, and a path back to the interaction.

Negative User Feedback

Interactions that received negative user feedback

Topic Summary

Aggregation

14

Join

3

Ordering

1

Records (18)

UserdatabaseDomainFeedback textQuery typeInteraction
AR
Alex Rivera
olympics.publicSportsmissing a column :(Aggregation
JK
Jordan Kim
olympics.publicSportswrong query, because only phelps is returned instead of all tunisian swimmers that participated in olympicsJoin
AR
Alex Rivera
olympics.publicSportsThe players shown here are not from TunisiaOrdering
EO
Elena Ortiz
olympics.publicSportsThe count includes exhibition events. Should only count official medal events.Aggregation
MW
Marcus Webb
olympics.publicSportsCountry names are missing. Query only returns medal counts without country labels.Join
JK
Jordan Kim
olympics.publicSportsResults include all years. I asked specifically for Tokyo 2020 only.Aggregation
Showing 1 to 6 of 18 results
1 2 3

Ready to make self serve analytics a reality for your company?

Deploy Unity Layer AI agents and empower your business and data teams with fast and accurate AI insights

Get Started