Case Study · Healthcare Services · ~900 Employees
Replacing a legacy 360 with a lighter, AI-assisted flow — without sacrificing rigor for talent reviews.
Situation
The organization is a regional healthcare services group operating across multiple sites in the southeastern United States. At the time of engagement they employed approximately 900 people, with a leadership population of 42 managers and directors spanning clinical, operational, and administrative functions.
People operations were managed by a three-person HR team. The team had used the same enterprise 360 platform for five years — an annual cycle administered in the third quarter of each year, with reports delivered in November in time for year-end performance conversations.
The process was well-established. Competency frameworks were mature. Survey design was professionally structured. From the outside, it was a 360 program that was working. From the inside, it had quietly stopped functioning as a development tool and was operating almost entirely as an administrative ritual.
The HR Director began evaluating alternatives in the first quarter. The trigger was not a single failure but an accumulation of friction that had become impossible to ignore.
The Challenge
The legacy platform was not broken in any obvious way. Surveys launched on schedule. Reports generated cleanly. The competency framework was professionally built and covered the dimensions the organization cared about. None of that was the problem.
The problem was timing. The 360 cycle ran from August through October. By the time reports were processed and reviewed, it was mid-to-late November. Managers received feedback that was nominally about the past year but had been shaped by rater memory of the past three months. And that feedback landed in the same two-week window as performance ratings, compensation decisions, and year-end planning — when no one had time to do anything with it.
The data was real and the reports were well-built, but they landed at the exact wrong moment every year, and by January nobody remembered what was in them.
— Director of People Operations
The survey itself was the second problem. Raters were asked to assess each manager across multiple competency dimensions using an 11-point response scale, with open-text fields at the end of each section. For a manager with a full rater panel, this meant a single rater could spend 25 to 30 minutes completing one survey — and many raters had more than one.
The experience was desktop-only. There was no mobile-compatible version. Raters received email invitations and were expected to sit at a computer to complete the assessment. In a healthcare services environment where many staff work non-desk roles, this created an additional structural barrier.
The result was a 58% average rater completion rate across the five years the organization had used the platform. More than four in ten invited raters never submitted. The organization had learned to treat this as normal.
What they had not calculated was the compounding effect. A 58% completion rate meant that the managers with the smallest rater panels — often newer leaders or those in less central roles — could receive reports based on three or four responses. At that sample size, a single outlier response could move a competency score by a meaningful margin. The data was real, but its reliability was unevenly distributed across the leadership population.
Running the annual cycle required between 180 and 200 hours of HR staff time per cycle. That included building the rater panels, managing the invitation process, chasing non-completions, processing reports, and coordinating debrief conversations. For a three-person team managing all other people operations responsibilities, this was a significant seasonal burden.
The platform also carried a substantial annual license cost — a fixed expense regardless of how many assessments were actually completed or how many reports were meaningfully used.
System Comparison
A. Legacy process (before)
B. Interval 360 (now)
The Inflection Point
The HR Director evaluated two other platforms before selecting Interval 360. Both offered more frequent feedback cycles than the legacy tool. Neither resolved the core tension she had identified: that simplifying the rater experience seemed to require accepting thinner or less reliable data.
The evaluation of Interval 360 began with sample reports. She had expected to see the kind of output that a shorter, lighter process typically produces — broad thematic summaries, averaged ratings, generic developmental suggestions. What she found was more specific and more contextual than anything the legacy platform had generated.
The per-assessment pricing model removed the fixed-cost barrier that had made frequency economically impractical. A quarterly cadence became financially straightforward to pilot.
I fully expected to give something up. In my experience, when you simplify the process, you get thinner data. But the reports were more specific than anything we'd gotten out of the old tool. I didn't have a good explanation for that at first.
— Director of People Operations
The Approach
The organization ran a pilot with eight managers in the first cycle before expanding to the full leadership population. Pilot completion rate was 93%. HR time for the pilot cycle was under six hours. Reports were ready the same day the project closed.
The pilot served two purposes: it gave the HR team confidence in the operational model before committing the full leadership population, and it gave the eight pilot managers a reference point — something to compare their subsequent quarterly reports against.
The full rollout structured four cycles across the calendar year. The Q1 cycle ran in February and was timed to feed the organization's spring talent review. The Q2 cycle ran in May as a development check-in. The Q3 cycle ran in August at mid-year. The Q4 cycle ran in November and fed the year-end talent conversations.
The Q1 and Q4 cycles were designated full cycles — covering both what the manager accomplished and how they led. The Q2 and Q3 cycles were development check-ins covering the how dimension only. This kept the mid-year cycles lighter for raters while maintaining the full signal at the moments the organization most needed it.
Project windows were set to 10 days. Raters received one reminder at day five. There was no extended chasing, no manual follow-up from HR, and no exceptions process for late submissions.
Q1 — February
Spring Talent Review
Full cycle. Covers both what and how. Data feeds directly into the organization's spring talent review conversations.
Q2 — May
Development Check-in
How dimension only. Lighter for raters. Focused on leadership behavior and team experience in the 90 days since Q1.
Q3 — August
Mid-Year Signal
How dimension only. Delta from Q1 and Q2 surfaced in each report — leaders can see movement on specific themes across the year.
Q4 — November
Year-End Integration
Full cycle. Data feeds directly into year-end talent reviews. No separate survey. No reconciliation. The signal is already there.
Before the first full cycle launched, each manager attended a one-hour orientation session. The session covered what the conversational format looked and felt like for raters, how to read the report, and how to use the 90-day cadence as a development rhythm rather than an annual event. The orientation was run once. It was not repeated for subsequent cycles.
Outcomes
In the first full year of quarterly cycling, the organization completed four cycles across all 42 leaders. The Q4 cycle closed in late November — the same week the senior leadership team began talent review conversations. For the first time, the data being discussed in those conversations was current.
Two decisions in the Q4 talent review were directly informed by the cycle data in ways the HR Director described as qualitatively different from prior years. One leader who had been on a Driver placement track showed clear and consistent improvement across the Q2, Q3, and Q4 cycles — movement that was visible in the longitudinal data but would not have been visible in a single annual snapshot. A second leader with strong internal advocates but a more ambiguous performance record showed a flat signal across all four cycles — a pattern that changed the nature of the conversation.
Neither decision was made solely on 360 data. But in both cases, the HR Director noted that the quarterly signal gave the talent review a factual anchor it had not had before.
The Q1 completion rate was 91%. By Q3, it had reached 94%. The HR team attributed the improvement to rater familiarity with the format — raters who had completed the conversational assessment once were significantly more likely to complete it again, and to complete it faster.
Average rater time-to-complete dropped from approximately 25 minutes on the legacy platform to under five minutes by the second cycle. The accessibility of the conversational format — available on any device, requiring no login, completable in a single sitting — removed the structural barriers that had suppressed completion rates for five years.
The qualitative character of the feedback also shifted. Reports from the legacy platform had tended toward competency ratings with brief open-text commentary. Reports from the quarterly cycles contained more specific behavioral description — raters describing particular interactions, particular decisions, particular moments of impact. The HR Director noted that this shift made the reports more useful in debrief conversations because there was actual material to discuss.
Total HR time across all four cycles in year one was approximately 140 hours — less than the time required to run a single annual cycle under the legacy process. Per-assessment pricing eliminated the fixed license cost and made the program's cost directly proportional to the number of assessments completed. For a three-person HR team, the capacity that had been consumed by the annual 360 administration became available for other work.
We went from a process that consumed half a quarter and produced data nobody used to four short cycles that actually change what we talk about in talent conversations. The time savings matter, but honestly what matters more is that the data is useful now.
— Director of People Operations
On data freshness
One finding the HR Director had not anticipated was the effect of quarterly cycling on data accuracy. Annual 360 assessments are subject to recency bias — raters assess based on what they remember, which skews toward the most recent interactions. A quarterly cycle covers a 90-day window. Raters are describing recent, specific experience rather than reconstructing a year from memory. The signal is narrower in time but more accurate within that window.
For the leadership population, the shift from an annual event to a quarterly rhythm changed how feedback functioned in practice. The annual report had been a summative document — a record of a year that had already passed. The quarterly report arrived close enough to the period it described that managers could act on it within the same operating cycle.
Several managers reported using their Q2 reports to inform specific behavioral changes before the Q3 cycle launched — a 90-day feedback loop that the annual process could not produce. The HR Director noted that this was the change she had most hoped for and least expected to see in the first year.
What Comes Next
After four quarterly cycles, the organization has something it has never had before: a longitudinal view of its leadership population. Each of the 42 leaders now has four data points. Patterns that are invisible in annual snapshots — who is improving, who is plateauing, who responds to feedback and who does not — are visible in the longitudinal record.
Two structural decisions made in the Q4 talent review illustrate what this enables. One leader was reassigned from a management role to an individual contributor role — a decision supported in part by a flat signal across four cycles that suggested the management context was not producing growth. A second leader was identified as a succession candidate for a senior role — a judgment informed by consistent upward movement across the year.
The People team is now using cohort-level pattern data to inform the L&D calendar — identifying shared development themes across the leadership population and building programming around what the data shows rather than what the annual engagement survey approximated.
Pattern recognition
The People team could see, for the first time, which leaders improved across cycles and which plateaued. That distinction had never been visible in annual data.
Conversational AI advantage
Conversational AI captured nuance that Likert scales collapsed. Raters described specific behaviors — not abstract ratings — giving coaches actual material to work with.
Get Started
Self-serve assessments start at $150 each, with ten-packs at $125. For organizations running ongoing programs across a larger leadership population, enterprise plans provide unlimited assessments within an annual subscription. Contact us to discuss what that looks like for your organization.
Related resources