Benchmarking autonomy — KPIs that drive ROI

June 24, 2026

15:45-16:45

Future skills stage

Autonomous Networks

Autonomous operations

Even though Autonomous Networks are increasingly moving from pilots to production, operators still face uncertainty about where to invest, which capabilities deliver measurable ROI, and how to scale adoption efficiently. This session, we’re pleased to launch the TM Forum AN Benchmarks Project. Join us to explore the results of our initial pilot program and explore how operators can use KPIs, domain-level insights, and regional comparisons to model value and prioritise actions.

Moderator: Shuvo Saha, VP of Education, TM Forum

15:45 – 15:50
Opening: Welcome + why this matters now... and what the benchmark is (in plain English)

CEO/CFO tension and the competitive one: proving ROI and knowing whether you’re ahead/behind peers
What the Autonomous Network Benchmark is, what we’ve learned so far, and how to engage today
Identifying the problem that the Benchmark solves: difficulties in comparing fragmented industry progress and linking autonomy measurement needs to business value
Advantages of a neutral, anonymised way to compare performance and track progress over time

Shuvo Saha, VP of Education, TM Forum

15:50 – 16:00
Presentation: Method + early insights: KPIs that drive ROI

How the benchmark links network capabilities to outcomes (KCIs → KEIs → KBIs)
What is in scope for the MVP pilot?
Types of early signals emerging so far (value correlation, variance across operators, and where “levels” do/don’t predict impact

John Gomes, Partner, Bain
Jennifer Binder‑Le Pape, Practice Executive Vice President, Communications, Media & Entertainment Practice, Bain

16:00 – 16:15
Case study: Starting right: How KPN used AOMM and ANLET together to build an evidence-based autonomous operations roadmap
KPN set an ambitious target: become Europe's most efficient telco by 2030. But before investing in AIOps, digital twins, or intent engines, KPN needed an honest baseline. In this session, KPN and Makman share the industry's first combined AOMM + ANLET assessment -- applying the outside-in/inside-out methodology from IG1403 with independent consultant validation. We'll share what the dual-lens approach revealed that neither framework alone could show, the "aha moments" that reshaped KPN's roadmap priorities, and how the assessment became the foundation for a phased transformation program now underway.

Why KPN chose to baseline before investing
The dual-lens methodology: AOMM + ANLET combined
What the assessment revealed and how it shaped the roadmap
Measuring progress: the case for re-assessment cycles

Luqman Shantal, CEO, Makman Consulting
Menno Groen, Strategist, Autonomous Operations, KPN

16:15 – 16:45
Panel: Early adopters’ viewpoint: Why we’re participating

Each panelist has 60–90 seconds each to explain:
The KPI/ROI question they most need answered
Why peer comparison matters internally
What would make benchmarking “worth it”?
The panel will close with one cross‑cutting question from the host: “What would you tell another operator considering joining?”

16:45 – 17:15
Table discussions + participation conversations
The session will conclude with facilitated table conversations to pressure‑test the benchmark approach, compare the KPI questions people are being asked internally, and identify who wants to explore joining. Panelists join tables, and TM Forum and Bain speakers will circulate to answer governance/anonymity/effort questions and capture follow‑ups with interested companies.

17:15
Closing remarks

All timings are provisional and may be subject to change.

Session speakers

Menno Groen

Strategist

Luqman Shantal

CEO

Jennifer Binder-Le Pape

Practice Executive Vice President

John Gomes

Partner

Shuvo Saha

VP Education

Alexis Koalla

Director Operations Strategy and Autonomous Network Transformation

Also running at this time

Composable IT & Ecosystems

24 June 2026

15:40-17:20

TM Forum industry showcase stage

ReInvent IT for an AI world

CSPs are fast-tracking AI-native operations via Open Digital Architecture (ODA), with this TMF stage session (15:40-17:20) diving into enterprise digital twins for agile business-IT-network modeling, Swisscom’s data products unlocking scalable AI, the Satcom Catalyst’s three-phase push to industrialize satellite services with partners like Airbus and Alvatross, and TM Forum’s blueprint for CSPs to conquer fintech adjacencies through platforms, APIs, and trusted data—driving operational excellence and new revenue frontiers.