Testing AI
in Smart Cities and
Communities

Our top-ranked service reveals how AI innovators struggle with a new complexity

Data server EU emblem large logo
IMG

Even the most experienced coder can struggle to figure out the inner workings of their own machine-learning algorithm, once it’s been unleashed on big data sets. Now our recent research, based on data from all of CitCom.ai’s 16 test sites and 26 different experiments, also reveals that AI innovators can find it as difficult to navigate EU’s inner workings on AI regulations. So, perhaps it’s not surprising that this TEF-service made it to the top of the list of our most popular services.

Guidance to understand EU legal framework – This was the top-ranked service in the paper, showing that AI innovators prioritise support in navigating complex EU regulations. It reflects the growing importance of regulatory assistance as AI regulation becomes more prominent.

Providing a regulatory sandbox – Regulatory sandbox services were the second most desired, emphasising the demand for a controlled, legally compliant environment where innovators can test AI solutions under regulatory supervision. These are currently lacking in Europe for AI-testing.

Access to real-life TEF data – Innovators value real-world data highly, ranking access to this data as the third most important service. This is crucial for training and validating AI models.

Algorithm training using real-life TEF data – The fourth-ranked service is closely related to the third, reflecting the importance of real-life data for developing and training algorithms.

Algorithm validation in a real environment – This service ranked fifth, showing that while validation is important, other forms of regulatory and data support take precedence in the early stages of development.

Data requirements mapping – Ranked sixth, this service helps innovators ensure they have the right data for their AI models, although it is less frequently demanded compared to regulatory and real-world data services.

While CitCom.ai and the other TEFs offer a wide range of AI services, it's clear that regulatory support and access to real-world data are currently the most sought-after by AI innovators. Services such as guidance on EU legal frameworks and regulatory sandboxes top the list, reflecting the growing complexity of AI regulations.

However, as more experiments progress, we expect the demand for technical validation and algorithm testing services to increase. CitCom.ai is well-positioned to support innovators as they navigate both the technical and regulatory challenges of AI development in smart cities.

Read the full report, "Exploring the link with AI Regulatory Sandboxes, Living Labs & AI Testbeds", here.

You can explore all of our services here.