Towards a Common European AI Hub: Storing, Sharing, and Operating AI/ML Models, Applications, and Vector Data at Scale

EuroHPC's compute infrastructure is world-class, but the surrounding AI/ML data ecosystem remains fragmented. This BoF explores what a common European AI Hub for models, embeddings, vector databases, and RAG components could look like. Through interactive roundtable discussions, participants will examine storage patterns, federation models, HPC integration challenges, reproducibility requirements, and governance approaches. This non-commercial session uses minimal presentation (5 min) and extensive moderated discussions (45 min) across eight themed tables with participant rotation. Rather than proposing solutions, we aim to collect diverse perspectives, identify shared challenges, and establish design principles. Outcomes include shared understanding of community requirements, networking opportunities, and potential coordination with European initiatives. Target audience: EuroHPC users, HPC operators, AI/ML infrastructure engineers, and researchers working with large-scale AI workflows.

---

Organizers:

• Christian Kniep
• Barbara Krašovec
• Alfio Lazzaro
• Abdulrahman Azab