A Thought-provoking Question Matrix to Guide the Development of Foundation-Model-based Applications

Authors Sietske Tacoma, Jimmy Mulder, Matthieu Laneuville, Stefan Leijnen
Published in Proceedings of the Workshops at the Third International Conference on Hybrid Human-Artificial Intelligence co-located with (HHAI 2024), Malmö, Sweden, June 10-11, 2024
Publication date 10 June 2024
Research groups Artificial Intelligence
Type Lecture

Summary

Organizations feel an urgency to develop and implement applications based on foundation models: AI-models that have been trained on large-scale general data and can be finetuned to domain-specific tasks. In this process organizations face many questions, regarding model training and deployment, but also concerning added business value, implementation risks and governance. They express a need for guidance to answer these questions in a suitable and responsible way. We intend to offer such guidance by the question matrix presented in this paper. The question matrix is adjusted from the model card, to match well with development of AIapplications rather than AI-models. First pilots with the question matrix revealed that it elicited discussions among developers and helped developers explicate their choices and intentions during development.

Downloads en links

On this publication contributed

  • Sietske Tacoma
    • Researcher
    • Research group: Artificial Intelligence
  • Jimmy Mulder
    • Lecturer-researcher
    • Research group: Artificial Intelligence
  • Stefan Leijnen
    • Professor
    • Research group: Artificial Intelligence

Language English
Published in Proceedings of the Workshops at the Third International Conference on Hybrid Human-Artificial Intelligence co-located with (HHAI 2024), Malmö, Sweden, June 10-11, 2024
Key words foundation models, use cases, model cards