Overview of the AI-Eval Workbench

Activity: Talk or presentationOther talk or presentationscience-to-science

Description

We presented the concepts and architecture of our planned AI-Eval Workbench. This tool, integrated with GitLab, evaluates the quality of requirements using INCOSE best practices, assists in refactoring source code based on SonarQube input, and aids in generating and enhancing unit tests. The workbench leverages generative AI systems, specifically ChatGPT, to perform these tasks. Additionally, it systematically collects feedback on the AI's recommendations, which can later be used to refine prompts or for fine-tuning the AI model. We also gave a short presentation of the prototype.
Period25 Oct 2024
Event titleSiemens AG, interne Veranstaltung
Event typeOther
LocationGermanyShow on map

Fields of science

  • 102006 Computer supported cooperative work (CSCW)
  • 102016 IT security
  • 102027 Web engineering
  • 502050 Business informatics
  • 102040 Quantum computing 
  • 102020 Medical informatics
  • 502032 Quality management
  • 503015 Subject didactics of technical sciences
  • 102022 Software development
  • 102034 Cyber-physical systems
  • 102015 Information systems
  • 509026 Digitalisation research

JKU Focus areas

  • Digital Transformation