- Country: Belgium
- Summary: Agentic Evaluation Interface
- BET Ref No: 118312330
- Deadline: 12 Jun 2025
- Financier: European Commission
- Purchaser Ownership: Government
- Tender Value: EUR 1080000
- Notice Type: Tender
- Document Ref. No.: 272332-2025
- Purchaser's Detail:Login to see full purchaser details. Login to see full purchaser details. Login to see full purchaser details. Login to see full purchaser details. Login to see full purchaser details. Login to see full purchaser details. Login to see full purchaser details. Login to see full purchaser details. Login to see full purchaser details.
- Description:
- The objective of this lot is to supply the AI Office with a programmatic interface for the evaluation of General-Purpose Artificial Intelligence (GPAI) models through agentic interaction patterns, i.e. the evaluation of GPAI models for use in tasks requiring multiple decisions and interaction with digital environments such as a browser, command line, or a full operating system. The interface is taken to mean software, methodology, configuration, cloud orchestration and other digital technical components that would allow the AI Office to execute evaluations of GPAI model and their agentic capabilities, without further dependency on the contractor, supplementing and working in tandem with AI Office digital infrastructure. The AI Office is seeking such an interface in the form of a GPAI model evaluation workflow or ‘harness-, and the necessary components thereof, that allow the AI Office and its technical experts to rapidly integrate into the evaluation pipeline new GPAI models and benchmarks across all digital modalities (text, image, video, audio) and from the full spectrum of digital tasks. This harness should provide support for relevant and state of the art elicitation methods and agent scaffolding, including fallback mechanisms that connect text only models to multi-modal benchmarks. It is expected that a significant part of the service will be dedicated to supporting the AI Office in the deployment on Commission infrastructure of existing or developed components of the e...
- Documents:
If you are registered member, kindly login to view full details of this tender notice:
CLICK HERE TO LOGINAgentic Evaluation Interface - Belgium Tender
The EUROPEAN COMMISSION, DG CNECT - COMMUNICATIONS NETWORKS, CONTENT AND TECHNOLOGY, a Government sector organization in Belgium, has announced a new tender for Agentic Evaluation Interface. This tender is published on BelgiumTenders under BET Ref No: 118312330 and is categorized as a Tender. Interested and eligible suppliers are invited to participate by reviewing the tender documents and submitting their bids before the deadline on 2025-06-12.
The estimated tender value is EUR 1080000, and full details, including technical specifications and submission requirements, are provided in the official tender documents. Ensure all submissions meet the criteria outlined to be considered for evaluation.
