CORDIS Project
Funding breakdown and partner intelligence are Premium
Sign in and upgrade to Premium for EU contribution totals, consortium analytics, OpenAlex research context, and AI summaries. · 0 consortium intelligence fields visible of 1
Start free • Cancel anytime • 14-day refund guarantee
This project focuses on improving the training of neural networks by identifying and addressing bottlenecks in optimization. By understanding data characteristics and their effects on training dynamics, the project aims to develop more efficient algorithms for machine learning.
Modern machine learning models have been successfully deployed across fields, from scientific studies to tech-nological developments in industry, but their development remains poorly understood.
The training of a largelanguage model such as GPT-3 is estimated to cost $4.6M, and public attempts to replicate the training processalone required teams of engineers to rotating on-call for months, monitoring various statistics and constantlytweaking the training procedure when it broke.
Existing theore…
INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE
Partner organizations (coordinator is shown above), with normalized type and CORDIS activity type. Guests see up to 4 partners.
Similar projects, consortium collaboration history, frequent partners, and OpenAlex research context.
Guests see up to 5 EuroSciVoc fields.
Guests see up to 5 topics.
Guests see up to 5 keywords.
