A new Trillion Parameter Consortium (TPC) has been formed by federal laboratories, research institutes, academia, and industry to address the challenges of building large-scale artificial intelligence (AI) systems and advancing trustworthy and reliable AI for scientific discovery.
Training LLMs (large language models) with this many parameters requires exascale class computing resources, such as those being deployed at several U.S. Department of Energy (DOE) national laboratories and multiple TPC founding partners in Japan, Europe, and elsewhere.
TPC will:
- Build an open community of researchers interested in creating state-of-the-art large-scale generative AI models aimed broadly at advancing progress on scientific and engineering problems by sharing methods, approaches, tools, insights, and workflows.
- Incubate, launch, and coordinate projects voluntarily to avoid duplication of effort and to maximize the impact of the projects in the broader AI and scientific community.
- Create a global network of resources and expertise to facilitate the next generation of AI and bring together researchers interested in developing and using large-scale AI for science and engineering.
Founding partners of TPC:
* AI Singapore
* Allen Institute For AI
* AMD
* Argonne National Laboratory
* Barcelona Supercomputing Center
* Brookhaven National Laboratory
* CalTech
* CEA
* Cerebras Systems
* CINECA
* CSC - IT Center for Science
* CSIRO
* ETH Zürich
* Fermilab National Accelerator Laboratory
* Flinders University
* Fujitsu Limited
* HPE
* Intel
* Juelich Supercomputing Center
* Kotoba Technologies, Inc.
* LAION
* Lawrence Berkeley National Laboratory
* Lawrence Livermore National Laboratory
* Leibniz Supercomputing Centre
* Los Alamos National Laboratory
* Microsoft
* National Center for Supercomputing Applications
* National Institute of Advanced Industrial Science and Technology (AIST)
* National Renewable Energy Laboratory
* National Supercomputing Centre, Singapore
* NCI Australia
* New Zealand eScience Infrastructure
* Northwestern University
* NVIDIA
* Oak Ridge National Laboratory
* Pacific Northwest National Laboratory
* Pawsey Institute
* Princeton Plasma Physics Laboratory
* RIKEN
* Rutgers University
* SambaNova
* Sandia National Laboratories
* Seoul National University
* SLAC National Accelerator Laboratory
* Stanford University
* STFC Rutherford Appleton Laboratory, UKRI
* Texas Advanced Computing Center
* Thomas Jefferson National Accelerator Facility
* Together AI
* Tokyo Institute of Technology
* Université de Montréal
* University of Chicago
* University of Delaware
* University of Illinois Chicago
* University of Illinois Urbana-Champaign
* University of New South Wales
* University of Tokyo
* University of Utah
* University of Virginia
