As the size of artificial intelligence models expands beyond 1 trillion parameters, a new concept is dominating the computing landscape: “supernode”. At this year’s World Artificial Intelligence Conference (WAIC), China’s top AI summit, domestic chipmakers from Huawei Technologies to Biren Technology showcased new hardware designed to knit hundreds or thousands of chips together to act as one giant supercomputer, which they called a supernode. The focus on supernodes at WAIC reflected a shift in...
How many electrons does it take to store a single bit of information? For today’s most advanced dynamic random access memory (DRAM) chips from Samsung and SK Hynix, the answer is roughly 200,000. That is the price of reliability – a vast reservoir of charge needed to ensure a “1” or “0” does not fade into noise. But a team at Fudan University in Shanghai has just collapsed that number to its theoretical floor: one. In a paper published on July 16 in Science, microelectronics professor Zhou Peng...