Category Technology/Electronics

Microsoft’s Small Language Model Outperforms Larger Models on Standardized Math tests

Grade School Math
Credit: Deepak Gautam from Pexels

A small team of AI researchers at Microsoft reports that the company’s Orca-Math small language model outperforms other, larger models on standardized math tests. The group has published a paper on the arXiv preprint server describing their testing of Orca-Math on the Grade School Math 8K (GSM8K) benchmark and how it fared compared to well-known LLMs.

Many popular LLMs such as ChatGPT are known for their impressive conversational skills—less well known is that most of them can also solve math word problems. AI researchers have tested their abilities at such tasks by pitting them against the GSM8K, a dataset of 8,500 grade-school math word problems that require multistep reasoning to solve, along with their correct answers.

In this new study, th...

Read More

Engineers Collaborate with ChatGPT4 to Design Brain-Inspired Chips

Image of a cartoon person looking at a computer

Johns Hopkins electrical and computer engineers are pioneering a new approach to creating neural network chips—neuromorphic accelerators that could power energy-efficient, real-time machine intelligence for next-generation embodied systems like autonomous vehicles and robots.

Electrical and computer engineering graduate student Michael Tomlinson and undergraduate Joe Li—both members of the Andreou Lab—used natural language prompts and ChatGPT4 to produce detailed instructions to build a spiking neural network chip: one that operates much like the human brain.

Through step-by-step prompts to ChatGPT4, starting with mimicking a single biological neuron and then linking more to form a network, they generated a full chip design that could be fabricated.

“This is the first A...

Read More

Researchers Demonstrate 3D Nanoscale Optical Disk Memory with Petabit Capacity

High-capacity data storage is indispensable in today's digital economy. However, major storage devices like hard disk drives and semiconductor flash devices face limitations in terms of cost-effectiveness, durability, and longevity.Read More

New Chip Opens Door to AI Computing at Light Speed

Streaks of blue light representing information run from right to left.
Computing at the speed of light may reduce the energy cost of training AI. (Narongrit Doungmanee via Getty Images)

University of Pennsylvania engineers have developed a new chip that uses light waves, rather than electricity, to perform the complex math essential to training AI. The chip has the potential to radically accelerate the processing speed of computers while also reducing their energy consumption.

The silicon-photonic (SiPh) chip’s design is the first to bring together Benjamin Franklin Medal Laureate and H...

Read More