Category Physics

Hybrid AI-powered Computer Vision Combines Physics and Big Data

Machine learning pipeline
Graphic showing two techniques to incorporate physics into machine learning pipelines — residual physics (top) and physical fusion (bottom) Achuta Kadambi/UCLA

Researchers from UCLA and the United States Army Research Laboratory have laid out a new approach to enhance artificial intelligence-powered computer vision technologies by adding physics-based awareness to data-driven techniques.

Published in Nature Machine Intelligence, the study offered an overview of a hybrid methodology designed to improve how AI-based machinery sense, interact and respond to its environment in realtime — as in how autonomous vehicles move and maneuver, or how robots use the improved technology to carry out precision actions.

Computer vision allows AIs to see and make sense of their surroundings by ...

Read More

Google StyleDrop generates Images from Text

Credit: Google

It took Da Vinci 16 years to paint the Mona Lisa. Some say he needed 12 years just to paint her lips.

There is no truth to the rumors that slow Internet was the cause.

But Da Vinci, a polymath who dabbled in botany, engineering, science, sculpture, and geology as well as painting, surely would have appreciated a new text-to-image generative vision transformer developed by Google Research.

Google’s StyleDrop, as described in a June 1 paper on the arXiv preprint server, lets users describe objects and specify artistic styles they wish to have incorporated in the generated output.

StyleDrop returns images reflecting the user’s specifications in about three minutes.

“The proposed method is extremely versatile and captures nuances and details of a user-provided...

Read More

Meta’s AI MusicGen makes Music from Text Prompts

meta
Credit: Unsplash/CC0 Public Domain

The 19th century philosopher Thomas Carlyle once declared, “Music is well said to be the speech of angels.”

One wonders what Tom would have thought about a later era serving up protopunk, death metal and gothic rock.

Moreover, what would he have had to say about current approaches to music composed not by angels but by CPUs, RAM and large language models?

Meta announced last week that it has developed an AI music processor that generates music based on natural language descriptions.

Meta’s MusicGen, which follows on the heels of Google’s January release of MusicLM that generates music based on text prompts or humming, was trained on 20,000 hours of music...

Read More

DeepMind achieves Giant Leap in Sorting Speed

Fundamentally different algorithms discovered by AlphaDev. a, A flow diagram of the variable sort 4 (VarSort4) human benchmark algorithm. In this algorithm, a sequence of unsorted numbers are input into the algorithm. If the sequence length is four, three or two numbers, then the corresponding sort 4, sort 3 or sort 2 sorting network is called that sorts the resulting sequence. The result is then returned and output by the function. b, The VarSort4 algorithm discovered by AlphaDev. This algorithm also receives sequences of length four, three or two numbers as input. In this case, if the length is two, then it calls the sort 2 sorting network and returns. If the length is three then it calls sort 3 to sort the first three numbers and returns...
Read More