Machine Learning Research

221 Posts

Animated graphs showing how an ensemble of fine-tuned models can provide better performance.
Machine Learning Research

Ensemble Models Simplified: New Machine Learning Research Simplifies Ensembles

A CLIP model whose weights were the mean of an ensemble of fine-tuned models performed as well as the ensemble and better than its best-performing constituent.

2 min read
Animated flowcharts show how the ProtCNN AI model classifies proteins.
Machine Learning Research

Protein Families Deciphered: Machine Learning Categorizes Proteins Based on Their Functions

Convolutional neural networks separate proteins into functional families without considering their shapes.

2 min read
A flowchart shows how a jury learning method reduces annotator bias in machine learning models.
Machine Learning Research

Choose the Right Annotators

A new machine learning method attempts to account for biases that may be held by certain subsets of labelers.

2 min read
Flowcharts show how a new contrastive learning approach uses metadata to improve AI image classifiers.
Machine Learning Research

Learning From Metadata: Descriptive Text Improves Performance for AI Image Classification Systems

Images in the wild may not come with labels, but they often include metadata. A new training method takes advantage of this information to improve contrastive learning.

2 min read
Humanized Training for Robot Arms
Machine Learning Research

Humanized Training for Robot Arms: New Research Improves Robot Performance and Adaptability

Robots trained via reinforcement learning usually study videos of robots performing the task at hand. A new approach used videos of humans to pre-train robotic arms.

2 min read
Tradeoffs for Higher Accuracy
Machine Learning Research

Tradeoffs for Higher Accuracy

Vision models can be improved by training them on several altered versions of the same image and also by encouraging their weights to be close to zero. Recent research showed that both can have adverse effects that may be difficult to detect.

2 min read
Diagram
Machine Learning Research

Who Was That Masked Input?

Researchers have shown that it’s possible to train a computer vision model effectively on around 66 percent of the pixels in each training image. New work used 25 percent, saving computation and boosting performance to boot.

2 min read
Diagram
Machine Learning Research

Roadblocks to Regulation

Most U.S. state agencies use AI without limits or oversight. An investigative report probed reasons why efforts to rein them in have made little headway.What’s new: Since 2018, nearly every proposed bill aimed at studying or

2 min read
DeepNet Graph Layers vs years
Machine Learning Research

Pile on the Layers!

Adding layers to a neural network puts the “deep” in deep learning, but it also increases the chance that the network will get stuck during training. A new approach effectively trains transformers with an order of magnitude more layers

2 min read
Airfoils Automatically Optimized
Machine Learning Research

Airfoils Automatically Optimized

Engineers who design aircraft, aqueducts, and other objects that interact with air and water use numerical simulations to test potential shapes, but they rely on trial and error to improve their designs. A neural simulator can optimize the shape

2 min read
Tech Imitates Life, Life Imitates Art
Machine Learning Research

Tech Imitates Life, Life Imitates Art

The computational systems known as cellular automata reproduce patterns of pixels by iteratively applying simple rules based loosely on the behavior of biological cells. New work extends their utility from reproducing images to

3 min read
Right-Sizing Confidence
Machine Learning Research

Right-Sizing Confidence

An object detector trained exclusively on urban images might mistake a moose for a pedestrian and express high confidence in its poor judgment. New work enables object detectors, and potentially other neural networks, to lower their confidence

2 min read
Driver one passing driver two who has no gas
Machine Learning Research

Linear Regression: Straight & Narrow

Linear regression may be the key statistical method in machine learning, but it didn’t get to be that way without a fight. Two eminent mathematicians claimed credit for it, and 200 years later the matter remains unresolved. The longstanding

3 min read
Upgrade for Vision Transformers
Machine Learning Research

Upgrade for Vision Transformers

Vision Transformer and models like it use a lot of computation and memory when processing images. New work modifies these architectures to run more efficiently while adopting helpful properties from convolutions.

2 min read
Image Generation + Probabilities
Machine Learning Research

Image Generation + Probabilities

If you want to both synthesize data and find the probability of any given example — say, generate images of manufacturing defects to train a defect detector and identify the highest-probability defects — you may use the architecture known as a

3 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox