Tech & Society
Language Models, Extended: Large language models grew more reliable and less biased in 2022.
Researchers pushed the boundaries of language models to address persistent problems of trustworthiness, bias, and updatability.
Atlas
Machine Learning Research
Memorize Less; Retrieve More: How small language models can perform specialized tasks.
Large language models are trained only to predict the next word based on previous ones. Yet, given a modest fine-tuning set, they acquire enough information to learn how to perform tasks such as answering questions.
Machine Learning Research
Transformers See in 3D: Using transformers to visualize depth in 2D images.
Visual robots typically perceive the three-dimensional world through sequences of two-dimensional images, but they don’t always know what they’re looking at. For instance, Tesla’s self-driving system has been known to mistake a full moon for a traffic light.