We’ve scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALL·E, but also for rapid small-scale iterative research such as Scaling Laws […]
Research
Trending topics and news from the Research category
Back to news homeNarinder S. Kapany, ‘Father of Fiber Optics,’ Dies at 94
But Dr. Kapany was growing restless in academia, and in 1960 he moved his family to California to start a new company, Optics Technology, to commercialize his research. He based […]
CLIP: Connecting Text and Images
We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP (Contrastive Language–Image Pre-training) can be applied to any visual classification benchmark by simply […]
DALL·E: Creating Images from Text
DALL·E is a 12-billion parameter version of GPT-3 trained to generate images from text descriptions, using a dataset of text–image pairs. We’ve found that it has a diverse set of […]
25 Days That Changed the World: How Covid-19 Slipped China’s Grasp
Politically, it was a perilous situation for both men.As its trade war with China escalated, the Trump administration had all but eliminated a public health partnership with Beijing that had […]
Learning to Summarize with Human Feedback
We’ve applied reinforcement learning from human feedback to train language models that are better at summarization. Our models generate summaries that are better than summaries from 10x larger models trained […]
Many Employers Avoid Covid Tests Over Cost, Not Availability
A surge of Covid-19 cases this fall has brought reports of new challenges in getting coronavirus tests. But for employers, testing availability and turnaround times do not appear to be […]
Racism Impoverishes the Whole Economy
Discrimination hurts just about everyone, not only its direct victims. New research shows that while the immediate targets of racism are unquestionably hurt the most, discrimination inflicts a staggering cost […]
Early Data Show Moderna’s Coronavirus Vaccine Is 94.5% Effective
The drugmaker Moderna announced on Monday that its coronavirus vaccine was 94.5 percent effective, based on an early look at the results from its large, continuing study. Researchers said the […]