Blog

Satya Nadella Discusses AI as “Heavy Industry” and the Return of Scaffolding

LLM

AI

Podcast

Microsoft CEO Satya Nadella views AI not as magic but as a “heavy industry,” emphasizing the strategic importance of “scaffolding”—the infrastructure and tools—over models themselves, as detailed in a tour of Microsoft’s Fairwater 2 data center and a discussion on the future of AI business models and geopolitical considerations.

Junichiro Iwasawa

Accelerating LLM Inference on Kubernetes: A Deep Dive into `llm-d`’s Architecture

LLM

LLM Inference

The explosive growth of Large Language Models (LLMs) has been incredible, but serving these massive models in a production environment is a formidable challenge. The core…

Junichiro Iwasawa

The Interactive Turn: How DocETL and Dialog Engineering are Reshaping LLM Data Analysis

LLM

Podcast

Large Language Models (LLMs) hold immense promise for extracting insights from the vast oceans of unstructured data we navigate daily. Yet, anyone who has tried to apply…

Junichiro Iwasawa

Introduction to Diffusion Models: From Core Concepts to Cutting-Edge Applications

Machine Learning

Diffusion models

In recent years, diffusion models have taken the generative modeling world by storm, particularly in image synthesis, often producing stunning results. This post aims to…

Junichiro Iwasawa

Understanding Self-Attention

Machine Learning

Transformer

Python

LLM

Lately, Large Language Models (LLMs) like ChatGPT and GPT-4 have taken the world by storm. These models demonstrate remarkable abilities, from generating code and drafting…

Junichiro Iwasawa