Tokenization in Transformers v5: Simpler, Clearer, and More Modular
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Today's focus
Equities Global marketsCentral banks Rates & policyTechnology AI & innovationEnergy Commodities & supplyGlobal trade Business & geopolitics
Trade World News / Section
Technology
Technology, fintech and innovation changing financial markets.
TW
Latest stories
620 stories
Technology desk
The 34 Best Gifts for Dads (2026)
Whatever your dad is into, there’s a great gift for him. Shop dad-tested brands like Bose, Patagonia, Snow Peak, Garmin, and more.
The Open Evaluation Standard: Benchmarking NVIDIA Nemotron 3 Nano with NeMo Evaluator
A Blog post by NVIDIA on Hugging Face
CUGA on Hugging Face: Democratizing Configurable AI Agents
A Blog post by IBM Research on Hugging Face
New in llama.cpp: Model Management
A Blog post by ggml-org on Hugging Face
Codex is Open Sourcing AI models
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Introducing swift-huggingface: The Complete Swift Client for Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
DeepMath: A lightweight math reasoning Agent with smolagents
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
We Got Claude to Fine-Tune an Open Source LLM
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Transformers v5: Simple model definitions powering the AI ecosystem
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Diffusers welcomes FLUX-2
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Continuous batching from first principles
We’re on a journey to advance and democratize artificial intelligence through open source and open science.