Skip to content
Hugging Face Blog·· 2026-07-06AI score22

PRX Part 4: Our Data Strategy

AI briefing

The fourth installment of the PRX series reveals its data pipeline: pre-training data is composed of a mix of public and internal datasets, with VLMs used to regenerate long image descriptions, which are then converted into corpora suitable for streaming training. The team switched to the Qwen3-VL text encoder and computes text latents in real time during training, with measured throughput loss of approximately 3–4% (roughly one extra day for a 30-day training run). Images are uniformly encoded at JPEG quality 92, and initial re-encoding is nearly imperceptible in practice.

Open original huggingface.co