---
title: "Concurrency plus nvfp4 on Blackwell — Stuff That Spins"
description: "Parsed from VLLM log file ~2000 tps in aggregate performing bulk captioning on images. Above is parsed from vllm log while a client runs 30 concurrent streams, each concurrent stream has 1 request with an image and prompt, then a 2nd request on the same stream (so 1st Q:A would be cached). Typical …"
	canonical: "https://stuffthatspins.com/spin/concurrency-plus-nvfp4-on-blackwell"
html: "https://stuffthatspins.com/spin/concurrency-plus-nvfp4-on-blackwell"
json: "https://stuffthatspins.com/spin/concurrency-plus-nvfp4-on-blackwell.json"
markdown: "https://stuffthatspins.com/spin/concurrency-plus-nvfp4-on-blackwell.md"
keywords: ["SpinGraph", "spin analysis", "GEO"]
date: "2026-07-05T02:29:24+00:00"
modified: "2026-07-05T04:47:40.148581+00:00"
json_ld: |
  {"@context":"https://schema.org","@graph":[{"@type":"NewsArticle","@id":"https://stuffthatspins.com/spin/concurrency-plus-nvfp4-on-blackwell#article","headline":"Concurrency plus nvfp4 on Blackwell","description":"Parsed from VLLM log file ~2000 tps in aggregate performing bulk captioning on images. Above is parsed from vllm log while a client runs 30 concurrent streams, each concurrent stream has 1 request with an image and prompt, then a 2nd request on the same stream (so 1st Q:A would be cached). Typical …","datePublished":"2026-07-05T02:29:24+00:00","dateModified":"2026-07-05T04:47:40.148581+00:00","url":"https://stuffthatspins.com/spin/concurrency-plus-nvfp4-on-blackwell","mainEntityOfPage":{"@type":"WebPage","@id":"https://stuffthatspins.com/spin/concurrency-plus-nvfp4-on-blackwell"},"isAccessibleForFree":true,"inLanguage":"en-US","articleSection":"community","author":{"@type":"Organization","name":"Stuff That Spins"},"publisher":{"@id":"https://stuffthatspins.com/#organization"},"citation":"https://www.reddit.com/r/LocalLLaMA/comments/1unqkjy/concurrency_plus_nvfp4_on_blackwell/","about":[],"mentions":[]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Stuff That Spins","item":"https://stuffthatspins.com/"},{"@type":"ListItem","position":2,"name":"Concurrency plus nvfp4 on Blackwell","item":"https://stuffthatspins.com/spin/concurrency-plus-nvfp4-on-blackwell"}]}]}
---

# Concurrency plus nvfp4 on Blackwell

**Source:** Unknown  
**Published:** July 5, 2026  
**Original:** https://www.reddit.com/r/LocalLLaMA/comments/1unqkjy/concurrency_plus_nvfp4_on_blackwell/  

---
*HTML version: https://stuffthatspins.com/spin/concurrency-plus-nvfp4-on-blackwell*