IO — Ivan Labs

The Technical Fundamentals of Low-Latency Streaming

3 Min. Lesezeit
RefluxHardware

Dieser Artikel ist bisher nur auf Englisch verfügbar.

Latency in video streaming comes from several distinct stages, each with its own trade-offs — understanding them explains why some approaches are inherently faster than others.

The stages that add up to total latency

Total latency is the sum of: capture time, encoding time, network transmission time, buffering time (often the largest and most controllable factor), and decoding/display time on the receiving end.

Of these, buffering is usually the largest and most deliberately-chosen factor — it's a design decision, not an unavoidable physical cost the way encoding and transmission partially are.

Why buffering exists and why it adds delay

Network conditions vary — packets arrive at inconsistent intervals (jitter), and buffering smooths this out by holding a small queue of data before playback, so brief network hiccups don't cause visible stutter. More buffer means more resilience to bad network conditions, at the direct cost of more delay between "this happened" and "you see it."

Protocol choice matters more than codec choice for latency

ApproachTypical latencyBuilt for
RTMP → platform (Twitch/YouTube) → HLS/DASH to viewersSeveral secondsReliable delivery to many simultaneous viewers, at scale
WebRTC (peer-to-peer or SFU-based)Sub-secondReal-time, interactive communication (video calls)

RTMP/HLS-based pipelines are built around the assumption that many viewers need a reliable stream and some latency is an acceptable cost for that reliability. WebRTC is built around the opposite assumption — a small number of participants where responsiveness matters more than large-scale reliability.

Codec choice: a secondary factor

Modern codecs (H.264, H.265/HEVC, AV1) differ in compression efficiency and encoding speed, which affects bandwidth usage and how much CPU/GPU work encoding requires — this can matter for latency on weaker hardware where encoding itself becomes a bottleneck, but it's a smaller factor than the buffering/protocol choice above for most real-world setups.

Why this isn't a solved, one-size-fits-all problem

A platform serving millions of simultaneous viewers genuinely needs the reliability that buffering provides — removing it would cause visible stutter for a meaningful share of those viewers on imperfect connections. A tool built for one-to-one, real-time interaction (like Reflux) can make the opposite trade, since the resilience buffering provides matters less than the responsiveness it costs, for that specific, smaller-scale use case.

This is the underlying technical reasoning behind why platform streaming inherently has delay that isn't fixable through OBS settings alone.

Häufige Fragen

What's the main difference between RTMP/HLS and WebRTC for latency?

RTMP/HLS-based pipelines (used by most platform streaming) are built around buffering for reliability at scale, typically adding several seconds of delay. WebRTC is built specifically for real-time, sub-second communication (video calls), trading some of that buffering resilience for speed.

Does a faster codec always mean lower latency?

Encoding speed is one factor among several — network transport method and buffering strategy usually matter more for overall latency than which specific codec is used, though a slow encoder can still be a bottleneck on weaker hardware.

Can you get zero latency in video streaming?

No — encoding, network transmission, and decoding all take some non-zero time. 'Low latency' means minimizing this to a small fraction of a second, not eliminating it entirely, which isn't physically possible.

Brauchst du Hilfe dabei?

Melde dich, und ich helfe dir weiter.

Kontaktiere mich

Ähnliche Artikel

Teilen:X / TwitterLinkedIn