Cover of The Television, a book by Ketineni RamaraoFrom the book The Television
Chapters 17 and 33 to 39. Read the full book free as a PDF.

What makes a TV smart

A smart TV combines normal television with internet connectivity and interactive features. Instead of only displaying a broadcast signal, it runs an operating system, such as Android TV, Tizen, webOS or Roku OS, connects over Wi-Fi, and streams from apps. Many are also 4K, which describes resolution only: 3840 by 2160 pixels, about 8.3 million pixels, four times Full HD. Smart and 4K are separate things.

The signal path

Three jobs run in sequence. The TV receives a signal from an HDMI cable, an antenna, Wi-Fi streaming or a USB drive. Its main processor, in effect a small computer, decodes video and audio, scales lower-resolution content to fit the screen, applies picture enhancement such as colour correction, motion smoothing and HDR, and runs the operating system. The processed picture then goes to the display panel pixel by pixel, while audio goes to the speakers or an HDMI-ARC sound system.

Four boxes in a row showing a smart TV signal path: signal in, main board with system-on-chip, timing controller, and panel with audio output.
A smart TV signal path. Original IOI diagram.

The load is heavy. At 4K and 60 frames a second a processor handles roughly 500 million pixels a second, which is why sets need capable chips.

What is inside

The chip that runs it

The system-on-chip is the biggest chip on the main board, usually under a heatsink in a package 20 to 40 mm square. It combines the CPU, GPU, video decoders, display processor, memory controllers and often an AI accelerator. EngineersGarage names five companies that dominate TV chips: MediaTek, LG, Samsung, Realtek and Novatek, and says MediaTek chips power more than 60 percent of smart TVs. Separate memory chips sit next to it. Budget Roku and Fire TVs use about 1.5 GB of RAM, mid-range sets 2 to 3 GB, premium models 4 to 8 GB, and a few 2025 flagships 16 GB. The operating system, apps and user data live on a flash chip soldered to the board. A smart TV is, in effect, a phone-class computer attached to a large screen.

The part that watches back

Because the TV sees the picture it is showing, it can identify what is on the screen. In 2017 the US Federal Trade Commission and the New Jersey Attorney General announced a $2.2 million settlement with Vizio, one of the largest smart TV makers. According to their complaint, starting in February 2014 Vizio TVs captured second-by-second information about the video displayed, whether it came from cable, a set-top box, streaming devices, DVDs or over-the-air broadcasts. The FTC blog says the company matched a selection of pixels on screen to a database of programmes and adverts, captured up to 100 billion data points a day from millions of sets, and passed IP addresses to data aggregators. The company sold the resulting viewing histories to advertisers and others. The order requires prominent disclosure and affirmative express consent for such collection, and deletion of data gathered before 1 March 2016.

That case concerned one company. It shows what the architecture allows: a networked computer between you and the picture. Its history starts with the scanned dots in how television works.

Quick answers

What is a smart TV?

A television with an operating system, internet connection and apps, so it can stream video and run interactive features as well as show broadcast signals.

How does a smart TV process a picture?

The main board processor decodes the video, scales and enhances it, and then a timing controller sends it to the panel pixel by pixel.

Can a smart TV track what I watch?

Some have. In 2017 Vizio settled with the FTC and New Jersey for $2.2 million over collecting second-by-second viewing data from 11 million TVs without consent.

Go deeper in the book: The Television · PDF · Source Companion · Browse the category

Sources

The architecture, chip, memory, 4K and pixel-rate figures are from EngineersGarage, a single secondary source. The tracking case is from the FTC press release and the FTC business blog. The allegations are reported as the complaint's allegations, and the order terms are from the FTC release.

More from this book

History · From the book The Television

Who invented the television?

There is no single inventor of television, and anyone who gives one name is leaving out two others.

Explainer · From the book The Television

How television works

A television never shows a moving picture.

Explainer · From the book The Television

How CRT TVs work

For most of the twentieth century a television was a glass vacuum tube with an electron gun at one end and a glowing screen at the other.

Explainer · From the book The Television

How LCD and OLED TVs work

A flat panel has no beam and no tube.