Posted on

Smart-TV viewing recognition and household media profiles

A television used to know almost nothing about what passed through it.

A smart television can know considerably more.

One technique is automatic content recognition, usually shortened to ACR. The television samples or identifies material displayed on the screen and compares it with a reference database so the system can determine what program, movie, advertisement, or other content is being watched.

The important detail is that recognition can occur at the television layer rather than inside one particular streaming app.

The Vizio case showed how broad that view can become

In 2017, the Federal Trade Commission and the New Jersey Attorney General settled charges that Vizio collected viewing histories from 11 million smart televisions without adequate notice or consent.

According to the FTC, the televisions captured second-by-second information about video displayed from cable, broadband, set-top boxes, DVDs, over-the-air broadcasts, and streaming devices. The agency said Vizio then shared viewing information with third parties and enabled demographic information to be appended to those records.

See the FTC’s Vizio settlement announcement and its explanation of what Vizio was doing behind the TV screen.

The case is old enough to be historical, but the architecture is still useful to understand.

The screen itself can become a sensor.

A viewing record says more than “this show was on”

One recognized program means little.

A long sequence can describe a household’s habits:

  • which news programs appear regularly,
  • what sports are watched,
  • which streaming services or inputs are used,
  • what hours the television is active,
  • what advertisements were displayed,
  • what genres dominate the household’s viewing.

The television does not necessarily know which person in the room chose the program.

That is an important limitation.

A household profile is not automatically an individual profile.

People share televisions. Children watch adult accounts. Guests use the same screen. A program can play while nobody is paying attention.

Settings and downstream relationships matter

A modern investigation therefore needs more than proof that a television supports recognition technology.

The useful questions are whether the feature is enabled, what data is collected, what identifiers accompany it, which company receives it, how long the records are retained, and whether the information is shared or combined with other data.

The Vizio case also demonstrated why consent language matters. A feature can be described as improving recommendations or interactivity while carrying a much larger data-collection function than the label suggests.

The Surveillance Economy does not require a camera pointed at the couch.

Sometimes the television only needs to recognize what the couch is watching.