ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement

Summary:

This paper is about using AI to predict where people look in short video ads, moment by moment, and using that to judge viewer engagement.

It introduces a new model called ViASNet for dynamic saliency in video advertising.

It was published on arXiv by the paper's authors, Jianping Ye and Michel Wedel. The main goal was to build a better model for video ads, test how well it predicts eye movements, and show how its output might help spot scenes that do not hold attention.

The authors trained and tested the model on 151 video ads.

Each ad was viewed by about 20 people while their eye movements were tracked. They also ran ablation tests, which means they removed parts of the model to see which pieces mattered most. They then showed how frame-by-frame entropy from the predicted saliency maps could be used on 15 unseen ads as a simple warning sign for weak engagement.

The main findings are that ViASNet was built to handle not just the video itself but also audio and scene meaning, and the authors say this improves prediction for video ads.

They report testing it on a sizeable set of ads with eye-tracking data rather than only on generic video benchmarks. They also say the ablation experiments helped identify which inputs and model parts drive performance.

Another key result is the use of saliency-map entropy as a practical diagnostic: higher or changing entropy can help flag ads or scenes that may fail to focus viewer attention.

The paper's broader claim is that this kind of automated saliency prediction could speed up ad design and testing by reducing the need for slower manual review.