Abstract
We consider the problem of content-based automated tag learning. In particular, we address semantic variations (sub-tags) of the tag. Each video in the training set is assumed to be associated with a sub-tag label, and we treat this sub-tag label as latent information. A latent learning framework based on LogitBoost is proposed, which jointly considers both the tag label and the latent sub-tag label. The latent sub-tag information is exploited in our framework to assist the learning of our end goal, i.e., tag prediction. We use the cowatch information to initialize the learning process. In experiments, we show that the proposed method achieves significantly better results over baselines on a large-scale testing video set which contains about 50 million YouTube videos.
Keywords
Discriminative modelComputer scienceProbabilistic latent semantic analysisArtificial intelligenceLatent Dirichlet allocationInformation retrievalTopic modelWorld Wide Web
Affiliated Institutions
Related Publications
Up next
The explosive growth in sharing and consumption of the video content on the web creates a unique opportunity for scientific advances in video retrieval, recommendation and disco...
Comment-based multi-view clustering of web 2.0 items
Clustering Web 2.0 items (i.e., web resources like videos, images) into semantic groups benefits many applications, such as organizing items, generating meaningful tags and impr...
Recognizing realistic actions from videos “in the wild”
In this paper, we present a systematic framework for recognizing realistic actions from videos “in the wild.” Such unconstrained videos are abundant in personal collections as w...
Action recognition by dense trajectories
Feature trajectories have shown to be efficient for rep-resenting videos. Typically, they are extracted using the KLT tracker or matching SIFT descriptors between frames. Howeve...
Modeling scenes with local descriptors and latent aspects
We present a new approach to model visual scenes in image collections, based on local invariant features and probabilistic latent space models. Our formulation provides answers ...
Publication Info
- Year
- 2011
- Type
- article
- Pages
- 3217-3224
- Citations
- 40
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
40
OpenAlex
Cite This
Weilong Yang,
George Toderici
(2011).
Discriminative tag learning on YouTube videos with latent sub-tags.
, 3217-3224.
https://doi.org/10.1109/cvpr.2011.5995402
Identifiers
- DOI
- 10.1109/cvpr.2011.5995402