Retrieval and Feedback Models for Blog Feed Search

Retrieval and Feedback Models for Blog Feed Search SIGIR 2008 Singapore Jonathan Elsas, Jaime Arguello, Jamie Callan & Jaime Carbonell LTI/SCS/CMU

Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is a Feed? <xml> <feed> <entry> <author>Peter …</> <title>Good, Evil…</> <content>I’ve said…</> </entry> <entry> <author>Peter …</> <title>Agreeing…</> <content>Some peo…</> </entry> …

Blog-Feed Correspondence Blog Feed Post Entry HTML XML

Why are Blogs important? ,[object Object],[http://www.technorati.com/about/]

Feed Search at TREC ,[object Object],[object Object],[object Object],(a.k.a. Blog Distillation)

Feed Search at TREC ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Represent Ongoing Information Needs Frequently Very General

Challenges in Feed Search ,[object Object],entries time feed

[object Object],[object Object],Challenges in Feed Search entries time feed

Challenges in Feed Search ,[object Object],time Space Exploration topic NASA China’s plans for the moon shuttle launch My dog Mars rover Boeing

Challenges in Feed Search ,[object Object],[object Object],Space Exploration time topic

Challenges in Feed Search ,[object Object],[object Object],time

Challenges in Feed Search ,[object Object],[Mac] [Music] [Food] [Wine] … post regularly about new products , features , or application software of Apple Mac computers. … describing songs , biographies of musicians, musical styles and their influences of music on people are discussed. … such as tastings , reviews , food matching or pairing , and oenophile news and events . … describing experiences eating cuisines, culinary delights , recipes , nutrition plans .

Feeds: ,[object Object],[object Object],[object Object],Information Needs: General & Ongoing Challenges Our Approach Retrieval Models Feedback Models

Retrieval Models ,[object Object],[object Object],[object Object]

Large Document (Feed) Model [Q] <?xml… … </…> `<?xml… … </…> <?xml… … </…> <?xml… <feed> <entry> <entry> <entry> <entry> <entry> … </…> <?xml… … </…> <?xml… … </…> <?xml… … </…> <?xml… <feed> <entry> <entry> <entry> <entry> <entry> … </…> Feed Document Collection Ranked Feeds Rank by Indri’s standard retrieval model [Metzler and Croft, 2004; 2005]

Large Document (Feed) Model ,[object Object],[object Object],[object Object],[object Object],[object Object],Feed Entry E E Entry Entry E

Small Document (Entry) Model Ranked Entries [Q] <entry> <entry> <entry> <entry> <?xml… <entry> Entry Document Collection <entry> <entry> <entry> <entry> <?xml… <entry> <entry> <entry> <entry> <entry> <?xml… <entry> <entry> <entry> <entry> <entry> <?xml… <entry> <entry> <entry> <entry> <entry> <?xml… <entry> <entry> <entry> <entry> <entry> <?xml… <entry> <entry> <entry> <entry> <entry> <?xml… <entry> Ranked Feeds document = entry Apply some rank aggregation function Rank By

Small Document (Entry) Model ,[object Object],[object Object],[object Object],ReDDE Federated Search Algortihm [Si & Callan, 2003]

Entry Centrality ,[object Object],[object Object],time topic

Small Document (Entry) Model ,[object Object],[object Object],[object Object],[object Object],[object Object],Not only improves speed, Also performance Q

Retrieval Model Results ,[object Object],[object Object],[object Object]

Retrieval Model Results Mean Average Precision Large Document (Feed) Model Small Document (Entry) Models

Retrieval Model Results Mean Average Precision Uniform Log(Feed Length) Uniform Log Prior Map 0.188

Retrieval Model Results Mean Average Precision Uniform Log(Feed Length) Uniform n/a

Feedback Models ,[object Object],[object Object],[object Object]

Query Expansion (PRF) [Q] BLOG06 Collection Related Terms from top K documents [Q + Terms] [Lavrenko & Croft, 2001]

Query Expansion Example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[Photography] PRF photography nude erotic art girl free teen fashion women

Feedback Model Results Mean Average Precision None PRF

Query Expansion (Wikipedia PRF) [Q] BLOG06 Collection [Q + Terms] [Lavrenko & Croft, 2001] Wikipedia [Diaz & Metzler, 2006] Related Terms from top K documents

Query Expansion Example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[Photography] PRF photography nude erotic art girl free teen fashion women Wikipedia PRF photography director special film art camera music cinematographer photographic

Feedback Model Results Mean Average Precision None PRF Wiki. PRF

Query Expansion (Wikipedia Link) [Q] BLOG06 Collection [Q + Terms] Wikipedia Related Terms from link structure

Wikipedia Link-Based Query Expansion

Wikipedia Link-Based Expansion Wikipedia … Q

Wikipedia Link-Based Expansion … Relevance Set, Top R = 100 Working Set, Top W = 1000 Q Wikipedia

Wikipedia Link-Based Expansion … Wikipedia Q Relevance Set, Top R = 100 Working Set, Top W = 1000

Wikipedia Link-Based Expansion Relevance Set, Top R = 100 Working Set, Top W = 1000 … Wikipedia Extract anchor text from Working Set that link to the Relevance Set . Q

Wikipedia Link-Based Expansion Relevance Set, Top R = 500 Working Set, Top W = 1000 … Wikipedia Extract anchor text from Working Set that link to the Relevance Set . Q Combines relevance and popularity Relevance: An anchor phrase that links to a high ranked article gets a high score Popularity: An anchor phrase that links many times to a mid-ranked articles also gets high score

Query Expansion Example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[Photography] PRF photography nude erotic art girl free teen fashion women Ideal digital photography depth of field photographic film photojournalism cinematography

Feedback Model Results Mean Average Precision None PRF Wiki. PRF Wiki. Link

Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Thank You! Student Travel Grant funding from: ACM SIGIR, Amit Singhal, Microsoft Research

Entry Centrality GM Derivation where Entry Generation Likelihood: |E|

Query Expansion Examples ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[Music] PRF Music Country Download Free MP3 Mp3andmore Lyric Listen Song

Query Expansion Examples ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[Scottish Independence] PRF scotland independence party convention politics snp national people scot

Query Expansion Examples ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[Machine Learning] PRF learn machine credit card karaoke journal sex model sew

Query Generality Characteristics ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Relevance Set Cohesiveness … Relevance Set, Top R = 100 Wikipedia Cohesiveness = | L in | | L in U L out |

Is it the Queries? ,[object Object],[object Object],[object Object],But, none of these measures predict whether wikipedia expansions helps…

Retrieval and Feedback Models for Blog Feed Search

Recommended

Recommended

More Related Content

Similar to Retrieval and Feedback Models for Blog Feed Search

Similar to Retrieval and Feedback Models for Blog Feed Search (20)

Recently uploaded

Recently uploaded (20)

Retrieval and Feedback Models for Blog Feed Search