https://shkspr.mobi/blog/2022/07/why-is-there-no-semantic-ontology-of-sentiment-in-academic-citations/ [apple-touc]Terence Eden's Blog Why is there no Semantic Ontology of Sentiment in Academic Citations? * By @edent [apple-touc] on 2022-07-10 * academia msc social media yak shaving * 3 comments * 800 words --------------------------------------------------------------------- About a million years ago, I was discussing the FOAF (Friend of a Friend) ontology with its early proponents. It allowed you to define a machine-readable semantic relationship like "Alice is married to Bill" and "Bill is Carol's child" and "Carol works for David". That sort of thing. At the time, all the FOAF relationships were defined in terms of positive sentiment. There wasn't (and still isn't) a FOAF representation for "divorced" or "estranged" or "fired by". I thought this was a failing. I understand why we all might want to play nice on the Internet. But sometimes it is useful to know about "negative" relationships. For example, I want to organise a seating plan for my wedding - it's helpful to know that Alice and Bill divorced and can't be on the same table, Carol doesn't talk to David. Bill is in a relationship with David and wants to keep it secret. Ellen would like to know Alice better. That sort of thing. More modern versions of FOAF have properties like enemyOf and wouldLikeToKnow. Which I think makes a great deal of sense. And so we come to Academic Citations. Using Google Scholar (or any other knowledge graph) I can find just about any academic paper. More importantly, it lets me see every paper which references that paper. Screenshot from Google Scholar. The book On farting: Language and laughter in the middle ages by V Allen has been cited by 106 other authors. Great! I can see if something has been cited lots of times, or very few times. That gives me a weak signal about its "importance". But it tells me nothing about the sentiment of those citations. Suppose I've just read (Smith, 2015) and I want to know whether the consensus is that the paper is a work of genius or absolute horseshit. What are my options? I can find all the citations of it, then manually read each one to determine whether the author thinks Smith is off their rocker or not. Wikidata has support for this. The Cites Work property can have roles like "objection" and "endorsement" Screenshot of a Wikidata page which lists papers which express an objection to the cited work. This means, in theory, someone could build a knowledge graph which says "Smith's argument rests on Jones' paper, but Xi's paper and Zhang's paper both object to Jones. Hook disagrees with Zhang's analysis, but these 500 papers disagree with Hook." Why is this important One problem that modern social media has is that its algorithms have no knowledge of sentiment. Whether you share a cute kitten video to make your friends smile or share a hateful message by a bigot in order to whip up a frenzy against them - the algorithm sees the same signal; +1. This means the outrage economy grows quickly. All "shares" are seen as positive sentiment. The algorithm sees lots of shares, interprets that a positive signal, and then further promotes the content - or similar content. There is very little way that a social network can filter content by "agrees with" or "disagrees with". Things like Facebook attempt to map sentiment with a series of emoji. Facebook sentiment emoji include, love, support, laughter, shock, sadness, and anger. In theory, you could tell Facebook not to show you posts which have more than 10% of anger reactions. Or only show you posts with positive sentiment. I say "in theory" because Facebook profits off your rage, so has no interest in helping you moderate your emotions. Popping back to academia for a moment. I recently read a paper that I disagreed with. I wanted to know if I was alone in my objection. This is currently no way for me to find all the citations which also disagree with the paper. Why this will never happen The first thing that stops this is that it is a lot of extra work for a human to perform. With hundreds of citations per paper, it would be a massive burden to categorise every single paper mentioned in passing. Most academics can't even be bothered to write alt-text for their images, so any extra labour is likely to be resisted. The second problem is that sentiment is hard! Can it be boiled down to just "agrees with" and "disagrees with"? What about "Agrees with methodology but not conclusion" or "Disagrees with some definitions but supports others"? There are hundreds of different sentiments. Even just positive and negative probably need degrees of strength associated with them. In the glorious future where DEEP AI and MACHINE CLEVERNESS rules, it might be possible for a computer to read an academic paper and determine whether it concurs with the papers referenced therein. Perhaps we need an army of (paid?) dogsbodies to manually go through every paper ever published and assess the sentiment behind each citation? But, for now, we have to make do with weak signals and uncertain sentiment. --------------------------------------------------------------------- Share the love: * Twitter * Facebook * LinkedIn * Reddit * HackerNews * Lobsters * Email * Pocket * Mastodon * WhatsApp * Telegram * Like this: Like Loading... More posts from around the site: 3 thoughts on "Why is there no Semantic Ontology of Sentiment in Academic Citations?" 1. 2022-07-10 16:11 [G3sBtHlb] [twitter] HackerNewsTop10 says: Why Is There No Semantic Ontology of Sentiment in Academic Citations? Link: shkspr.mobi/blog/2022/07/w... Comments: news.ycombinator.com/item?id=320449... Reply 2. 2022-07-10 19:37 [5ca1d47b] Jay Patel says: You may like Scite.ai (via Josh Nicholson), an AI startup working on exactly this problem. Also, I have (as an academic) been toying with similar ideas. A few papers in the Information Science field may be worth examining here. Reply 1. 2022-07-10 22:18 [63632727] @edent says: Any specific papers you'd reccomend? Reply Leave a Reply Cancel reply Your email address will not be published. Required fields are marked * [ ] [ ] [ ] [ ] [ ] [ ] [ ] Comment *[ ] Name * [ ] Email * [ ] Website [ ] [ ] Notify me of follow-up comments by email. [ ] Notify me of new posts by email. [Post Comment] [ ] [ ] [ ] [ ] [ ] [ ] [ ] D[ ] To respond on your own website, enter the URL of your response which should contain a link to this post's permalink URL. Your response will then appear (possibly after moderation) on this page. Want to update or remove your response? Update or delete your post and re-enter your post's URL again. (Learn More) [ ] [Ping me!] Found this post useful? Click the icons to support this blog More ways to support my blog Get new posts by email Enter your email address to subscribe to this blog and receive brand new posts by email. (Or subscribe to this [rss]Atom Feed.) Join 13,420 other subscribers. Email Address [ ] Free Sign Up Search Blog Posts Search for: [ ] [Search] Explore The Archives 2022 January 30 posts February 23 posts March 15 posts April 19 posts May 19 posts June 19 posts July 7 posts August September October November December 2021 January 31 posts February 28 posts March 31 posts April 30 posts May 31 posts June 30 posts July 31 posts August 31 posts September 30 posts October 31 posts November 30 posts December 31 posts 2020 January 31 posts February 29 posts March 31 posts April 30 posts May 31 posts June 30 posts July 31 posts August 31 posts September 30 posts October 31 posts November 30 posts December 31 posts 2019 January 31 posts February 12 posts March 17 posts April 12 posts May 12 posts June 10 posts July 7 posts August 5 posts September 6 posts October 14 posts November 30 posts December 17 posts 2018 January 8 posts February 4 posts March 6 posts April 14 posts May 5 posts June 6 posts July 6 posts August 13 posts September 14 posts October 8 posts November 30 posts December 4 posts 2017 January 12 posts February 9 posts March 8 posts April 4 posts May 10 posts June 5 posts July 5 posts August 6 posts September 3 posts October 4 posts November 30 posts December 2016 January 10 posts February 10 posts March 11 posts April 9 posts May 8 posts June 9 posts July 6 posts August 9 posts September 4 posts October 2 posts November 30 posts December 14 posts 2015 January 8 posts February 11 posts March 10 posts April 4 posts May 9 posts June 3 posts July 7 posts August 9 posts September 10 posts October 2 posts November 30 posts December 4 posts 2014 January 13 posts February 13 posts March 14 posts April 14 posts May 8 posts June 7 posts July 9 posts August 5 posts September 5 posts October 1 post November 30 posts December 20 posts 2013 January 25 posts February 17 posts March 15 posts April 18 posts May 11 posts June 14 posts July 6 posts August 14 posts September 6 posts October 4 posts November 30 posts December 14 posts 2012 January 14 posts February 8 posts March 13 posts April 15 posts May 10 posts June 16 posts July 8 posts August 8 posts September 6 posts October 6 posts November 30 posts December 31 posts 2011 January 13 posts February 11 posts March 11 posts April 12 posts May 8 posts June 8 posts July 6 posts August 5 posts September 11 posts October 7 posts November 30 posts December 17 posts 2010 January 6 posts February 15 posts March 12 posts April 13 posts May 4 posts June 3 posts July 15 posts August 8 posts September 11 posts October 9 posts November 30 posts December 9 posts 2009 January 1 post February 5 posts March 3 posts April 7 posts May 12 posts June 8 posts July 10 posts August 10 posts September 12 posts October 22 posts November 31 posts December 15 posts 2008 January 2 posts February March 2 posts April 3 posts May 2 posts June July 1 post August 3 posts September 1 post October 3 posts November 2 posts December 1 post 2007 January February March April May June July August September October November 4 posts December 5 posts 2006 January February March April 1 post May June July August September October November 1 post December 2005 January February March 1 post April May June July August September 1 post October November December 2004 January February March April May 5 posts June 3 posts July 1 post August September October November December 2003 January February March 2 posts April May June July August September October November December 2002 January February 1 post March April 3 posts May June July August September October November December 2001 January February March April May June July 1 post August September October 1 post November December 2000 January February March 1 post April May June July August September October November 1 post December 1999 January February March April May June July August September 1 post October November December 1 post 1997 January 1 post February March April May June July August September October November December 1995 January February March 1 post April May June July August September October November December 1987 January February March April May June July August September October November December 1 post * (c) Terence Eden * Contact Me * Subscribe * Citations * Support My Blog * About Me ISSN 2753-1570 %d bloggers like this: