Feel free to follow Student Activism on Twitter or Facebook, if you like. You can also read this essay in German, if you like.
December 8 Update: Twitter released an official statement on the Wikileaks trending controversy this afternoon. I’ll have a full response soon, but for now I’ll just say that it doesn’t seem to me that it fits the data I’ve presented here.
December 11 Update: This has been an absurdly busy week in the world of things-this-blog-is-interested-in, but here it is at long last: How Twitter Kept Wikileaks from Trending, and Why.
Okay, this is a little ridiculous.
A week ago, I wrote a piece dismissing the idea that Twitter was actively working to keep Wikileaks out of its trending topics lists. This morning, I wrote a followup in which I continued to express skepticism that any monkey business was going on, but acknowledged that the data were really kind of weird.
Now I’ve gone back and compared long-term traffic patterns for “Sundays,” one of today’s big global trending topics, with those of “Wikileaks,” and I have to say I’m kind of flabbergasted. If the data I have are accurate, something very very strange is going on.
Here. Let me show you.
(click each chart to view full size)
This is the last 180 days of Twitter traffic data for “Sundays,” taken from the Trendistic website. We can see that the word peaks every weekend — unsurprisingly — and that it’s grown only slightly in volume since mid-July. With the exception of today’s large spike, the biggest weekend bump for Sundays was only about double the volume of the smallest.
Looking at trending topic data from Twend It, however, we see that Sundays has trended four times in the last two months — on September 26, October 18, November 21-22, and today. The first two of those “trend incidents” took place on completely ordinary days for Sundays (measured by total volume), and the third, which lasted much longer, took place on a weekend when traffic for the phrase spiked over a longer period of time, but no higher, than it had in the past.
Why is this significant? Because, as I wrote this morning, Twitter claims that a phrase’s novelty is a major predictor of whether it’ll trend or not. But “Sundays” is the opposite of novel — it’s a term that spikes once a week, every week, in pretty much the same way at pretty much the same time. By the criterion of novelty, Sundays should be at a huge disadvantage versus hundreds of other terms — including, yes, Wikileaks — in making the trending topics list.
Take a look at the Trendistic chart for Wikileaks over the same 180-day period and you’ll see what I’m talking about.
The first thing that jumps out, obviously, is that Wikileaks’ traffic pattern is far less regular than Sundays’. There are a few large-ish spikes, some extended periods of lower but still significant activity, and a bunch of long stretches when nothing’s going on at all.
If we look a little closer, we see that there’s very little happening here until the first spike, which comes on July 26. Activity then tails off gradually over the next month, with a second, smaller spike on August 21, and then almost nothing for two months. There’s a third spike — slightly smaller than the first, but much longer lasting — beginning on October 24. Traffic begins rising again in mid-November, spikes on November 29 at a volume four times that of the August peak, and has since settled in at a plateau about two-thirds the height of the November 29 spike ever since.
If you asked me, I’d say — just off the top of my head — that there are three or four obvious places on this chart where I’d have expected Wikileaks to trend, with the most recent being the most obvious. But if we look at Twend It, we see that it trended for thirty-eight hours over the course of three days at the time of the July spike, for less than two hours on August 21, and never again since.
Let me repeat that. Wikileaks trended on Twitter for three days following the first spike on the chart above, for two hours at the time of the smaller spike right next to it, and not at all for the third similar spike or the huge one that’s still going on now.
Weird, right?
But no. That’s not the weird part. This is the weird part.
This chart tracks Sundays and Wikileaks over the last 180 days, with each term’s volume drawn to scale. The red spires? Wikileaks. The blue dust at the base of those spires? Sundays. The tiny blue uptick in the lower left hand corner of the chart has had Sundays trending for more than twelve hours today, while Wikileaks has been completely dark since August.
What the hell is going on here?
As I said in my last two posts, I don’t care that much about trending topics lists. I’m a big believer in online organizing, but I just don’t think getting your cause to trend is all that important in the grand scheme of things. But this, like I say, is ridiculous.
December 6, Morning | Be sure to read the full exchange between myself and Josh Elman of Twitter in comments — it’s illuminating in its own way. There’s a bunch of other important new info and analysis in the comments thread, too. I’ll be continuing to follow this story on Twitter over the course of the day, and I’m hoping to have a full new post up sometime this afternoon.
Also, you know, feel free to check out the rest of the site. Welcome!
December 6, Late Morning | Blogger Bubbloy has a post up that covers similar ground to this one in a complementary (and complimentary!) way. Be sure to check out the discussion of the “oil spill” trending topic in the second update.
146 comments
Comments feed for this article
December 5, 2010 at 5:15 pm
dettman
Twitter postponed scheduled maintenance at the request of the State Department during the Iranian election in 2009, so that the opposition to Ahmadinejad could document what was happening on the streets. Do we think that Twitter did this because of their love of democracy in Iran, or because it was the State Department who asked? It’s not a stretch to think that the government has requested or even pressured Twitter to repress trends related to Wikileaks, as a form of soft censorship.
December 5, 2010 at 5:31 pm
Left Outside
I’m still under the impression that Twitter doesn’t make any money. That would mean that even subtle suggestions from those with lawyers, guns and money could provoke a disproportionately supplicant response because they need to avoid large up front costs like going through the courts. Just a theory.
December 5, 2010 at 6:29 pm
Tom Schaffer
would it be ok for you, if we translate this post into german and distribute it on our blog zurpolitik.com?
December 5, 2010 at 6:31 pm
Angus Johnston
Sure. Just let me know and link back here.
December 5, 2010 at 7:36 pm
gregorylent
which is why i said i didn’t believe you, in your earlier post about this. thanks for continuing.
December 5, 2010 at 7:41 pm
Josh Elman
Hi – I work at Twitter on trends and other projects. Twitter hasn’t modified trends in any way to help or prevent wikileaks from trending. #cablegate was trending last weekend and various terms around this issue have trended in different regions over the past week. Trends isn’t just about volume of a term but also the diversity of people and tweets about a term and looking for organic volume increases above the norm. I hope this helps.
December 5, 2010 at 7:42 pm
Garrett W.
I think you meant to say “while Wikileaks has been completely dark since August.”
December 5, 2010 at 7:43 pm
Vukašin
In the paragraph before last you may have meant Wikileaks instead of Wikipedia.
December 5, 2010 at 7:59 pm
Sharon
I did the same thing to just like you a few minutes ago. the trend for #wikileaks #imwikileaks are all 3 times stronger yet not one of the trending hash tags listed. This is good because we now know who is Government controlled. Paypal, Amazon, Twitter…. but Facebook is still hanging in there.
December 5, 2010 at 8:03 pm
slu
Stop using Twitter, use identi.ca
December 5, 2010 at 8:06 pm
slu
http://thisisabore.net/post/2010/12/02/Why-Identi.ca-(and-Status.net)-matter-in-a-Twitter-world
December 5, 2010 at 8:13 pm
Tom Schaffer
thanks for allowing me to translate this angus. you can find the German translation here – various links to this site are of course included http://zurpolitik.com/2010/12/06/warum-ist-wikileaks-kein-trending-topic-bei-twitter/
December 5, 2010 at 8:30 pm
Angus Johnston
@Garrett, Vukasin: Thanks. I made that error countless times when writing the post, but caught it all but one.
@Tom: Thank you! I’ll add a link to the post.
December 5, 2010 at 8:31 pm
Julien
http://www.rawstory.com/rs/2010/12/students-warned-read-wikileaks-government-job/
December 5, 2010 at 8:47 pm
Emma G.
Great piece. Coincidentally, guess who provides DNS for Twitter? Dyn Inc.aka EveryDNS aka the DNS provider who pulled the plug on the WikiLeaks domain.
What a tangled web…..
December 5, 2010 at 8:53 pm
Angus Johnston
@Josh: Thanks for writing, and thanks for bringing up #cablegate — I mentioned it in a previous post, and indeed cited it as counter-evidence to the conspiracy theories.
I hope you’d agree that #Wikipedia has seen an “organic volume increase above the norm” in the last week — it’s one of the most talked-about topics in the world right now, on or off Twitter, and the fact that subsidiary topics around it have trended reflects that. Again, note that I’m not accusing Twitter of anything nefarious here, and I would be happy to have this explained.
But since you bring up the sujbect of other terms relating to Wikileaks, let’s take a look at perhaps the most prominent of those terms — “Assange.” Julian Assange’s last name trended briefly in July, August, and October, peaking at 0.04%, 0.13%, and 0.12% of Twitter traffic respectively. But it hasn’t trended again since — not when it hit 0.29% of traffic on November 30, not when it hit 0.26% on December 1, not even when it hit 0.55% on December 3. (I take these figures from Trendistic and Twend.It — please correct them if they’re erroneous.)
This just seems bizarrely counter-intuitive to me. On Friday Assange’s name was getting four times the traffic that it had received the last time it trended, and yet there wasn’t so much of a hiccup.
And yes, I understand — as I said in a previous post — that not all Tweets are created equal when it comes to trending. I get that. But that brings us back to #cablegate. It trended for a total of 22 hours at the end of November, despite being the least “organic” hashtag imaginable — it was devised and promulgated by Wikileaks itself.
If you’re still with me, I’d like to ask a couple of questions — as well as welcoming comment on anything I’ve written so far.
First, could you give me some examples of other news-related terms that have failed to trend for similar reasons to “Wikileaks,” despite receiving similar traffic? That’s a data point that would go a long way to demonstrating that the current situation is an artifact rather than an intended result.
Second, could you indicate whether Twitter is reviewing its trending algorithm in response to this situation? Because again, it just seems bizarre to me — and I’m curious to know whether it seems bizarre to you too — that the biggest global news story of the year would fail to trend under these circumstances.
Thanks.
December 5, 2010 at 8:59 pm
tempo dulu
But preventing wikileaks from becoming a trending topic would be a futile exercise anyway. After all, you can easily see all the latest tweets on wikileaks in twitter just by doing a simple search.
December 5, 2010 at 9:02 pm
Still More Questions About Why Wikileaks Hasn't Trended On Twitter … | The Daily Conservative
[…] Still More Questions About Why Wikileaks Hasn't Trended On Twitter … Share and […]
December 5, 2010 at 9:16 pm
Josh Elman
We are constantly reviewing the trends algorithms but not in particular response to this question.
The various terms around Wikileaks are showing up on our trends dashboards but are just not breaking into the top tens that appear in the product. While I personally feel this is a very important topic, that doesn’t mean it’s as widespread across the twitter userbase. And what’s amazing with Twitter is that each of us gets a personalized timeline of things that are relevant to us, so even if we think *everyone* is talking about something, it still may not be widespread enough to be in top trends.
December 5, 2010 at 9:42 pm
Angus Johnston
@Josh: Thanks for the reply. Two more questions, for now:
First, again, can you think of any similar “failure to trend” in the past? A non-generic hashtag doing huge traffic, spiking quickly to the stratosphere as it’s never done before, and not trending? If so, which?
Second, can you speak to whether #cablegate was more “widespread” than Wikileaks or Assange? Because that seems highly unlikely to me. As I said above, that struck me as an extremely insiderish tag.
December 5, 2010 at 10:00 pm
Ben Borges
Ok twitter, if you are not censoring, why not create a page where we can get access to the TOP 100 trends then ? this would show that you care about users, and what they care about.
and in the same time, this would let people browse through the trending topics easely, and maybe let more people discover new trends..
keep smiling :)
December 5, 2010 at 10:14 pm
bri
man, your algorithms are esoterics xD
December 5, 2010 at 10:29 pm
noreen
That was interesting to read. Agree, it is indeed ridiculous. First amazon, then paypal and now twitter. What can we trust?
December 5, 2010 at 11:06 pm
Bob Boynton
How they ‘compute’ is a mystery, but shortchanging wikileaks probably is not unique. If you check Obama and trending topics he almost always is in the middle in terms of tweets, but he almost never trends — unlike Justin Bieber who trended for months with, often, fewer tweets. I think they like entertainment, natural disasters, and little else.
December 5, 2010 at 11:10 pm
Toshia
The links to twitters response don’t work on my iPhone
December 5, 2010 at 11:46 pm
Josh Elman
@Ben – good idea. We’ll explore that in future iterations.
@Angus – over time and the life of stories, there are many things that don’t continue to trend — the bp oil spill was a great case where it trended early but over time didn’t continue to trend even though it continued to make headlines. And in this case #cablegate did far exceed the velocity and diversity of wikileaks when it was trending – even if that’s contrary to your assumptions.
Hope that
December 5, 2010 at 11:56 pm
Maritza van den Heuvel
There have been a few culturally relevant topics in the past few months that haven’t trended when one would think they should.
A simple example from the movies, is the recent release of Harry Potter and the Deathly Hallows, Part 1. Even though traffic started at 0.14% on November 17 and peaked at 0.85% on November 19 before coming down to 0.41% on November 21, the only trending topic related to Harry Potter over the movie’s first weekend box office release was Dobby, despite a large number of #HP7 and #DeathlyHallows tags also being used. [Stats courtesy of Trendistic].
At the time, I researched the Twitter algorithm to find out why this is happening. The issue seems to be the way they changed their algorithm a few months ago to respond to the complaints about Bieber trending all the time.
However they have modified their algorithm, it’s no longer giving a true reflection of what people are discussing on a daily basis, whether it’s politics or pop culture. We asked for censorship on Twitter, and we got it. And this is the result.
December 6, 2010 at 12:02 am
gediel
other options that offer services like Twitter?
December 6, 2010 at 12:02 am
Angus Johnston
@Josh, the full history of the “oil spill” trends isn’t available on Twend.It, but what’s there shows a very different profile than Wikileaks’. I don’t want to get too far into the weeds here, but that story trended every day for months, then dropped off, then returned without any huge new spike in traffic.
As for Wikileaks vs Cablegate, Trendistics stats show what one would expect to be the case — that most tweets used the organic term (Wikileaks) rather than the synthetic one (Cablegate). At #cablegate’s peak it was garnering only a quarter of the traffic that Wikileaks was at the same time. So unless “velocity” means something different to you than volume, or Trendistics’ stats are wildly off, I’m left a bit confused.
December 6, 2010 at 12:14 am
Josh Elman
@angus – it’s not just about sheer “most tweets” – there’s more science on this including how diverse the tweets and the tweeters are. It’s not tuned to show “here are the specific most discussed things on twitter right now”, but more “here are the top things on twitter being discussed a lot more than usual right now”. We’re constantly optimizing this for better insights into what people care about and are talking about, and fighting spam. it’s not perfect and like any algorithm raises questions on its performance.
While we can’t go into the full algorithm, I can assure you and reconfirm the original question here – we did not modify anything to help or prevent wikileaks and related topics from appearing in Twitter trends.
December 6, 2010 at 12:25 am
Angus Johnston
@Josh: I get that there’s a complex algorithm. I said as much in this post and discussed it in detail in my previous two. But you said that Cablegate “did far exceed” Wikileaks in “velocity and diversity” when it trended — if by “velocity” you didn’t mean “volume,” what did you mean?
And again — we’re at the point where we’re going around in circles, but I’ll persevere a little longer — my exact point is that Wikileaks was “being discussed a lot more than usual” for much of the past week, and didn’t trend. It was discussed FAR more than it ever had been in the past, in fact.
My argument isn’t based on raw volume. Never has been.
December 6, 2010 at 12:26 am
Still More Questions About Why Wikileaks Hasn’t Trended On Twitter … | 6d
[…] The first thing that jumps out, obviously, is that Wikileaks‘ traffic pattern is far less regular than Sundays’. There are a few large-ish spikes, some extended periods of lower but still significant activity, and a bunch of long … Persistent Search […]
December 6, 2010 at 12:36 am
Øyvind
@Josh But how come Sundays manage to trend with so few and so regular tweet patterns then? It doesn’t make sense.
@giedel identi.ca is a non-censoring twitter alternative
December 6, 2010 at 12:54 am
Jim Morris
Hi Guys, feel free to delete my post if it is irrelevant. I know nada about trending and the like but stumbled on your thread and wondered if this meant anything. I have been attempting to drive traffic from twitter to an article on Bukisa.com using #WikiLeaks #imWikiLeaks and #cablegates in each post along with a url. Needless to say I managed around 25 site visits from twitter.com and search.twitter.com
In my Top Search Stats page however I have only two results:
Phrase Unique Visitors
#cablegate site:twitter.com 2
Calls to assassinate julian 1
Don’t laugh about my mediocore traffic but I was wondering why there would be no visitors showing for either #wikileaks or #imwikileaks considering that both were contained in 4 out of 5 of my tweets. I assumed these two terms would have generated more of the traffic.
Each Tweet contained the followin # items
17hrs ago Tweet 1 – #Wikileaks, #imwikileaks, #wikileaksAus, #washington
10hrs ago Tweet 2 – #Wikileaks, #imwikileaks, #wikileaksAus, #cablegate
4hrs ago Tweet 3 – #Wikileaks, #imwikileaks, #wikileaksAus, #cablegate
4hrs ago Tweet 4 – #Wikileaks, #imwikileaks, #wikileaksAus, #cablegate
45mins ago Tweet 5 – #Wikileaks, #cablegate.
Like I said, don’t know if this is at all relevant to your discussion. Apologies if it was a wasted post but it struck me kind of peculiar that #wikileaks and #imwikileaks didn’t show up in the stats even once.
Cheers
December 6, 2010 at 2:24 am
Josh Elman
@Angus — I agree trends are an ongoing area we can make a lot of improvement both to the algorithms and to the understanding and visualization of what’s going on. There’s no perfect answer here, just that the algorithm is doing what it’s always done, and for whatever reasons wikileaks isn’t rising above to become a top 10 trend. Turns out while it’s high in volume, particularly in certain demographics, etc, it’s not that popular across all of Twitter. But it’s still prominent, no doubt. For trends, a basic answer is that trends create a history model of average term usage over hours/days. We look over a most recent period and compare to that model to look for conversation that is immediately well above average for a time period. The very top terms are displayed as trends. In the case of Sundays, while it trends very rarely, there are Sundays where everyone tweets Sunday and that’s far over the normal hourly/daily averages (since most other days, no one tweets Sunday). For Wikileaks, there was an immediate spike — particularly last weekend — and terms like #cablegate trended. That said, the discussion has been fairly consistent and ongoing, so it’s not like any single day or hour has significantly more than another day or hour, so hence it doesn’t continue to trend. That’s why I said “velocity” over “volume”.
December 6, 2010 at 3:41 am
Cotton
Mr Elman, if what you say is true, then your algorithm has failed everyone. Wikileaks and related keywords were extremely popular, in and out of Twitter, all this past week. And yet, they never trended. Some of it, should have had, at some point. But they didn’t, and this is very disturbing.
When Google was called out on its search engine algorithms last week, it had a solution ready within a few days. I expect nothing less from Twitter. I expect this discrepancy that doesn’t really show the true Twitter trends, to be fixed at the very earliest. Otherwise, you will continue to be called out by people all over the place, and be “misunderstood,” and eventually lose users and credibility.
December 6, 2010 at 4:23 am
Jotman
Josh Elman, you wrote:
“There’s no perfect answer here, just that the algorithm is doing what it’s always done, and for whatever reasons wikileaks isn’t rising above to become a top 10 trend.”
“Whatever reasons” is no secret. Either you haven’t been told or you are not supposed to say.
The reason Agnus went to a lot of effort is because Twitter has a rather serious credibility problem on its hands. He’s trying to help Twitter fix a credibility problem. We want to trust Twitter, but Twitter is making this more difficult than it needs to be.
“Whatever reasons” isn’t good enough.
December 6, 2010 at 5:59 am
Still More Questions About Why Wikileaks Hasn't Trended On Twitter … | Internet News
[…] post: Still More Questions About Why Wikileaks Hasn't Trended On Twitter … Random Posts20 Most Popular Facebook Cartoon Profile Pics of the 90s, 80s, 70s … (0)What were […]
December 6, 2010 at 6:19 am
Aaron
I don’t believe this alleged twitter employee at all. Old Joe Lieberman leaned on Amazon and Paypal and they folded. There’s no reason he wouldn’t have leaned on Twitter – especially as twitter trending would demonstrate the HUGE interest among citizens over wikileaks’ releases, even in the dumbed-down US media environment.
All we need now is for someone who works @ twitter to leak meeting memos where manipulation of trending topics is discussed. The explanation given over the wikileaks / cablegate trending disparity is not convincing. So it’s something else – I posit there’s a kill option for a trend.
In the long term if twitter doesn’t alter this behaviour a P2P replacement will emerge that is immune to political interference. I say the sooner the better.
@Josh – Are you writing in a personal or professional capacity?
December 6, 2010 at 6:25 am
Carme
I follow my twitter stats every month and the figures of November were obviously wrong. I have no idea about what’s going on, but figures of November were a mess.
December 6, 2010 at 7:01 am
Goldie
Hi guys,
pardon my english, it’s not my native language.
What I understand for why wikileaks is not a trending topic, is that there are not enough people talking about it, and that the huge twitts about it are meanly sent by the same group of people.
That’s what I understand from Josh answers.
But I seriously doubt of it.
December 6, 2010 at 7:06 am
MrTiggr
@Angus (and @Josh for further confirmation maybe?)
Although i am normally the first to jump on the “they’re just against Assange/Wikileaks” bandwagon…AND your article DID get me thinking – i am pretty sure that (based upon some ‘reading-between-the-lines’ of @Josh’s comments) i can explain why wikileaks doesn’t trend “as expected” and also answer why Sunday does!…
1.) Twitter’s trending algorithm does not just do a “whats hot across twitter as a single entity” calculation (thus velocity not being based on raw volume) instead, i assume (i am a software engineer working in Social Networking and GIS) that the algorithm instead relies on accumulative “trends” based upon “clusters” from the entire Twitter social graph. So, in order to trend, a topic must be unusually active within a large percentage of the “sub-pockets” or clusters within the graph.
2.) Within the graph of most social networks, there are nodes who exhibit a statistically high connectivity (i.e. in the Twitter sense, these are the users/lists with high numbers of followers) which might be called supernodes. In the case of the wikileaks twitter user, at last count they have 398,764 Followers…which, although in the scope of the (estimated) 190 Million twitter users is less than a percentage point, it may well be elevated to the “supernode” status by considering the facts that the average twitter user has around 27 followers; thus the cluster that wikileaks forms quickly consumes a significant? portion of the twitter user base! – this would be compounded when you consider up to 25% of accounts have no followers, up to 40% of accounts are inactive and up to 80% of all active users have sent less than 10 tweets ever! ..i think this would make the wikileaks userbase a statistically significant cluster size for the trending algorithm.
3.) “Trending” is about statistically unusual activity…i posture that a large amount of the “wikileaks” activity on twitter occurs within the wkilileaks supernode cluster (sounds like a breakfast cereal!)…unfortunately, being a “specialist” cluster, most content posted therein is in regard to wikileaks…so from a statistical standpoint tweeting about wikileaks within that cluster is NOT a trend but the NORMAL! basically, no matter what you do within that cluster talking about wikileaks will not add “wikileaks” to the candidate trends!…this is compounded by the fact that some 14,946 of wikileaks followers are lists because lists again represent specialist groups co the clusters that form around them are not likely to produce a “trend” effect either!
SO WHAT ABOUT SUNDAY!?
Well…firstly, there is no statistically significant “Specialist” supernode that affect the sunday keyword i.e: people don’t generally subscribe to Sunday-Specific content, there certainly isn’t the groundswell of support for sundays that there is for wikileaks!! ;D …this, in turn means that posts that mention/tag sunday are likely to come from a large variety of the clusters in the network (and not always the same clusters). Also, the posts about sundays are likely to occur at the same rough time within these clusters and (given the topic-specific way that we tend to cluster within the twitter network) appear to be “off-topic” more often and thus constitute a “trend”.
I may be WAY off base here and, so in order to check – i am actually modifying some twitter statistics software i have written (using the Twitter Streaming API – thanks guys!) to confirm my suspicions – i will certainly keep you posted if you are interested!
Lastly (and i apologise now for the length of this diatribe) what can we do to MAKE wikileaks a trend if my assumptions here are true. I am sure smarter and greater men than myself have attempted to “g@me” the twitter engine but i think the general effort would need to consist of trying to introduce the wikileaks keyword into as many different clusters in the network as possible without causing subscription to the supernode and without causing it to become a mainstream topic of discussion (not sure that is a good idea for wikileaks)….. alternatively a more radical experiment would involve everyone un-following wikileaks which disconnects us from the supernode cluster and allows posts about wikileaks to influence the other (non-wikileaks specific) clusters in our own graphs!…kinda a catch-22 if you want to stay interested in wikileaks but hey – a very interesting experiment!!
thanks again for wasting a good few hours of my day thinking about think – your’ writing obviously inspired ;) and again i apologise for the length of this post.
happy to continue “offline”
Cheers
Tiggr
December 6, 2010 at 7:12 am
the nobel of rage
julian assange deserves a nobel for peace for the annoying truths that he revealed on internet that could become a new democratic weapon
the swedish government should give him an asylum for his contribution to the historians of the present ande future and usa should stop chasing him
he made his duty for the horrible regime of bush junior the last 10 previous years
http://www.arelis.gr
it contains erotonomicon and new york olympia
December 6, 2010 at 7:14 am
dianavaughan
These ‘explanations’ given by Josh are not cutting it.
He is either intentionally misleading or he just isn’t ‘in the loop’, and is pretending he is.
Anyone can google wikileaks and set the search to “latest” and see that all weekend wikileaks has been tweeted on average 3 tweets PER
SECOND.
I can see that many tweets ARE re-tweeted, lessening the diversity-
however, I took at least ten words that were listed as twitter trends throughout the day today; some words that were ‘trends’ all day;
‘VH1 divas’, ‘facebook profile’ ect,
and I googled those terms on google set to ‘latest’ results.
All the trend keywords I looked at showed MUCH slower activity, one to five tweets PER MINUTE,—AND the tweets were about 5 to 1 (non-variant) re-tweets.
Also, during the ‘bp oilspill crisis’-Then I also googled on ‘latest’ results-
and while IT was being tweeted incessantly it did show as a twitter trend term.
So why not wikileaks?
Josh tries to say that because there is no ‘spike’ or increase in tweets, that because the massive amount of tweets have been constant ,
thats the reason it’s not trending?
What about the ‘Iran vote march crisis’ that was trending for 48 hours at about the same contstant heavy rate as wikileaks is doing now, and Iran stayed as a top trend term throughout.
As for the reasoning that we must UNDERSTAND that simply because WE are interested in the topic and see soooo many wikileak tweets in our personal feeds…we shouldn’t conclude that its a hot topic for EVERYONE—that’s offensive Josh. Anyone can go on (again) a GOOGLE search of the word ‘wikileaks’ and set the search to ‘latest’ results, and see how many tweets are racing out-for days now. I scream FOUL FOUL FOUL. I want this issue more widely pointed out online-when I search to see whats being said about it “wikileaks twitter trend blackout”-this site-studenactivism- is just about all that comes up…WTF?
No Josh-your explanations don’t cut it-
I would like you to further explain, and address my points-
OR go convince your twitter bosses to fix it! IMMEDIATE
December 6, 2010 at 7:48 am
Twitter is censoring the discussion of #Wikileaks | safety first
[…] has been incredibly helpful in alerting me to another blog, Student Activism, where this question is also being analyzed and also for his personal insights into the process of phrases becoming trended. First of all, the […]
December 6, 2010 at 7:51 am
MrTiggr
@dianavaughan
Please understand that it is not just VOLUME of tweeting that makes up a “trend” …. a trend, on twitter is essentially “something that a lot of groups of people are talking about at that time which is out of the ordinary for each independent group”
>>[[See my previous LONG comment about this – Note i have NO affiliation with twitter and i actually agree with your outrage and am an avid (twitter or otherwise) supporter of Wikileaks..i might go as far as to disclaim that , as a fellow Australian i feel a kinship with and horror that our government is not offering him personally more protection from the vicious attacks being waged against him!]]
This also explains why Natural Disasters trend better than wikileaks…more separate groups of a more diverse nature tweet about them..AND they are out of the ordinary for each group (few people subscribe to a generic “I love Natural Disasters” topic!
Trends on twitter, from my observation (i am a software engineer in the field so have some knowledge and daily experience with the topic) are topics that are far-reaching (in terms of the variety of groups/clusters they effect) AND unexpected (insofar as they are statistically unusual to the topics discussed by groups).
I would love to call any organisation up on vilifying wikileaks or Julian Assange but unfortunately i think we might be barking up the wrong tree on this one if twitter is purely based upon statistics gleaned from its Graph as i suspect.
(perhaps @Josh can help me out here!?)
December 6, 2010 at 8:00 am
dianavaughan
Mr Tiggr- If I’m understanding your post (not completely I’m sure)-
it has to do with the idea that these ‘clusters’ are connected to the ‘supernode’ wikileaks? And the idea is that all these tweets are generated by a mass cluster of tweeters all interconnected through ‘following’ or ‘followers’ and consequently some thread of connectedness back to the main wikileaks site? Is that your idea?
If that is the theory-I would question its validity-reason being-
I just spent the last 20 minutes doing a taking a random sampling of all the current wikileaks tweets-the ones tweeted in the last 20 minutes-
I stopped at 70-I know its very unscientific but regardless-
the results? Out of 70 tweets, only 11 people who had the word ‘wikileaks’ in thier tweets were ‘also following’ wikileaks-only ONE in 70 was ‘also following’ someone else I am following-(paris review),
( though that same tweeter is not also following wikileaks).
So only 12 out of 70 had any thread of connection to me or wikileaks-that leaves 60 outside the ‘cluster’ right?
From this small ‘poll’ the vast majority have no ‘cluster’ connection to me or wikileaks-hows that?
Too small a sampling? Or maybe I don’t understand what your trying to explain…
Please explain further, if you could try it in even more ‘laymans’ terms,
I would appreciate it. For some reason these overly complex tech explanations are making me more suspicious-And I’m not paranoid.
BTW-that bandwagon-“they’re out to get Assange/wikileaks” thing-
I hardly think its a debatable point anymore, who DOESN’T think that?
December 6, 2010 at 8:07 am
asd
It’s a fact that secrets are hard to keep. No one can stop it. Cork out of the bottle. Problem ? Yust as mucht the printed book once was. Question: what’s next: E-Power to the people. Direct webvoting democracy with a lot of transparency. Technology brings revolution, it always did.
December 6, 2010 at 8:14 am
MrTiggr
@dianavaughan
you have absolutely grasped the core of what i am explaining!
my comment to your work in collating statistics would be that to do “1 Hop” from you to your folowers and “1 Hop” from the poster to being a follower of wikileaks is a niave experiment – 12 out of 70 tweeters 1-Hop away from wikileaks or you is probably supporting evidence for my argument!
My point here is that the social graph is a complex network..it goes MANY hops deep to make it’s clusters….think of the idea of “Six degrees of seperation” (or Six degrees of Kevin Bacon!) and calculate how many out of 70 are conected up to 6 hops deep and i posture that the saturation is actually quite deep – THAT makes discussing wikileaks whilst you are a member of the supernode cluster a counterproductive action as it becomes quickly the NORMAL behaviour for that cluster!
I hope i have been able to explain this in more general terms, please feel free to ask for any clarification – more than happy to try and help!
Lastly *tips hat to you* ABSOLUTLEY…there IS a “war” being waged against Wikileaks and Julian Assange – i am outraged that the Australian gov. has not offered more assistance – HOW UN-AUSTRALIAN!
December 6, 2010 at 8:19 am
Alle Segretti
I think I understand why Wikileaks isn’t trending as we’d expect.
Without recapping the speculation of the algorithm, and the details posted above aand at Student Activist I noticed one thing.
Trendistic, I am assuming, collects ALL tweets from the public time line. It doesn’t per se have an algorithm, it just reports in it’s graphs the total volume over the defined period.
So you are counting retweets of the same information over and over.
I presume the algorithm for Twitter does not take into account retweets, or if it does, as it seems more, it starts to deminish the trend of the same ‘tweet’ wording. A mammoth CPU process, but one well worth it for true reflection of trending.
As most people are RE-TWEETING wikileak tweets, Twitter sees this as ‘non unique’ and doesn’t count it as part of the trend.
However, if every retweet from Wikileaks was to jumble up the sequence of words, ensuring that one tweet carried the #wikileaks and a subsequent tweet carried #cablegate and a third tweet carried both, then I’ll bet that Twitters Trending algorithm would quickly show a massive distance between that of Wikileaks and that of the next highest.
I’ve thought about the twitter algorithm in so far as I know what details I have collected from many sources and speculations, and from monitoring trends and traffic for a few months.
Reverse engineering a complex algorithm isn’t easy, but as you know the input and you know the output result, what is in the middle is arbitary if you can trace patterns for multiple events over various periods of time.
I recommend people jumble up Wikileak and Cablegate tweets, reword them and don’t use RT or the Rewteet buttons. Make them unique.
I’ll bet Wikileaks will trend for months then :)
At which point, we could recommend that Twitter simply put a hard link on the navigation and be done with the issue of trending :)
December 6, 2010 at 8:42 am
tortov
@JoshElman: is possible to show us the total number of users tweeting both #wikileaks and #thingsimiss and also de ratio tweet/user (ex.: 5tweet/user) for each one? Just to have an idea about the diversity of people. Thanks! =)
December 6, 2010 at 8:50 am
henk
Well, I guess if we wait a few months we can read all about this on wikileaks when they reveil the truth.
December 6, 2010 at 8:53 am
MrTiggr
ROFL
+100 Humor points
December 6, 2010 at 8:54 am
macacanadian
Are we to believe that wikileaks now, of all times and of all possible subjects, just coincidentally happens to fall through your algorithm’s cracks?
Wikileaks? Now? Missed. A coincidence?
Hardly. I don’t buy it for a second.
Funny, Iran didn’t.
Is your algorithm somehow biassed to consider 14 year old girl’s opinions of greater importance? That would explain F****** beiber’s constant showing.
If I were you, I’d look over my shoulder and politely ask Joe Leiberman to pull his hand out of your ass.
December 6, 2010 at 9:09 am
Daniel Lee
Might be worth looking at this:
http://www.guardian.co.uk/technology/2010/dec/01/twitter-student-protesters-accounts?CMP=twt_gu
A similar allegation was made that Twitter was being asked to censor hashtags related to a student demo in the UK, presumably on the request of police to harm organisation on the day. Of course this is denied.
These are just two examples though, and are examples that involve people who have reason to feel there are forces opposing them in their actions. Whilst I err on the suspicious side of Twitter on this, it may be that there are many other examples of this that just fail to trend, but due to their nature being entirely ‘innocent’, users have no reason to have their suspicion aroused.
December 6, 2010 at 9:12 am
Daniel Mietchen
Just for the sake of completeness, #wikileaks does seem to have trended at least in France these days, according to
http://twitter.com/#!/TopHashtags/status/11067916602572801 .
December 6, 2010 at 9:31 am
Liz
The BP Gulf Oil Spill is not a good example because it’s a trend that actually got MORE popular over time, not less. At What the Trend we saw it move from #30 in our weekly Top 100 each week until it rose to #6 over the span of five weeks. It’s a counterexample of the phenomena you’re talking about
This result is partially because of the timeline of the oil spill: from 20 April 2010 to 15 July 2010. Twitter changed their algorithm (from what was most “popular” to trends that are “newly emerging”) at the end of May.
That’s when everything shifted and became much more ambiguous and arbitrary. It why the Brazilian presidential candidates were in the Trending Topic Top 10 in August but not in September or October (the election was Oct. 3rd) when the political conversation was getting louder. If this system had been in place in 2008, you would have seen Obama & McCain trending in June but not making the trending topics in November 2008.
The way around this is the childish but effective changing of terms and hashtags so there is this novelty factor. The users who do this most effectively are fans of Korean pop bands who, nearly every week, get their trends in the Top 10 because they are continually inventing new hashtags once their older ones no longer make the top trends list.
This is why Wikileaks didn’t make Twitter’s top trends but #cablegate spent 22 hours on the Top 10, most of that time at the #1 spot. In fact, it was such a strong trend that it catapulted the topic of Wikileaks to the #20 spot in our Week in Review (http://www.whatthetrend.com/week_in_review_20101203).
As for why this doesn’t effect the “Sundays” trend, I don’t know. But this novelty factor, as you call it, doesn’t just affect Wikileaks, it affects #NowPlaying, Justin Bieber, Harry Potter, Glee, #FollowFriday, Kobe Bryant, Super Junior, basically any term that has trended exceptionally high for a certain period of time. How many hours/days it takes to have the trending threshold raised (the number of mentioned required to make it into the Top 10), is unknown to those outside of Twitter.
It would be great if Twitter was more transparent but I’m guessing they think if they made their super secret algorithm formula public, that regular users as well as spammers would try to game the situation.
It’s less than an ideal situation as the example of the Brazilian Presidential Election shows. Movies that are newly released into theaters trend opening week and then are never seen again even if they continue to be popular. And some topics are important and newsworthy for more than 24 hours and they don’t have fan clubs to keep inventing new hashtags. Right now, that is the only solution around this problem that I know of.
Liz Pullen
What the Trend
http://www.whatthetrend.com
December 6, 2010 at 9:45 am
Angus Johnston
Folks should know that I go into a lot of the issues relating to the Twitter algorithm in this post:
https://studentactivism.net/2010/12/05/twitter-wikileaks-trending-2/
If you want the full picture of how I see this situation, that’s the place to start.
Also, Daniel mentions the UK student demonstrations — I blogged about those charges at the time, and concluded that there most likely wasn’t anything out of the ordinary happening:
https://studentactivism.net/2010/11/24/why-isnt-demo2010-trending-on-twitter/
December 6, 2010 at 10:06 am
I trend di Twitter censurano WikiLeaks? | bruno trani dot info
[…] frattempo però a seguire ulteriormente in dettaglio la vicenda è stato il blog Student Activism, nel quale Angus Johnston parla di chiaro impegno dello staff di Twitter per mantenere fuori dai […]
December 6, 2010 at 10:20 am
Researchers accuse Twitter of censoring Wikileaks – TechEye | Tips Promosi Online
[…] topics. This has given rise to accusations by several researchers, including Bob Murphy and Angus Johnston, that Twitter is actively censoring Wikileaks to prevent it from trending and therefore getting […]
December 6, 2010 at 10:57 am
My Blog » Researchers accuse Twitter of censoring Wikileaks – TechEye
[…] to accusations by numerous researchers, including Bob Murphy and Angus Johnston, that Twitter is actively censoring Wikileaks to prevent […]
December 6, 2010 at 11:02 am
¿Twitter censura a WikiLeaks? en ALT1040 (Destacadas)
[…] es repetido bueno, todas las semanas, una vez por semana.En el blog en el que hicieron la investigación realizó un comentario un empleado de Twitter, quien pretendió dar algunas explicaciones sobre el […]
December 6, 2010 at 11:17 am
Wikileaks, zum Dritten « Internet und Politik
[…] mit Daniel Domscheit-Berg. Jeff Jarvis, Transparenz hilft gegen Enthüllungen. Angus Johnston, Why Wikileaks isn´t trending on Twitter. Nick Judd, Google: Wikileaks vs. Justin Bieber. Lauren Kirchner, Why Amazon Caved (Q & A mit […]
December 6, 2010 at 12:09 pm
Twitter excluding Wikileaks from trends? – msnbc.com | Jauhar Efendi
[…] on his safety first (“this site is about things thought through”) blog. Historian Angus Johnston also tackled the subject on his “Student Activism” blog, drawing a Twitter staffer into a conversation via the comments that followed his […]
December 6, 2010 at 12:20 pm
‘Twitter censureert Wikileaks’
[…] onderzoekers uiten hun twijfel over het feit dat Wikileaks als onderwerp niet ‘trending’ is geworden op Twitter, […]
December 6, 2010 at 12:21 pm
Twitter excluding Wikileaks from trends? – msnbc.com | Information update
[…] on his safety first (“this site is about things thought through”) blog. Historian Angus Johnston also tackled the subject on his “Student Activism” blog, drawing a Twitter staffer into a conversation via the comments that followed his […]
December 6, 2010 at 12:30 pm
Twitter: We Are Not Keeping WikiLeaks Out of Trending Topics
[…] a trending topic since August 21, although #cablegate was trending last weekend.Over at the blog Student Activism, which has also noted #WikiLeaks’s conspicuous absence from the Trending Topics, a commenter […]
December 6, 2010 at 12:47 pm
Twitter excluding Wikileaks from trends? – msnbc.com | bali listing
[…] on his safety first (“this site is about things thought through”) blog. Historian Angus Johnston also tackled the subject on his “Student Activism” blog, drawing a Twitter staffer into a conversation via the comments that followed his […]
December 6, 2010 at 1:06 pm
Twitter: We Are Not Keeping WikiLeaks Out of Trending Topics | Affinity
[…] at the blog Student Activism, which has also noted #WikiLeaks’s conspicuous absence from the Trending Topics, a commenter who […]
December 6, 2010 at 1:21 pm
Twitter excluding Wikileaks from trends? – msnbc.com | Tips Promosi Online
[…] on his safety first (“this site is about things thought through”) blog. Historian Angus Johnston also tackled the subject on his “Student Activism” blog, drawing a Twitter staffer into a conversation via the comments that followed his […]
December 6, 2010 at 1:21 pm
Censureert Twitter de trending topics? | Twittermania
[…] beweert dat Twitter Wikileaks bewust buiten de trending topics houdt. Interessant is dat op zijn weblog een discussie is ontstaan tussen Johnston en Josh Elman van Twitter. Volgens Elman is er geen […]
December 6, 2010 at 1:28 pm
Twitter censura a Wikileaks. O no. « Noticias – Seguridad Tuareg
[…] rápidamente- todo lo referido a Wikileaks. Un blogger lo ha argumentado en su web, basándose en otras sospechas y en una investigación basada la herramienta Trendistic. La propia cuenta oficial en Twitter de […]
December 6, 2010 at 1:53 pm
¿Censuran a WikiLeaks en Twitter? en Bitelia (Redes Sociales)
[…] raro.De hecho, en un blog en el que han estado estudiando el asunto, un empleado de Twitter participó en los comentarios explicando el funcionamiento de los trending topics y de los motivos por los que WikiLeaks no […]
December 6, 2010 at 2:09 pm
Still More Questions About Why Wikileaks Hasn't Trended On Twitter … | Unison Blogs
[…] Still More Questions About Why Wikileaks Hasn't Trended On Twitter … • Posted by administrator • Sunday, December 5th, 2010 at 9:53 pm • (0) Comment […]
December 6, 2010 at 2:11 pm
Francisco Venancio
@angus and @josh, Any toughts on the MrTiggr cluster theory?
Tough I still agree that Twitter should answer these questions better, the theory sounds specially plausible.
But it also means that twitter should find a new way to trend topics. Is it really better to exclude such large communites from the trending topics?
To me it seems that such a system would favor the like-minded communites that are less institucionalized for absolutly no other reason. Sports fans would be able to get things trending just because they have less connections between them than wikileaks fans. Political topics would be disfavoured over the strange, slightlly houmorous topics such as “#noonelikesyoubecause”.
But hey… Twitter can always just ignore us… this doubt alone made me know, and consider, identi.ca…
December 6, 2010 at 2:17 pm
¿Twitter censura a WikiLeaks? « …sobre gustos acá hay algo escrito
[…] rápidamente- todo lo referido a Wikileaks. Un blogger lo ha argumentado en su web, basándose en otras sospechas y en una investigación basada la herramienta Trendistic. La propia cuenta oficial en Twitter de […]
December 6, 2010 at 3:10 pm
¿Censuran a WikiLeaks en Twitter? « BN
[…] hecho, en un blog en el que han estado estudiando el asunto, un empleado de Twitter participó en los comentarios […]
December 6, 2010 at 3:11 pm
Researchers accuse Twitter of censoring Wikileaks – TechEye | Diving at Raja Ampat Island
[…] topics. This has given rise to accusations by several researchers, including Bob Murphy and Angus Johnston, that Twitter is actively censoring Wikileaks to prevent it from trending and therefore getting […]
December 6, 2010 at 3:39 pm
Rob Altorf
Just one trending topic in the Netherlands at this moment showing the same “weird” results.
The soccer coach of AJAX is leaving the club, so you would expect AJAX to be a trending topic, but no, just the name of the trainer Martin Jol is trending.
December 6, 2010 at 4:12 pm
Wikileaks Cyberwar Rages On « Saskboy's Abandoned Stuff – Site News
[…] it’s likely pressuring Twitter (and Facebook I’d assume too) to suppress information sharing about Wikileaks. In other words, the US State Department comes to the aid of Iranian protesters, but […]
December 6, 2010 at 5:02 pm
3nglish.co.uk » Save Wikileaks II – The Attacks Continue
[…] Above you’ll see the official trending topics twitter says are on top vs. wikileaks. The probe was done by adding the twitter trending topics to an account together with #wikileaks (not including all the related ones like #cablegate). More investigative evidence here. […]
December 6, 2010 at 6:24 pm
Twitter: We Are Not Keeping WikiLeaks Out of Trending Topics | IT-Networks
[…] at the blog Student Activism, which has also noted #WikiLeaks’s conspicuous absence from the Trending Topics, a commenter who […]
December 6, 2010 at 6:56 pm
Twitter: We Are Not Keeping WikiLeaks Out of Trending Topics | Social Media Guru
[…] at the blog Student Activism, which has also noted #WikiLeaks’s conspicuous absence from the Trending Topics, a commenter […]
December 6, 2010 at 7:03 pm
Top Posts — WordPress.com
[…] Still More Questions About Why Wikileaks Hasn’t Trended On Twitter Feel free to follow Student Activism on Twitter or Facebook, if you like. You can also read this essay in German, if […] […]
December 6, 2010 at 7:41 pm
Warum »Wikileaks« auf Twitter nicht trending topic ist, vielleicht | Webevangelisten
[…] ist das nicht unbedingt wert, in die trending topics zu kommen. Deshalb ist es plausibel, wenn Josh Elman, der nach eigenen Aussagen bei Twitter arbeitet, darauf hinweist, dass, um in die topics zu kommen, […]
December 6, 2010 at 7:50 pm
MrTiggr
@FranciscoVenancio – no further news on my theory yet however i am running some stats software i have written, against the twitter streams – it will take a while for the results to become clear as we really don’t have ready access to a statistically significant portion of the twitter stream. I would question, however whether twitter SHOULD change the algorithm (if i am correct) – it constitutes a mathematic approach to determining trends which prefers NOVELTY to VOLUME just because we don’t agree with “what’s trending” doesn’t mean the algo. is wrong, just that we are expecting twitter trends to represent “Whats trending in my own social network” (which is more related to volume).
@RobAltorf unfortunately AJAX is a common technical term on the internet and is unlikely to demonstrate the novelty value required to make it trend – whereas a proper noun such as the name of the coach is more unique and would appear as a trend.
December 6, 2010 at 8:03 pm
Twitter: We Are Not Keeping WikiLeaks Out of Trending Topics [UPDATED] | iuvo Shopper & Community Newspaper News
[…] a trending topic since August 21, although #cablegate was trending last weekend.Over at the blog Student Activism, which has also noted #WikiLeaks’s conspicuous absence from the Trending Topics, a commenter […]
December 6, 2010 at 8:40 pm
dec7
also banned is bankrun
December 6, 2010 at 8:44 pm
astonished
Josh, I don’t believe you. But of course you can not step out and say “OK, people, look, we just don’t want to be responsible for political change, for heated discussions, for promoting subversive content. We have to show responsibility, and loyalty, and some people might view that as censorship, yes. But we do not censor the WL tweets, only the trends blabla”
So you rather step out and say “It’s the algorithm blabla has to be improved blabla”.
Sorry – no.
December 6, 2010 at 8:56 pm
Twitter: We Are Keeping WikiLeaks Out of Trending Topics [UPDATED] | Trumagic Channel
[…] at the blog Student Activism, which has also noted #WikiLeaks’s conspicuous absence from the Trending Topics, a commenter who […]
December 6, 2010 at 9:13 pm
Francisco Venancio
@MrTiggr In what ways is wikileaks not novel? It should trend not because a lot of people talk about it all the time. It should trend because a lot of people talk about it now. The current algorithm, if that is the reason it is not trending, fails to show a novel and incredibly popular topic.
If your theory for the algorithm is correct. Groups that are less connected will have an enormous advantage in getting topics trending. Sports and celebrities fans are less connected than people of the same political affiliation. Worse even for opensource, web-based projects.
Why should the trending algorithm reflect better topics used by communities that are less interwoven than those more connected?
December 6, 2010 at 9:50 pm
MrTiggr
@FranciscoVenancio in order to prevent “beiber” being the top trend permanently (or any other spam tag), twitter MUST use an algorithm that caters for REAL novelty. If wikileaks were NOT so talked about in the general then it WOULD be out of the ordinary and therefore be seen as a TREND … once there is a significant velocity behind a topic and LOTS of people start talking about it and forming a community then it STOPS BEING A TREND because it is now so commonplace – that is to say the more popular something is the less novel or organically unique it is.
POPULAR TOPICS DO NOT (and SHOULD NOT) NECESSARILY = TRENDS
The concept of a “Trend” involves not just popularity but popularity over TIME that is OUT OF THE ORDINARY (statistically). no-one is arguing that wikileaks is possibly the hottest topic on twitter at the moment….but that just means it is a hot topic not a trend….
…or put differently, wikileaks regularly goes through phases of being VERY popular and hot as a topic then cools off in the aftermath of a major leak (cablegate hasn’t cooled off yet but collateralmurder,afghandiaries,iranwarlog all have pretty much subsided) so, with regards to the topic of wikileaks, it is THE NORM for wikileaks to see this type of traffic in twitter so it is not novel at all and shouldn’t make it as a trend. (We have seen wikileaks get this kind of coverage before)
wikileaks have obviously seen this effect in action and correctly create/use a different tag for each leak campaign thus ensuring at least some period as a trend – the challenge for wikileaks will be to come up with novel tags for each leak that are novel enough in their own right to become trends….i imagine that if they started calling everything *****gate (cablegate,obamagate etc) then thos would fail as trends also since they are similar to the “normal” hashtagging behaviour of the group.
December 7, 2010 at 12:40 am
world-ofbusiness.info - Twitter: We’re Not Censoring WikiLeaks, #Cablegate
[…] Twitter’s algorithm explanation hasn’t satisfy some, who felt blaming the issue on the company’s algorithm was more of an excuse rather than a […]
December 7, 2010 at 1:44 am
MrTiggr
JUST TO CLARIFY:
Twitter is definately NOT censoring the DISCUSSION of wikileaks – you can look at the public feed, search for AND follow wikileaks quite freely – i have not certainly not noticed any of my posts with #wl related content being removed!
The ALLEGATION here is that twitter is “censoring” wikileaks by preventing them becoming a trend adn/or staying there as a trend. With the exception of preventing spam, there is no real incentive for twitter to do such a thing and to not actually censor the CONTENT TOO!
I do not believe there is anything nefarious about the “missing wikileaks trend” – in fact i think that it is BY DESIGN (see my other posts here and on SafetyFirst.com) and that it is a “Good Thing” otherwise we would have #Vezuzu and #beiber and pretty much nothing else on trends!
December 7, 2010 at 7:42 am
Researchers accuse Twitter of censoring Wikileaks – TechEye | bali listing
[…] topics. This has given rise to accusations by several researchers, including Bob Murphy and Angus Johnston, that Twitter is actively censoring Wikileaks to prevent it from trending and therefore getting […]
December 7, 2010 at 8:11 am
Twitter: We Are Not Keeping WikiLeaks Out of Trending Topics « NetSoft Consultants
[…] at the blog Student Activism, which has also noted #WikiLeaks’s conspicuous absence from the Trending Topics, a commenter who […]
December 7, 2010 at 8:21 am
TWITTER CENSURA A WIKILEAKS O NO « SR HADDEN SECURITY CONSULTING
[…] rápidamente- todo lo referido a Wikileaks. Un blogger lo ha argumentado en su web, basándose en otras sospechas y en una investigación basada la herramienta Trendistic. La propia cuenta oficial en Twitter de […]
December 7, 2010 at 9:10 am
Wikileaks, Justin Bieber und die Echokammern des Netzes | Kontextschmiede
[…] versuchen Softwaredesigner ihren Algorithmen Filter anzutrainieren, mit denen allgemeine Relevanz über Freundeskreise und […]
December 7, 2010 at 9:19 am
Bok
MrTiggr, I’d say looking at the graphs there’s no doubt that the subject “wikileaks” has (had) the novelty you speak of, much more so than several of the other topics mentioned here (“bp oil spill”, which apparently trended even though it slowly drifted around for a long time, and “sundays” which spikes every sunday)
The only explanation that seems to make sense is that even though there are a lot of tweets about “wikileaks”, these tweets are all coming from a (relatively) small portion of the Twitter network. For example, say that “sundays” ended up trending because 4% of the entire network all mentioned it once during the day. “wikileaks” might not be trending because even though it’s tweeted about 15 times more than “sundays” now, this is because only 0.4% of the network mentioned it a whopping 150 times during the day.
Given just how astronomical the numbers on “wikileaks” seem to be compared to some less popular subjects that did make it on the trends list, I’m not sure how these numbers could be made to actually fit the facts, but it’s a possibility nonetheless.
December 7, 2010 at 10:25 am
MrTiggr
@Bok i think, reading your post, you seem to agree with most of my main arguments (read my comments here and at SafetyFirst – i get confused where i have posted what on this :S sorry) – the novelty factor of a topic within each “social cluster” of the graph is what is used to create the twitter trends list (…i have software running at the moment to confirm this – stay tuned!) i think perhaps, you underestimate the size of the cluster surrounding wikileaks within the social graph…it is not just 0.4% of the community by my calculation (more data pending) – it could be as large as 4% (VERY rough initial estimates put it at 4.8%..i won’t be held to that)…and that is only going 6-degrees-of-freedom within the graph! – who knows how deep twitter is doing there!
my point? …thanks…i think you agree with me but underestimate the “spread” of interest in wikileaks and it’s (negative) influence on it’s ability to trend.
Cheers
Tiggr.
December 7, 2010 at 10:37 am
Twitter bloquea a Wikileaks
[…] rápidamente- todo lo referido a Wikileaks. Un blogger lo ha argumentado en su web, basándose en otras sospechas y en una investigación basada en Trendistic. La propia cuenta oficial en Twitter de Wikileaks ha […]
December 7, 2010 at 10:53 am
BLOGuia | Internet, tecnologia, games, variedades
[…] el blog en el que hicieron la investigación realizó un comentario un empleado de Twitter, quien pretendió dar algunas explicaciones sobre el […]
December 7, 2010 at 12:12 pm
Bok
Yeah, the numbers are completely made up. That’s why I said I’m not sure how to actually make them fit reality. :-)
If the cluster talking about wikileaks is really 4% of the entire network though, that only makes it weirder it’s not on the trends list. I mean, you’d expect more people talking about it would make it more likely to be a trend, right? Not less.
December 7, 2010 at 12:47 pm
eamcet*[SEO対策調査自動更新ブログ] | Twitter、「Trending Topic」 を検閲してる?
[…] 「Trending Topics」とは、いまみんながつぶやいているフレーズやハッシュタグのことを指し、Web版のTwitterでは右側のサイドバーに表示されている。Student Activismが日曜日にグローバルのTrending Topicに上がってきた「Sundays」という単語と、「WikiLeaks」のトラフィックを検証したところ、「WikiLeaks」は「Sundays」よりも顕著にピークしていたと指摘する。またbubbloyがTrending Topicに上がっていた5フレーズと「WikiLeaks」を比較したところ、「WikiLeaks」は他のフレーズよりも平均して3倍程度多く使われていたという。 […]
December 7, 2010 at 1:31 pm
links for 2010-12-07 | KevinBondelli.com: Youth Vote, Technology, Politics
[…] Still More Questions About Why Wikileaks Hasn’t Trended On Twitter « Student Activism […]
December 7, 2010 at 4:28 pm
Twitter: We Are Not Keeping WikiLeaks Out of Trending Topics
[…] at the blog Student Activism, which has also noted #WikiLeaks’s conspicuous absence from the Trending Topics, a commenter who […]
December 7, 2010 at 8:19 pm
Lucka 7: Mer Wikileaks och Assange
[…] censurerat hashtaggen #wikileaks men på nåt sätt känns det som om det finns någon liten hund begraven. Och man får hoppas att fler av ledande politiker och tjänstemän faktiskt blir utsatta för […]
December 7, 2010 at 10:28 pm
João
You are missing one point here… tweeting of the word “Sundays” is limited almost exclusively to the english speaking users of Twitter. French users tweet “Dimanche”, Brazilian users tweet “Domingos”, etc.
“Wikileaks”, however is used worldwide, with no translations. You should expect it to be tweeted from a much more broad spectrum of “clusters” than any regular word in one single language.
December 7, 2010 at 10:32 pm
Angus Johnston
I’ve been reading all these, by the way, and I’ll be posting more soon — probably tomorrow. The Assange arrest sucked up all my Wikileaks-related blogging energy today.
December 7, 2010 at 11:39 pm
BWP AND COMPUTER SCIENCE » Twitter vs. WikiLeaks: Algorithms Are Uncontrolled Corporate Spokespeople
[…] People started second guessing, taking available measurements and numbers and trying to apply them. Someone who identified himself as Josh Elman, a former Facebook platform manager now working at Twitter, tried to answer concerns, but ultimately had to observe that he couldn’t “go into the full algorithm.” […]
December 8, 2010 at 12:53 am
MrTiggr
@João – my point with regard to the use of “english woords” as tags speaks towards the inclusion of SPAM protection measures built into the trends algorithm (we KNOW there – there is no more #bieber !) part of SPAM protection looks for things that are machine-generated “WIKILEAKS” is not a word in any language (it IS a proper noun in english) – to a machine algorithm, “WIKILEAKS” would look very much like a spam-word and would almost certainly be penalised in the algorithm….the fact that there is a deep saturation of the word in the general traffic would only compound the way it looks like SPAM to an algorithm – Bottom line being that the trends algorithm must take into account a lot of factors “novelty” being an important one but by no means the only measure used.
@bok – “you’d expect more people talking about it would make it more likely to be a trend, right? Not less.” ….Not Quite….
that would be true if all of those people came from a vast variety of different clusters in the network (because amongst those clusters it WOULD be novel to talk about wikileaks) …what i am seeing is that there is a HUGE supercluster of people who “follow #wikileaks” or “follow people who follow wikileaks” or “follow a supporting list that follows wikileaks” – taken to at least 6 degrees. – This general traffic within this cluster is MOSTLY ABOUT wikileaks (in the form of link posts and retweets) so what you have is not novel at all, it is a group of people doing what they joined together to do – THAT is not out of the ordinary! …it may be “Big” or “popular” or “hot” but it isn’t a “TREND” – a trend is something that is organically novel and unique at that point in time amongst the general population……MAYBE we should be pushing twitter to have a “HOT TOPICS” list instead/as well as a “TRENDS” list…that way it would show what people expect rather than things that are out of the ordinary. – are we really surprised that a “trends list” is providing us with unpredictable outcomes? predicting trends in real human behaviour has been the “science” of the advertising and marketing industry and the fashion industry for decades and we’ve seen how “correct” THEY seem to be eh!?
December 8, 2010 at 1:39 am
twitteros de todo el mundo lanzan #DíaSinTwitter o #DayWithoutTwitter | twitter news |
[…] rápidamente- todo lo referido a Wikileaks. Un blogger lo ha argumentado en su web, basándose en otras sospechas y en una investigación basada la herramienta Trendistic. La propia cuenta oficial en Twitter de […]
December 8, 2010 at 3:42 am
Shortcuts: Hysterie und Verschwörungstheorien « zwo null
[…] Netz, die eine mögliche “Zensur” auf Twitter betrafen. Offensichtlich hat keiner (offensichtlich noch nicht einmal die Entwickler bei Twitter) Einblick in den Mechanismus zur Bestimmung der Trendic Topic. Bar jeder Kenntnis wurde dennoch […]
December 8, 2010 at 5:12 am
The Hacker War Over WikiLeaks Rages On | JetLib News
[…] the most popular topics being tweeted. But Web site blogs such as OSNews, OSDir, Safety First, and StudentActivism.net have reported findings that terms such as #wikileaks and #Assange have not been trending nearly as […]
December 8, 2010 at 8:36 am
Wikileaks Link-Sammlung « Noch mehr Entropie
[…] Angus Johnston (En): https://studentactivism.net/2010/12/05/wikileaks-twitter-3/ […]
December 8, 2010 at 9:18 am
Carstenm
Not sure about the international thing or the velocity not volume thing after the interminable CalaBocaGalvao nonsense earlier in the year.
December 8, 2010 at 9:24 am
mary jane
man, long dorky comment threads about algorithms, conspiracies and wikileaks are totally not helping my insomnia issues.
cheers all, love your brains :)
December 8, 2010 at 9:38 am
ja9ae
I’m starting to feel sorry for poor MrTiggr having to explain statistical concepts every 2 minutes!
It’s also strikes me as not very likely that the powers that be would try to stop wikileaks trending on twitter, when every news organisation in the world is leading their bulletins with it.
December 8, 2010 at 11:06 am
Bok
MrTiggr, it seems to me all we’re doing at this point is adding more requirements for something to be a trend until we can rationalize wikileaks not being recognized as one by a man-made computer algorithm. Does it really make sense to ask that the people talking about a subject are not connected in any way (even to the 6th degree!) before we can consider something a trend?
Don’t trends develop naturally through word of mouth to begin with? If so, why require that this happens outside of Twitter? (and heck, hasn’t it happened outside of Twitter to begin with? Who would decide to follow the nonsense phrase “wikileaks” all of a sudden without hearing about it somewhere else first?)
Also, we’re not talking about predicting trends here. We’re talking about an algorithm to detect trends after they happen. (which is something humans have absolutely no trouble with; we just want the algorithm to do it for us since it’s cheaper and faster) If we have a look at the data ourselves and say “Hey, this is a trend” and the algorithm says no, then we haven’t failed to predict a trend, but the algorithm has failed to predict what we consider a trend. The algorithm is based on our idea of a trend, not the other way around.
December 8, 2010 at 2:17 pm
Is Twitter Suppressing Discussion Of WikiLeaks? | Disinformation
[…] Has Twitter caved to anti-WikiLeaks pressure à la PayPal and Mastercard? There’s a full explanation at Student Analysis. […]
December 8, 2010 at 2:51 pm
Soul
Is there any other topic more trend than wikileaks for the past few days? Birthday Ian? Space X? Regardless how the system works, it doesn’t show the real trend. If Twitter is not censuring wikileaks, they are misleading us with a faulty system which can not detect such an important and popular topic.
Does anyone know how much would cost to promote Wikileaks on the trend list? Maybe we could raise some cash to promote it. That would be fun!!!!!
December 8, 2010 at 2:52 pm
Soul
Is there any other topic more trend than wikileaks for the past few days? Birthday Ian? Space X? Regardless how the system works, it doesn’t show the real trend. If Twitter is not censoring wikileaks, they are misleading us with a faulty system which can not detect such an important and popular topic.
Does anyone know how much would cost to promote Wikileaks on the trend list? Maybe we could raise some cash to promote it. That would be fun!!!!!
December 8, 2010 at 3:45 pm
¿Está censurando Twitter a WikiLekas de sus trending topics? | Pijamasurf
[…] ha explicado que su lista de trends se basa en la novedad de un término, sin embargo el sitio Student Analysis ha comparado WikiLeaks con el término "Sunday", un término que tiene una tendencia totalmente […]
December 8, 2010 at 8:49 pm
Twitter, Bing, Facebook y la censura a WikiLeaks « Digital World News
[…] se convirtieron en temas de moda, han caído de las listas. Por eso, desde los blogs Bublloy y Student Activism se están llevando a cabo pequeñas investigaciones en las que se comparan los resultados […]
December 8, 2010 at 9:54 pm
MrTiggr
@Soul – now THAT is thinking – if people are so unhappy that wikileads isn’t a trend then put ur money where ur mouth is and promote it!
UPDATE: Twitter confirms what i have been saying:
“What makes a trend a Trend?
Twitter users now send more than 95 million Tweets a day, on just about every topic imaginable. We track of the volume of terms mentioned on Twitter on an ongoing basis. Topics break into the Trends list when the volume of Tweets about that topic at a given moment dramatically increases.
Sometimes a topic doesn’t break into the Trends list because its popularity isn’t as widespread as people believe. And, sometimes, popular terms don’t make the Trends list because the velocity of conversation isn’t increasing quickly enough, relative to the baseline level of conversation happening on an average day; this is what happened with #wikileaks this week.”
BASICALLY: If out of all the traffic about wikileaks, most of that traffic comes from a bunch of users (yes – a LARGE bunch) who talk about wikileaks a LOT then the fact they are doing it right now is not a trend..just a popular topic.
twitter is not censoring trends – we all just need to change our perception of what a trend is or write a better algorithm ourselves.
I’m done.
December 9, 2010 at 3:05 am
0mad
One thing, which might make your analysis more complicated:
How prominent (according Twitter’s algorithm) were all the other “trending topics” at the same time you exspect wikileaks to be trending. — doublecheck this and make a little update, and then, Twitter has really to explain things.
December 9, 2010 at 6:59 am
Twitter está censurando la conversación sobre #Wikileaks | Chile a Punto
[…] de TweetStats.com ha sido muy colaborador al recomendarme otro blog, Student Activism, en el que esta pregunta está siendo también analizada y también por sus reflexiones personales sobre el proceso en el que las frases y términos se […]
December 9, 2010 at 8:38 am
Los enemigos de Wikileaks: ¿miedo a las multitudes inteligentes? – Periodismo Ciudadano
[…] Topics”. Según el blog oficial de Twitter, defienden que no han censurado WikiLeaks, aunque, haya más de una sospecha de lo contrario. Hoy #songsthatleadtosex es más Trending que #wikileaks, datos que no se reflejan […]
December 9, 2010 at 9:42 am
Pourquoi est-ce que WikiLeaks n’est pas “tendance” sur Twitter ? | Geeko
[…] La liste des “tendances” existe depuis l’été 2008, et tout ceux qui ont déjà consulté Twitter sauront qu’un des sujets les plus “populaires” sur le réseau social a longtemps été Justin Bieber. Ce jeune chanteur canadien, et utilisateur de Twitter, fait pour le moment un tabac outre-atlantique mais reste pratiquement inconnu chez nous. Justin est si populaire qu’un employé de Twitter avait même confié que 3% de ses serveurs étaient dédiés au trafic généré par le chanteur. Depuis, Twitter a donc revu son algorithme de sélection des sujets tendances afin de laisser plus de chance aux nouveaux arrivants. Pour qu’un sujet fasse son apparition dans les tendances, il doit être “plus discuté maintenant qu’auparavant”, précise Carolyn Penner, porte-parole de Twitter. Wikileaks a donc bel et bien été populaire/tendance pendant un certain temps, mais aujourd’hui il génère un flux constant de messages, sans pic de discussion lui permettant d’atterrir dans la fameuse liste. Le bloggueur Angus Johnson précise même que Wikileaks sur Twitter serait carrément “absent des tendances depuis le mois août”. […]
December 9, 2010 at 9:58 am
La Opinión Política.com » Puesta en duda credibilidad de Twitter ante censura a WikiLeaks
[…] lo comenzaron a esbozar unos pocos sitios en inglés, pero este lunes 6 ya está disparado el clamor en el microblogging más popular: Twitter censura a […]
December 9, 2010 at 10:58 am
MrTiggr
:S ….i still don’t know how i can express it more simply.
10,000 people from random walks of life tweeting about “lennon” in a few hours is obviously more novel/unique than 10,000 people talking about wikileaks!!! (despite the spelling error Lennon trended today on twitter! but wikileaks still did not!!) ….the more we talk about it the less novel/unique it becomes..in short;;wikileaks has become TOO POPULAR for TOO LONG for i to trend!…..and rightfully so!…otherwise twitter’s top 10 trends would consist of #bieber #vevzuzu (or however u spell it!) and #iranelection ….me personally, i praise our new twitter overlords for learning from experience and making an algorithm that looks for “cool new stuff” rather than what the guy in the next cubicle is looking at. basically – kudos to twitter – caveat emptor “STUFF YOU LIKE != TWITTER TREND”
December 10, 2010 at 12:01 am
Twitter Appears to Censor Wikileaks-Related Trends | External Brain
[…] 5 days ago. Today, my fears of secret censorship seem to be coming true. It appears that Twitter is censoring all these words, so they don’t appear in the (much-used) Twitter trends list. Update 1: A Twitter staffer […]
December 11, 2010 at 2:56 am
Still More Questions About Why Wikileaks Hasn’t Trended On Twitter « Student Activism « Yahyasheikho786's Blog
[…] Still More Questions About Why Wikileaks Hasn’t Trended On Twitter « Student Activism. […]
December 11, 2010 at 4:23 am
Grego
@Josh Elman: Just want to say thanks for your prompt, polite responses/assurances. They’re appreciated.
December 11, 2010 at 8:56 am
isemann
I WILL NEVER LOOK AT TRENDS THE SAME WAY AGAIN!
That was some reading, interesting and taxing!
Thanks,
R!
December 11, 2010 at 9:02 am
MrTiggr
Wikileaks has been a top volume tag on twitter for over 12 days now…. are we all REALLY sure that we still want to count wikileaks as a “trend” ..ok, really popular – SO popular that i am having a hard time building charts showing the interconnections of the group following wikileaks… but a TREND?? STILL ?? REALLY ??
twitter aglorithm 1 : conspiracy of censorship 0
December 11, 2010 at 1:39 pm
Angus Johnston
My new essay on the subject is up here:
https://studentactivism.net/2010/12/11/twitter-wikileaks-why/
Short version — I tentatively conclude that Twitter probably DIDN’T block Wikileaks specifically, but that their algorithms are designed to keep topics like Wikileaks off the charts.
December 12, 2010 at 9:11 am
vis4.net/blog - über Infografiken und Datenvisualisierungen in Flash, HTML5, SVG und Processing
[…] Still More Questions About Why Wikileaks Hasn’t Trended On Twitter ce Dez 2010 infografik Tags: trends, twitter Comments: 1 Comment. Comments Comment from Dave Gööck – Dezember 06, 2010 at 15:43 also das ist ja eine krasse nummer. auf der einen seite freut sich twitter, die meinungsfreiheit in ländern, die viel zensieren zu fördern, auf der anderen seite zensieren sie selbst, wenn es gegen die usa geht. – ehrlich, das ist heuchlerisch… Write a comment Name: […]
December 12, 2010 at 5:10 pm
WikiLeaks – Intrebari despre Twitter si cenzurarea WikiLeaks? | Nostrabrucanus
[…] articol intitulat Still More Questions About Why Wikileaks Hasn’t Trended On Twitter apar o serie de grafice ce par sa contrazica declaratia oficiala a Twitter (official statement) […]
December 13, 2010 at 1:40 am
Twitter censors WikiLeaks-OS News « FACT – Freedom Against Censorship Thailand
[…] 5 days ago. Today, my fears of secret censorship seem to be coming true. It appears that Twitter is censoring all these words, so they don’t appear in the (much-used) Twitter “trends” list. Update: A Twitter […]
December 13, 2010 at 1:40 am
Twitter censors WikiLeaks-OS News « FACT – Freedom Against Censorship Thailand
[…] don’t appear in the (much-used) Twitter “trends” list. Update: A Twitter staffer replied to the blog post saying that their trending algorithm doesn’t really result to the most […]
December 14, 2010 at 8:39 pm
Perché #Wikileaks non può essere Trend Topic « Gilda35
[…] Still More Questions About Why Wikileaks Hasn’t Trended On Twitter […]
February 17, 2011 at 5:14 pm
COINTELPRO 2.0 and US Propaganda « GODZILLA GOVERNMENT
[…] FBI, handing over user profile information to US Intelligence agencies on a silver platter. Twitter censored or supressed tweets over Wikileaks’ cablegate releases. Google is always sitting precariously on the fence with […]
April 11, 2011 at 2:22 pm
censored
http://maxkeiser.com/2011/04/11/twitter-censoring-crash-jp-morgan-buy-silver/
Zipped screen capture video of Twitter hiding updates for the “Crash JP Morgan Buy Silver”
April 10, 2014 at 12:29 am
3HASHTAG SINTÍTULO « Ciro Múseres
[…] 3 Angus Johnston, Still More Questions About Why Wikileaks Hasn’t Trended On Twitter, https://studentactivism.net/2010/12/05/wikileaks-twitter-3/ […]
June 6, 2014 at 11:14 pm
Why everyone loves Bieber | Ethnography Matters
[…] diversity of people and tweets about a term” as Josh Elman wrote in the comments on a post questioning wikileaks trends by Angus Johnston. In addition to representing spikes in activity, Twitter’s trending topics […]