Unnaturally Long Attention Span

AvatarA blog about Grad School at Stanford, Working in a Silicon Valley Internet Company, and Statistical Machine Learning. mike AT ai.stanford.edu

What is Web 2.0 ?

Everyone in the sphere seems to have an opinion on what Web 2.0 means to them, and I will add my own here. Web 2.0 is the new software tradition which we have all but transitioned to. The features of this new tradition that differentiate it from the older tradition are that products are more focused on design rather than on capability/features. Take for example products like Flickr, Firefox, MacOS X, Office 12, and the slew of AJAX service-based microapps. A good example to illustrate this paradigm shift is MS Word. In earlier versions of Word(1-7), each release added more capability to the editor evolving it from something like Notepad to the current Word 2003, while essentially keeping the interface consistent and familiar. However, if you look at Word 12, the first thing you will notice is a new interface focused on making tasks more efficient and discoverable. Even the data is stored in open formats with the goal of making it easy to consume and access by third parties.

Why did this shift occur and does this mean that software companies will eventually evolve into pure design companies? It's conceivable that with technology becoming more and more accessible and the wider availability of powerful tools, the software company of the future may be staffed almost completely with artists, psychologists, anthropologists, and designers, with maybe a few technical school graduates to write the tools.

And also, why is it that features and capabilities are less emphasized now? Aren't those the cornerstone of the computer revolution--being empowered by technology?

The truth is, the software industry is stuck in a rut. You can see it across all specialties--office productivity software, on the web, in gaming--no new features have been added, no new types of websites, no new gameplay, just more efficiency, more polygons, more psuedo-chrome. Since we have no new features to add, we have been keeping busy by making things pretty and usable, to keep us employed. Why this rut? Some might say that it is because the industry has entered a stage of evolution rather than revolution. We've reached a critical mass where now the improvements will be in small increments. I agree and also disagree. I agree that is the state of the industry, but I think the cause for no new features is simply that we have no new technology.

Technology as a whole, even outside of IT, has actually slowed down. Where are the Bell Labs of today? PARC is a shell of its former self. What are the new Information theories and quantum theories, new internets. Technology innovation has flatlined after it was made unecessary after we came out of wartime. The internet itself is a wartime child.

Okay, I've gotten a little too caught up and started rambling, but I think the solution to this technological rut is clear. We need more fundamental research. We've reached the limit on how far we can milk the results of past research. Whether or not there is a wartime neccessity, we need to do this basic research in order to improve the capabilities of our systems, to claim that things are still getting better.

So, what kind of new capabilities should be developed? Computers today are used almost solely to input, output, store, or transmit human data. But, instead of just being repositories and pipes for the data, I believe computers can consume and reason with data, much like a human can. How this can be implemented in our current market, I'll talk about later.

Ranking Freedom of Press

Here's another interesting ranking: the World Press Freedom Index. The list is topped by Denmark. At the bottom of the list is North Korea. The US? 44th. Another interesting data point is the United States of America (in Iraq) [sic] listed with rank 137. Defenders of freedom?

Using Statistics to Uncover Human Rights Violations

The Human Rights Data Analysis Group , which used to be incubated under AAAS has just released a study they did on the analysis of the human rights violation datasets from Timor-Leste. I'm poring over their paper right now

The Profile of Human Rights Violations in Timor-Leste, 1974-1999
A Report by the Benetech Human Rights Data Analysis Group to the Commission on Reception, Truth and Reconciliation of Timor-Leste
The actual datasets are available for download as well. I encourage you to check them out(zipped CSV files):

the graveyard census database, called the Graveyard Census Database (GCD)
the fatal violations data from the Retrospective Mortality Survey (RMS)
the Multiple Systems Estimation (MSE) data file

Diffbot Launch Date

Some of you may know that I've been working in my spare time on a new type of news reader. Until now, the service has been a closed test involving about 50 users. Last week, though, Leith and I have finally decided on a launch date for a public beta. It's going to be April Fools Day, 2006. That gives us less than two months to get things tidy (and boy are there a lot of things!). Stay tuned...

Ask the Geek Grammar Lady #1

In the course of working with fellow geeks, I've noticed a few language usages that are unique to us geeks. One of these is the tendency to classify problems and issues as either "trivial" or "hard". Now, you have to understand, part of this standard geek colloquialism comes from the math tradition of formal proofs. Trivial is used to describe the obvious, non-interesting solution. "Hardness" could be a shortening of NP-hard, used to describe a class of problems that requires a lot of computation.

Next time you are tempted to use these labels, maybe consider some of the following more meaningful alternatives:

Instead of "This such-and-such problem is trivial"... consider replacing it with:
  • This such-and-such problem is easy to solve!
  • This such-and-such problem is small in scope.
  • This such-and-such problem is easy to talk about, but would require a team of grad students 10 months to implement.
Instead of "So, we all know such-and-such is hard"... consider replacing it with:
  • So, we all know such-and-such is computationally intensive.
  • So, we all know such-and-such is impenetrable.
  • So, we all know such-and-such is something I have no idea how to do.

Latest AIDS Cure Hoax

"Researchers believe they have found a new compound that could finally kill the HIV/AIDS virus, not just slow it down as current treatments do. While most of the community is still hesitant to comment on this until it passes peer review, initial results show that their method attacks and kills ALL variations of the virus. A fast track through the FDA could have one of the world's leading problems licked in less than a decade."

Funniest thing heard on Slashdot
Theoretically, Chuck Norris' tears could cure AIDS, cancer, paraplegia, herpes, common cold, mouth ulcers, and hangovers. Too bad that it is impossible to make Chuck Norris cry...

Neurosurgery is Innate

Scientists have discovered a species of wasp, called Ampulex, that has evolved an ability to perform brain surgery on cockroaches. Not only that, but it has reverse-engineered the brain-physical map of the roach in order to control its movements, a feat which has only been performed by scientists in recent history. Seems like hacking is not only something that humans do.
The wasp slips her stinger through the roach's exoskeleton and directly into its brain. She apparently use ssensors along the sides of the stinger to guide it through the brain, a bit like a surgeon snaking his way to an appendix with a laparoscope. She continues to probe the roach's brain until she reaches one particular spot that appears to control the escape reflex. She injects a second venom that influences these neurons in such a way that the escape reflex disappears.

From the outside, the effect is surreal. The wasp does not paralyze the cockroach. In fact, the roach is able to lift up its front legs again and walk. But now it cannot move of its own accord. The wasp takes hold of one of the roach's antennae and leads it--in the words of Israeli scientists who study Ampulex--like a dog on a leash.

The zombie roach crawls where its master leads, which turns out to be the wasp's burrow. The roach creeps obediently into the burrow and sits there quietly, while the wasp plugs up the burrow with pebbles. Now the wasp turns to the roach once more and lays an egg on its underside. The roach does not resist. The egg hatches, and the larva chews a hole in the side of the roach. In it goes.

The larva grows inside the roach, devouring the organs of its host, for about eight days. It is then ready to weave itself a cocoon--which it makes within the roach as well. After four more weeks, the wasp grows to an adult. It breaks out of its cocoon, and out of the roach as well. Seeing a full-grown wasp crawl out of a roach suddenly makes those Alien movies look pretty derivative.

Update on China Censorship Situation

It appears now China has added http://google.cn to the "Great Firewall"

Tests on a Shanghai-based trace-route server, located at http://www.linkwan.com/vr2/, indicated that the site was being blocked at the government-operated backbone server. The analysis from the trace route said 'IP packets are being lost past network CHINANET backbone network at hop 4.'

On Google Censoring China

Many people have been commenting on Google's recently implemented censorship of Chinese search results. If you search at google.cn from within China, certain sensitive queries such as "falun gong" or "democracy" will recieve censored results. Some have demanded that Google not comply with the Chinese government's request.

So, yesterday I was sitting in a small burrito shop on the corner of Rengstorff and Middlefield waiting for my order. I was scanning the local paper while observing the hyper-efficiency of the Mexican burrito assembly line. The reason I mention this is that a front page article featured a story of an American citizen's recent experience with the Chinese government. It really puts things in perspective.

Here's the full article. Some excerpts..
ET: Tell us about the trial.

Dr. Lee: The trial was conducted in such a way that I was denied every possible legal right. I have evidence which can prove my innocence and they did not allow me to present it. I tried to defend myself, but they did not allow me to do that, especially when I was talking about the reasons, why I was trying to reveal the truth of the persecution. They interrupted me many times; whenever I tried to speak, they would stop me. So I never got a chance to defend myself. And no evidence whatsoever was presented from me, even though I requested it many times.

...

ET: How were you treated?

Dr. Lee: When I was arrested in the very beginning, in Canton, and then was transferred to Guangzhou, they tortured me with handcuffs, which cut into my flesh to the bone; it was extremely painful. They did not allow me to sleep for 92 hours in total. They used the handcuffs as a tool to torture me. They pulled my arms upward, from the back, so it was extremely painful and I could not move at all. If I moved at all, the pain would get worse.

I conducted a hunger strike from the very beginning on January 22, 2003 until February 10—18 days in total.

I still insisted on practicing Falun Gong, so they handcuffed me on March 27, after the trial; the trial was March 21. They handcuffed me, and I started a hunger strike on the 30th, one more time. The reason I started was because I wanted to write an appeal letter, because the trial was unlawful, and I had to make three copies, plus one for myself, thus I had to write four copies of the appeal letter, and I was handcuffed.

On May 9 my appeal letter was denied, and I started a hunger strike again, because this was totally unlawful, so I wanted to protest again. After that, according to their law, that was the final decision, you had to be thrown into prison, so then I was transferred to Nanjing prison on the 12th of May. I was still doing a hunger strike to protest, and then on the 14th of May I received a phone call from the U.S. consulate and I said, "I have some materials over here, I want to give them to you. I will stop the hunger strike today, and if you do not get the materials in two weeks, I will start the hunger strike again." Because those materials are extremely important. They recorded all the details of the trial, what they (the authorities) said, what they did, why they did not allow me to do this and that, and also my appeal letters and how they tortured me. After two weeks, they did not send what I wanted, so I started a hunger strike again.

The forced feeding was extremely painful, and I resisted their treatment. So they just poked the big, thick tube into my nose and into my stomach. It was so irritating that I threw up several times. It was crazy—I was screaming as it was so painful. The cameraman, who was green—just from the police academy—he fainted, right at the scene. On June 2, the U.S. consulate received all the materials I wanted to give them.

They still had my Zhuan Falun [the central text for Falun Gong practitioners], and I said you need to give me this Zhuan Falun , or I won't stop the hunger strike. They started the force feeding again on June 3. Before they did, they yelled, "Taste the power of the people's democratic tyranny!" They were full of exultation before they were going to torture me, like it felt so good. They left the tubes in my nose, which I pulled out myself.

They used the forced feeding to torture me, actually.

They had these so-called group study sessions, anti-Falun Gong group study sessions. I was surrounded by 15 people, yelling at me. Falun Gong is this and that, so crazy, why do you believe in these things… calling me this every day. So I started a hunger strike again, because that was so bad. I was protesting against the torture.

I started a hunger strike again on July 14 to 18, and at that time they left the tube inside of my nose for 33 hours, and they had all of my body tied up on a bed. 33 hours I lied there without moving; it was extremely painful—agony.

Then came the brainwashing. From August, 2003 they started to force me to watch the videotapes. Every day, it was three hours of videotapes. Then they had condemnation meetings on Falun Gong, three-hour sessions; then the policemen would come and talk to me. This continued for three to four months, and they didn't see enough results, so they changed their strategy.

Starting at the end of 2003, they forced me to do slave labor, to make shoes. The shoes used a sort of industrial glue that contains benzene; it's very toxic and irritating, and I felt short of breath and had a headache, that sort of thing. The other thing is, I always tried to refuse to work, because I was innocent—I should not be doing this. They forced me to stand for 16 days, from morning to evening, stand in front of other prisoners; they verbally attacked me, insulted me, that kind of thing. If you didn't stand straight they would kick you and push you.

They tried to force me to confess to the crime, by using forced sitting. They say you have to sit there and think about your wrongdoings yourself, like repentance. You're forced to sit there, just sit there in a fixed position. The longest time was 48 days straight, with my heart problem surfacing as a result. After breakfast it was 7:30 a.m.; then you start sitting there, and at lunchtime you have lunch. Then you start sitting again after lunch, then have dinner, and then come back and sit there for some time and watch their CCTV (China Central Television). Every hour they gave me five minutes to walk around in the cell. The stool was this size [gestures to describes a stool less than a foot high, less than a foot wide, and around six inches deep], you sit there and then your bottom develops this hard callus—it's extremely painful, and your back is also very painful. I was exhausted for such a long time.

After maybe two to three weeks, my brain worked very slowly. When the consulate came, I found it very difficult to speak; somehow, my brain didn't work anymore!

ET: What was your day-to-day life like?

Dr. Lee: They have something for you all the time, like brainwashing sessions. It's always brainwashing, from the very beginning to the very end. They say you are a prisoner, you have committed a crime, that you have to be punished.

And this was an AMERICAN citizen.

Yeah, you don't want to mess with the Chinese government. I think what Google has done in order to bring their service to China is a positive step forward. They even display a message to the user when the results have been censored. Since many of the sensitive sites are filtered anyway by the Chinese government at the ISP level, showing the search results for those would have limited usefulness. Any change that we want to enact in China's humanitarian policies will have to happen at the governement level, not by companies.

Thoughts on Adsense



An early text ad
GMail and Google Maps may be incremental improvements to web based email and mapping, but the reason Google is as talked about today as it is is because of its success on Wall Street. Despite a few recent lackluster product releases, we give Google the benefit of the doubt because, hey, if they were able to more than quadruple their stock price then they must be pretty smart guys. The majority of it's financial success, Google owes, to Adsense, Google's little text ads. (They have recently gone into graphic ads as well)

How sound is the concept of Adsense? Imagine what your elevator pictch for Adsense would be back in the day. Is it as useful as being able to buy books at bargain prices online or trading my used stuff with others? Well, I can only speak personally, but I have recieved little, if any value from Adsense. I've never found anything "relevant" to what I'm looking for in an Adsense ad. I've definitely tried, and I still don't understand it. When I search for something on Google the most relevant results are the natural search results. That is the justification of the search results--The ads inherently cannot be in the best interest of the user and I've trained up my mental adblocking circuits to just simply ignore them.

But, Google continues to milk money from Adsense, now up to $1.9 billion in this last quarter alone. Who's buying this stuff? I think the proper analogy is that Google is cashing in on the online Gold Rush it has created. It's selling picks and shovels to the miners when there is no gold in the mountains to be found. In the American Gold Rush, the real winners, at least financially, were the hotel owners and city developers that provided the support framework to the many westward bound migrants. Of the composition of Adsense traffic, I would conjecture that the majority are "mistake clicks" that do not lead to information the user actually wants to see. The design of the Adsense ad itself is optimized for these mistake clicks. For example if you hover over the Adsense ads on the right, you'll see that the entire surface of the ad is a clickable area, even the empty space between the ads. This goes counter to the web convention that only underlined, blue text represents a hyperlink. So the common behavior of underlining text as you read it will invoke the ad, causing the poor advertiser who thinks he has bid his money on a legitimate user to his site, to pay money to Google for the user's action.

In addition to these "mistake clicks" others have estimated that up to 20% of Adsense clicks are malicious clicks, or spam clicks. Google would never admit to this being a serious problem, but the advertisers themselves have noticed by examining their webserver logs that much of the traffic coming in from these Adsense clicks is suspicious.

So, there seems to be many misconceptions at multiple levels in the Adsense system, both between the user, Google, and the advertiser. How long can the parties involved remain in the dark? John Battelle, in a recent interview, said that this misconception persists because despite the false clicks, advertisers still believe that they are receiving some net benefit from Adsense, in terms of new users to their site. However, John thinks that there is some point at which these benefits will be outweighed by the costs of traffic acquisition.

Where will Google be when that point comes?