December 7, 2009

Free report: ‘Real-Time Search and Discovery of the Social Web’

Google, Microsoft scram­ble to incor­po­rate real-time search into their results

David SparkCall it good or bad tim­ing, but I just hap­pened to fin­ish a report on real-time search on the day that Google announced its roll­out of its inte­grated real-time search results within its gen­eral search results. After some last-minute edits, the report is now done and I’m mak­ing it avail­able to every­one for free. It’s titled, “Real-Time Search and Dis­cov­ery of the Social Web.” You can down­load the PDF, or view it as a slide show on Scribd.

Given that I’m maki­ing the report avail­able free, I ask just one thing in return: feed­back. Pos­i­tive, neg­a­tive, it’s all wel­comed — just please make it con­struc­tive. I’m eagerly learn­ing as much as I can about this sub­ject. This is an area that I think is going to grow like crazy, and we’re only look­ing at a thumbnail’s worth of what is yet to come.

Here are some high­lights from the report.

  • Real-time search could steal away as much as $40 bil­lion from tra­di­tional search. Google and Microsoft’s announce­ment to incor­po­rate real-time search results is a good first step to pre­vent losses.
  • The def­i­n­i­tion of real-time search is far more var­ied than the def­i­n­i­tion of tra­di­tional search. You’ll see more vari­a­tions in what is con­sid­ered a real-time search engine.
  • All real-time search engines are far from equal. The major rea­son is they don’t index the same content.
  • Real-time search engines that index only Twit­ter are miss­ing up to 90 per­cent of the real-time web.
  • One excit­ing new aspect of real-time search is the cre­ation of real-time pro­gram­ming that will be com­ple­men­tary and com­pet­i­tive with tra­di­tional pro­gram­ming (e.g. TV, radio, print and online).

Enjoy and let me know what you think. David

Decem­ber 10th, 2009 CORRECTION: The arti­cle men­tioned that real-time search engine Wowd required a plu­gin for its use. That is not true. Cur­rent report is updated to reflect that it’s not required.David Spark helps busi­nesses grow by devel­op­ing thought lead­er­ship through sto­ry­telling and cov­er­ing live events at Spark Media Solu­tions. He blogs at The Spark Minute and can be heard and seen reg­u­larly on ABC Radio, Cranky Geeks with John C. Dvo­rak, and KQED in San Fran­cisco. See his busi­ness pro­file, con­tact David, or leave a com­ment below.

This website uses IntenseDebate comments, but they are not currently loaded because either your browser doesn't support JavaScript, or they didn't load fast enough.

16 Comments

1.
@joemarchese

Fan­tas­tic write up David. Going to link back from my Medi­a­Post col­umn I am writ­ing now on the impli­ca­tions of real time search for marketers.

Comment by @joemarcheseNo Gravatar — December 8, 2009 @ 2:01 am

2.
Anna Hughes

Hi David great post and report, it was really insight­ful. I have been debat­ing with a team mem­ber on what the impli­ca­tions will be for opti­mis­ing con­tent. Will real­time search open the door to a new wave of black hat opti­mi­sa­tion tech­niques and be real prob­lem? Or due to the fact the con­tent is cur­rently stream­ing through from social media plat­forms that already reg­u­late mis-use? would be really inter­ested in your thoughts!

Comment by Anna HughesNo Gravatar — December 8, 2009 @ 2:55 pm

3.
Craig Kessler

It seems the real time search only takes up a minor part of Google and the search query page. Do you think this is strictly more for mar­keters? Because as a user I have no inter­est about real time Twitter/Facebook sta­tus searches.

Comment by Craig KesslerNo Gravatar — December 8, 2009 @ 4:30 pm

4.
@bdo

Good arti­cle David. I think that many of the start-ups that you men­tioned repli­cate the tra­di­tional search expe­ri­ence: type key­word, see list of results. I think that in real-time three issues will be key: (1) search, nav­i­ga­tion and dis­cov­ery will tend to merge, (2) per­son­al­iza­tion will be a must and (3) an impor­tant social com­po­nent will need to be incor­po­rated. Tough work ahead !

Comment by @bdoNo Gravatar — December 8, 2009 @ 8:17 pm

5.
David Spark

You really have no inter­est in real-time sta­tus searches? You haven’t been play­ing it around with it. It’s actu­ally immensely valu­able and fas­ci­nat­ing. If you’re not inter­ested because you don’t want to know if everyone’s eat­ing a ham sand­wich right now, I under­stand, but tweets and Face­book sta­tus updates actu­ally give you real insight into the pub­lic inter­est right now. Start play­ing around with the real-time search engines and you’ll see what I mean.

Comment by David SparkNo Gravatar — December 9, 2009 @ 5:40 am

6.
Marshall Kirkpatrick

Look­ing for­ward to read­ing it. Con­grats on its completion.

Comment by Marshall KirkpatrickNo Gravatar — December 9, 2009 @ 12:36 am

7.
Dave Woodall

David, nice! I don’t have any crit­i­cisms per se, just per­sonal obser­va­tions (pre­dic­tions?) about mon­e­tiz­ing the social/real-time web. With respect to the real-time web poten­tially account­ing for up to 40% of all search activ­ity and $40B in rev­enue, this assumes all 40% of that traf­fic is worth mon­e­tiz­ing. Given the cur­rent “90/10” nature of the real-time web’s con­tent you refer to, it is appar­ent that much of it is worth­less (i.e. – unable to be mon­e­tized) noise. As Mar­keters move to the real-time web, they (and con­tent providers) need to remem­ber; it’s “Social” not “Com­mer­cial” Media. On the Social Web, there’s an ultra-fine line between enhanc­ing or intrud­ing upon the user experience…and alien­at­ing con­sumers. Noise is noise regard­less its source.
Like you, I see mas­sive up-side for the real-time web in enter­tain­ment con­tent. Con­tin­ued luck; I’ll be sure to look for more of your work.
@Joe March­ese — Thanks for link­ing to the article.

Comment by Dave WoodallNo Gravatar — December 9, 2009 @ 1:03 am

8.
Dave Woodall

David, nice! I don’t have any crit­i­cisms per se, just per­sonal obser­va­tions (pre­dic­tions?) about mon­e­tiz­ing the social/real-time web. With respect to the real-time web poten­tially account­ing for up to 40% of all search activ­ity and $40B in rev­enue, this assumes all 40% of that traf­fic is worth mon­e­tiz­ing. Given the cur­rent “90/10” nature of the real-time web’s con­tent you refer to, it is appar­ent that much of it is worth­less (i.e. – unable to be mon­e­tized) noise. As Mar­keters move to the real-time web, they (and con­tent providers) need to remem­ber; it’s “Social” not “Com­mer­cial” Media. On the Social Web, there’s an ultra-fine line between enhanc­ing or intrud­ing upon the user experience…and alien­at­ing con­sumers. Noise is noise regard­less its source.
Like you, I see mas­sive up-side for the real-time web in enter­tain­ment con­tent. Con­tin­ued luck; I’ll be sure to look for more of your work.
@Joe March­ese — Thanks for link­ing to the article.

Comment by Dave WoodallNo Gravatar — December 9, 2009 @ 1:03 am

9.
David Spark

One of the aspects that came up in my inter­views but we didn’t get into heav­ily was spam. I make a men­tion of it in my report, the need to con­trol spam in real time, but I don’t go into depth. That could be another report in itself. And actu­ally, the sub­jects of spam might actu­ally have some inter­est in real-time infor­ma­tion. Why are spam­mers spam­ming this stuff now?

Comment by David SparkNo Gravatar — December 9, 2009 @ 5:39 am

10.
David Spark

One of the aspects that came up in my inter­views but we didn’t get into heav­ily was spam. I make a men­tion of it in my report, the need to con­trol spam in real time, but I don’t go into depth. That could be another report in itself. And actu­ally, the sub­jects of spam might actu­ally have some inter­est in real-time infor­ma­tion. Why are spam­mers spam­ming this stuff now?

Comment by David SparkNo Gravatar — December 9, 2009 @ 5:39 am

11.
David Spark

You really have no inter­est in real-time sta­tus searches? You haven’t been play­ing it around with it. It’s actu­ally immensely valu­able and fas­ci­nat­ing. If you’re not inter­ested because you don’t want to know if everyone’s eat­ing a ham sand­wich right now, I under­stand, but tweets and Face­book sta­tus updates actu­ally give you real insight into the pub­lic inter­est right now. Start play­ing around with the real-time search engines and you’ll see what I mean.

Comment by David SparkNo Gravatar — December 9, 2009 @ 5:40 am

12.
David Spark

You really have no inter­est in real-time sta­tus searches? You haven’t been play­ing it around with it. It’s actu­ally immensely valu­able and fas­ci­nat­ing. If you’re not inter­ested because you don’t want to know if everyone’s eat­ing a ham sand­wich right now, I under­stand, but tweets and Face­book sta­tus updates actu­ally give you real insight into the pub­lic inter­est right now. Start play­ing around with the real-time search engines and you’ll see what I mean.

Comment by David SparkNo Gravatar — December 9, 2009 @ 5:40 am

13.
David Spark

These are very good points. But the “social” com­po­nent is often all the real-time con­tent since all of it is com­ing from some type of social media tool. What I think is going to hap­pen is there will be more of a merger of the three dif­fer­ent types of appli­ca­tions: real-time search, social media mon­i­tor­ing tools, and most impor­tantly (and to your point) real-time inter­ac­tiv­ity tools such as Seesmic and Tweet­deck, but can do more than just Tweet at sta­tus updates.

Comment by David SparkNo Gravatar — December 9, 2009 @ 5:43 am

14.
David Spark

Thanks bud. Yes, it took a while to just get the last items fin­ished. Do let me know what you think.

Comment by David SparkNo Gravatar — December 9, 2009 @ 5:43 am

15.
David Spark

That’s a really good point. I guess I cov­ered my basis by say­ing “up to $40 bil­lion.” Although, the $40 bil­lion is in ref­er­ence to mar­ket val­u­a­tion, not rev­enue the com­pany is gen­er­at­ing in a year. It’s esti­mated that the entire mar­ket val­u­a­tion of tra­di­tional search hov­ers around $100 bil­lion. Using that logic, that’s $1 bil­lion for every 1%. And much of search is real-time search that Google and Microsoft weren’t sat­is­fy­ing, and now to a degree are.

Comment by David SparkNo Gravatar — December 9, 2009 @ 5:46 am

16.
David Spark

That’s a really good point. I guess I cov­ered my basis by say­ing “up to $40 bil­lion.” Although, the $40 bil­lion is in ref­er­ence to mar­ket val­u­a­tion, not rev­enue the com­pany is gen­er­at­ing in a year. It’s esti­mated that the entire mar­ket val­u­a­tion of tra­di­tional search hov­ers around $100 bil­lion. Using that logic, that’s $1 bil­lion for every 1%. And much of search is real-time search that Google and Microsoft weren’t sat­is­fy­ing, and now to a degree are.

Comment by David SparkNo Gravatar — December 9, 2009 @ 5:46 am

Sorry, the comment form is closed at this time.

Related posts

About Socialmedia.biz

We're the #1 site covering the business of social media and the social Web. We can help your company become a social business. Find out how | Contact us

Real-time conversations

Follow us on Twitter

Social media jobs

Powered by
Socialmedia.biz provides these listings as a community service (without compensation).

Latest comments

Flickr gallery

Upcoming

Contributors

JD Lasica
JD Lasica
Silicon Valley
Ayelet Noff
Ayelet Noff
Tel Aviv
Chris Abraham
Chris Abraham
Berlin/Washington
Joanna Lord
Joanna Lord
Los Angeles
Christopher S. Rollyson
CS Rollyson
B: GHCJ
Chicago
Deltina Hay
Deltina Hay
Austin
David Spark
David Spark
San Francisco

Disclosure statement

Here is a list of companies and organizations that JD helps advise or has been involved with professionally.

Recent Twitter visitors