SxSWi Report: Designing for the Wisdom of Crowds

NB: I have long wanted to attend SxSwi – where the cool geeks go to party – and this year had my first opportunity to do so, thanks to Sun. This conference is great bang for the buck: registration cost only $450, for four days of good, solid talks. I’ve been meaning for some time to write about sessions I attended and what I learned from them, but time keeps getting away from me. Here’s the first in a series. I hope the next will follow in reasonably short order – but I don’t guarantee that!

I attended Derek Powazek’s talk (slides), which was inspired by James Surowiecki‘s book The Wisdom of Crowds.

Why I attended this session: I work with communities, both online and off. And Powazek is a well-known name in web design, which has been part of my career, so this confluence of topics was irresistible to me.

From my notes:

Surowiecki’s premise is that the aggregate wisdom of “the crowd” can be greater than the wisdom of a single individual (no matter how expert).

According to Surowiecki, the elements of wise crowds are:

  • diversity
  • independence
  • decentralization
  • aggregation

Powazek gave suggestions on how to make the wisdom of the crowd work online:

  • give small, simple tasks (e.g., one-click vote on Hot or Not) – This works best when there is a definite outcome, e.g. a Threadless shirt design is chosen. A grass-roots news site gave a list of desired interviewees, participants then conducted the interview(s) of their choice via email
  • try to have a large, diverse group of participants – This is a sticky point. The Internet is inherently a place where it’s easy for people of all kinds to congregate (absent language barriers), but we still clump with people who mostly think like us. It takes effort to create a truly diverse crowd.
  • design for selfishness: participants have to get something out of it for themselves, even just a chance to win. The “greater good” is not sufficient motivation. (But personal glory can be.)
  • aggregate results so that individual behavior (e.g., tagging) leads to collective wisdom

(However, there’s the Heisenberg Problem: scoring creates a game, and therefore an incentive to cheat.)

Popularity does not have to rule. Amazon’s reviews/ratings are displayed with a histogram of results, and readers can rate each review (“was this helpful? yes/no”), giving feedback on the feedback.

Consider both implicit and explicit feedback.

Implicit:

  • page views
  • searches
  • rate of change
  • interestingness

Explicit = voting and rating, but never ask people to do more thinking than they have to, e.g. use a simple yes/no or thumbs up/thumbs down wherever possible.

Note, however, that you get better data when you don’t ask the question.

Design Matters

Kvetch.com -  The mood of responses became happier when the color scheme changed from dark to light.

Red vs. blue – In testing, people shown blue backgrounds responded with more imagination, while red backgrounds led to better attention to detail. This may occur because red is a danger sign, so people are primed to be more cautious when they see red, whereas blue is calming, so they feel freer to be creative.

(Sun’s corporate theme color is blue, Oracle’s is red. Uh oh.)

Filling in the Blanks

For me, this was the payoff from this talk. Powazek described a study on how people’s feelings of not being in control lead them to see patterns (e.g., conspiracies) where none exist.

He has also written about this in Meaning-Making Machines:

This is relevant online because we have much less input than in real-life social situations. Virtual communications like email, blog comments, and instant messages come without the associated social data our brains are used to. In the absence of context, our brains fill in the rest. What we fill it in with is a byproduct of our own insecurities.

My own thoughts on this:

If you’ve spent much time interacting with people online in email, forums, blogs and comments, you know how easy it is misunderstand someone’s character or intentions when you only know them through text.

Misunderstandings can occur because of differences in language, culture and writing skills, as well as the above-mentioned human propensity to fill in our mental gaps with worst-case assumptions. We are especially negative in our assumptions when we don’t feel in control in our own lives – and, these days, who does? The result is flame wars and other online unpleasantness that simply doesn’t happen in real life.

In my first distance-working experience, I also learned that it’s hard for human beings to work with someone they’ve never seen. I suspect that we don’t quite believe someone is real until we’ve seen them face-to-face. In my six years working from Italy for a Silicon Valley company, I noticed that colleagues were poor at responding to me until they’d met me once (I traveled to California four times a year), then their attitude would change radically. It wasn’t that I did anything particular on my visits to inspire cooperation; it was simply that they now could put a face to the emails and the voice on the phone. I guess that’s human.

Conversely, we can have warm feelings for people we’ve only seen on screens. I have twice now embarrassed myself meeting actors in unexpected contexts, the first at CES, and, more recently, at SxSWi itself: I was wandering the halls when I saw a familiar face. This wasn’t unexpected at SxSWi; videoblogging buds and other folks I know were there. So my brain registered “someone I know and like,” and I rushed up to greet her with an enthusiastic “Hi!” before my memory kicked in with: “You know her from Buffy and Dr. Horrible.” She was completely unfazed; I’m sure this happens a lot to actors.

All this is why I’ve encouraged the Sun teams I’ve filmed to shoot brief introductions of themselves to share online: if you’ve seen their faces and heard their voices in video, you’re more likely to treat them kindly when responding to their text (e.g. in an online forum). And it’s easier to feel a sense of community, kinship, and cooperation with people you’ve seen and heard, even if only via recorded video.

The next step is to get video from non-Sun members of our developer communities. Working on it!

Returning to Powazek, he concluded his talk with some examples of the above-mentioned principles in action, such as a crowd-curated photography exhibit at the Brooklyn Museum.

Rating: A great and useful talk. I should go read his books.

Gallery: Hauz Khas, Delhi

Hauz Khas is a quiet green spot in the madness which is Delhi, with tourist appeal and historical significance. These photos are from my 2004 visit. Note that the gallery below now includes Jantr Mantr and other sites in Delhi.

ps There are some nice boutique shops and at least one great restaurant nearby.

Video: Shooting Presentations

The formal presentation accompanied by slides and followed by Q&A is standard fare at conferences and other corporate settings. It makes sense to capture these on video whenever possible, so that you can re-use the material and get greater returns on the investment that the presenter (and the company) have made in developing the presentation, traveling to the venue, etc.

So what’s the best way to video these things? I have a few suggestions, based on LOTS of experience.

Lighting

The setting is usually a large room with a podium at the front where the speaker rests a laptop. Slides are projected onto one or two screens to the side(s) of the speaker.

These are terrible filming conditions. At large events the speaker may be spotlighted, but more often you’re stuck with room lighting, and have to fight with people who keep wanting to turn that down so   the slides can be read more easily. Resist this tooth and nail: you have enough lighting problems even with the room lights turned up as high as they will go.

Camera Position

I’ve seen people set up a camera at the back of the room, angled to get both the presenter and the projected slides in the frame, on the assumption that this way they’re capturing everything. WRONG. The slides will be illegible at that distance, and the speaker a blurry silhouette. The resulting video won’t be good for much.

My solution is to position my camera close to the front of the room, preferably on the same side that the screen is on, shooting across the room so that the speaker’s face and upper body are framed and NOT silhouetted against the screen.

The front row is ideal, as long as that’s not so close to the speaker that he/she disappears behind the podium, and also taking into account your need to connect to a good sound source. If you can’t be in the front row, you’ll need to raise the camera up enough to shoot over the heads of the audience in front of you. I usually put my tripod on a table, and use the center column to get more height (note, however, that whenever you put a tripod on a table, you are vulnerable to people jiggling the table; it’s a tossup between that and having them trip over the legs if you put the tripod on the floor).

Give yourself room to pan the camera back and forth in case the speaker paces during the presentation. Sometimes you may think the speaker is “tethered” because the podium is on a dais or stage, but don’t count on it – you’d be surprised how mobile some speakers can be in the face of all kinds of obstacles! (NB: I’m happy for speakers to move around, if that feels natural to them – it makes for more entertaining video.)

Because I zoom in on the speaker, the slides are usually not in the picture at all (unless the speaker walks over in front of the screen and gestures at the slide). As you can see in most of the videos I’ve done for Sun, I edit the slides in afterward as video overlays. To make it easier to find the right place to put each slide, during filming I try to note the timing of slide changes.

…or try to get a corner of the screen in your shot so that you’ll be able to see on the video when the slide changes.

Sound

Try to ensure that questions from the audience will be heard on the video, either by the questioners using a floor mic or the speaker repeating the question. You can’t always enforce this, so be prepared to write down the questions as well and edit them in later as subtitles – otherwise you have video of a speaker nodding wisely in total silence, then rattling off an answer that’s unintelligible without the question.

The results of all this will not be the highest-quality video, but, especially if you take care to get good sound, it will be good enough for web use, and people worldwide who could not attend the presentation in person will be grateful that you made it available.

You can see many, many examples of my video work on my YouTube channel.

The Twitter Diaries: 2009-04-26: CO

  • contemplating 25 (now 27) years online: http://tinyurl.com/c2dund #
  • @timfoster sorry to miss you in MPK this week. Will you be back for C1? in reply to timfoster #
  • @ElaineEllis how to start on Doors Open Denver? Not clear on the site. in reply to ElaineEllis #
  • @davewiner I suspect Twitter is so short-staffed they don’t have time or expertise for good curatorship. in reply to davewiner #
  • @davidorban ANSA also takes down old articles = lots of link rot on my site. Managgia! in reply to davidorban #
  • @ajkeen lots of sites do that “you’re in x, therefore you must speak xian” thing. Drives me batty. in reply to ajkeen #
  • @ElaineEllis thx, had to get the map first, but figured that out. Legs hurt. in reply to ElaineEllis #
  • OMFG #
  • @baratunde male-female diffs in conversational styles take a lot of managing and awareness. Women generally don’t interrupt, men do. in reply to baratunde #
  • @nonstick better hope MIL never gets on Twitter. There’s always that risk… in reply to nonstick #
  • RT @deirdrewalsh http://myparentsjoinedfacebook.com/ – thanks, my daughter will love that one! #
  • @lbridenne76 you say that as if Coronas would be a drawback. in reply to lbridenne76 #
  • @zalez is there an online agenda for the meetings? #oracle #Munich #OpenSolaris in reply to zalez #
  • @jeffreytaylor as if required nudity and multiple showers are a bad thing? in reply to jeffreytaylor #
  • The death of 1000 reports on cuts: all this analysis is painful when it’s YOUR blood that may be on the street. #
  • Severgnini severo: http://tinyurl.com/d5r3lo (wish I could translate into English, he may do it himself) #
  • Uspo won’t deliver to my house so standing in line to pick up a registered letter. Augh #
  • The nice thing about twitter is: if you’re not interested in someone, YOU DON’T HAVE TO FOLLOW THEM #
  • “Carrie Prejean was neck-in-neck with winner Miss North Carolina…” Neck IN neck? Ouch! Fox News has no copyeditors, evidently. #
  • @italylogue there are a few Roman swear words in my Italian slang pages, and a few other dialects here and there #
  • @NatHistoryWhale hey, a friend of mine was very likely the editor of that video, whatever it is. in reply to NatHistoryWhale #
  • power nap on the boss’ sofa was good but not sufficient. More sleep at night would be nice, hard to achieve these days. #
  • @c0t0d0s0 speaking of important things, we’re still looking for suggestions on venue(s) for a student event in Hamburg on June 21st in reply to c0t0d0s0 #
  • @c0t0d0s0 “too expensive” is relative, but we don’t know how many people yet. Are German universities in session then? in reply to c0t0d0s0 #
  • FISL proposal drafted, C1 OpenSolaris schedule filling in… I’m starting to feel on top of my workload. I must be forgetting something. #
  • @thepartycow look up my buds at TVBLOB and let me know what you think. It’s cool technology. (I used to work on it.) in reply to thepartycow #
  • Google Profile both pointless and impossible for me. My name is unique, and my life doesn’t fit in little boxes. #
  • http://twitpic.com/3qhf5 – ROTFL – Google thinks I’m all about the Italian seduction! #
  • @ranaban the idea seems to be to uniquely identify you, so Google Profile might actually help in your case in reply to ranaban #
  • @jimgris re Community Leadership conf, looks as if as lot of us ought to. in reply to jimgris #
  • @rosso $%^#$%^$%^ ma sono diventati pazzi? Gelato is made to walk around with, that’s why it’s in a cone. And the stores are so tiny! in reply to rosso #
  • RT @rosso http://tinyurl.com/cby6do It’s now illegal to eat gelato on the streets in Lombardy. WTF? #
  • @shawnferry no you don’t, just use the password in reply to shawnferry #
  • at least this wait music is better than the stuff we hear while waiting for AT&T con calls to start #
  • @jimgris I’ve put it on the calender, in between Australia and OSCON… in reply to jimgris #
  • @alice my favorite charity http://sageprogram.org/ – teaching kids to be global citizens in MANY senses of the term #
  • @SteveEdiger see http://blog.alice.com/ – it’s a chance to have them give $25 to the charity of your choice in reply to SteveEdiger #
  • turning off the lights in Sun offices for Earth Day today is not, psychologically, a great idea. #
  • @StorageMonkeys black humor is my specialty. <wry grin> in reply to StorageMonkeys #
  • @plasticbagUK it is best to be cautious; most travelers are clueless and tropical diseases are v real. Malaria prevention also a good idea in reply to plasticbagUK #
  • corporate survival strategies: Eric gave me a slice of panettone, then I scavenged sandwiches left over from a meeting. #
  • @plasticbagUK don’t be overconfident. Dengue fever will walk right thru your vaccinations and kick your ass in reply to plasticbagUK #
  • just posted: Capturing Good Sound for Video http://tinyurl.com/dkkwwe #
  • anyone know of a way to track statistical trends in Twitter topics? e.g. for specific keywords #
  • @sumaya hmm. I need a way to track specific and not enormously popular topics e.g. Solaris Cluster in reply to sumaya #
  • @ckoontz thanks for the tips, though the topics I’m searching on are too obscure to really be on the radar on these svcs in reply to ckoontz #
  • and the prize for “most stupidly obvious headline” goes to: “Changes may be ahead for Sun Microsystems workers after Oracle buyout” #
  • @missbhavens umm… together? in reply to missbhavens #
  • @AmandaLorenzani good books I’m reading recently: Blink, God is Not Great, Nation, anything else Pratchett in reply to AmandaLorenzani #
  • recommendations for managing multiple twitter accounts? #
  • @ben I now have two Macs. And my old Dell laptop. in reply to ben #
  • @jowyang I love animals, but have a hard time with people acting as if they’re children. Plenty of real human children need love and money. in reply to jowyang #
  • @DonMacAskill you were great at the OpenStorage Summit, nice buildup to a Cinderella story. Kept us hooked, waiting for the outcome. in reply to DonMacAskill #
  • oh, right, today is Bring Your Kid to work day. My work was mostly at home when Ross was small, she learned the Internet sitting at my elbow #
  • @DonMacAskill you’ll be great. I’d recommend you as a speaker anytime (and I spend a lot of my life at conferences these days…) in reply to DonMacAskill #
  • okay, so I downloaded Tweetie. It’s pretty, but I can’t see how to use it with multiple accounts, and the user manual is “coming soon.” #
  • found the add account feature in Tweetie, but it doesn’t work (authentication error). And I’m not the only one. Still need a solution. #
  • ♫ “Who are going to meet their fate in a highly nervous state (tarantara tarantara tarantara)…” ♫ #
  • ♫ “…but of course it would be wise not to carp or criticise (tarantara tarantara tarantara)…” ♫ #
  • @jowyang re. JetBlue, they’re doin’ it right where it counts: on the plane. e.g. free movies when the TV wasn’t working. in reply to jowyang #
  • @DonMacAskill so how did it go? in reply to DonMacAskill #

Powered by Twitter Tools.

Deirdré Straughan on Italy, India, the Internet, the world, and now Australia