Wear Plaid and Hang Out at Coffee Shops? In the Future, Facebook May Know You’re a Hipster.

Artificial intelligence is coming for your social media.

National Journal
Brian Resnick
Add to Briefcase
See more stories about...
Brian Resnick
Dec. 16, 2013, midnight

So you grow some scruff, start wear­ing tight jeans, oc­ca­sion­ally throw on sus­pend­ers, and reg­u­larly don plaid. You start hanging out at that ar­tis­an­al kom­bucha spot down the street — you know, the one with all the wick­er? And then one morn­ing — be­fore you wax that 360-de­gree handle­bar — when you log onto Face­book, you no­tice something dif­fer­ent.

There’s one ad for sock sus­pend­ers, and an­oth­er one for Amish-made beard con­di­tion­er*.

At parties and on the streets, it’s ob­vi­ous — you’re a total hip­ster. And now Face­book knows it too, just by the pho­tos you’ve up­loaded.

While this dysto­pi­an scen­ario is still set in an un­deter­mined fu­ture, the idea that so­cial me­dia can scan your pho­tos for con­tex­tu­al clues about life­style has already been proven. In his lab at Uni­versity of Cali­for­nia San Diego, Serge J. Be­longie and his stu­dents have cre­ated a com­puter al­gorithm that can guess what “urb­an tribe” (i.e., sub­cul­ture) you be­long to.

Hu­mans can do this al­most without think­ing. We hold ste­reo­types of what the word “hip­ster” im­plies, but we know that not one of these vari­ables com­pletely defines the term. A “hip­ster” is the sum of many parts, like a plaid shirt or tight jeans.

This concept — the abil­ity to use con­tex­tu­al clues to define an ob­ject — is what artists and psy­cho­lo­gists call gestalt. But that type of cog­ni­tion is not easy for a com­puter, which op­er­ates on hard rules.

“That’s the theme in my re­search,” Be­longie says. “Whenev­er I stumble across a pat­tern that people can see but is not im­me­di­ately evid­ent from a quant­it­at­ive per­spect­ive, I’d like to probe that to fig­ure out what’s caus­ing that.”

Be­longie and his team com­pile ref­er­ence pho­tos for each urb­an tribe and then “teach” the com­puter to re­cog­nize the pat­terns in col­ors, tex­tures, and geo­met­ric ar­range­ments. The com­puter then “combs through the data­base and looks for ex­cep­tion­al ex­amples of each of those cat­egor­ies.” In oth­er words, Be­longie is try­ing to teach the com­puter the gestalt it needs to nav­ig­ate a high school cafet­er­ia.

Once the com­puter gets a feel for these pat­terns, it can start guess­ing. Be­longie’s pro­gram isn’t per­fect. The ma­chine op­er­ates at just 39 per­cent bet­ter than chance, Be­longie says. “This is something that we’re just crack­ing open a new re­search area.”

A Seis­mic Shift

Be­longie’s work goes bey­ond hip­sters and goths. This was just an off­shoot of his more sober work — teach­ing com­puters to re­cog­nize can­cer in a biopsy slide or dead cor­al from satel­lite pho­tos.

And yet, he says his re­search can’t ig­nore the pull of so­cial me­dia. “In the old days,” he says, “It was NSF and NIH and DARPA grants — that’s what was kept this field rolling.” But now com­pan­ies like Face­book and Google are in­vest­ing heav­ily in ar­ti­fi­cial in­tel­li­gence, and pick­ing off his stu­dents when they gradu­ate.

The de­fin­ing story of the dec­ade con­tin­ues to be the ap­plic­a­tions of big data. Yes, the Snowden leaks were the biggest story of the year, but they speak to the lar­ger trend of what huge in­sti­tu­tions, such as the U.S. gov­ern­ment, can do when they can pro­cess tera­bytes of data quickly in­to us­able in­form­a­tion. But here’s where that story is start­ing to shift. Big data is go­ing to gain (great­er) con­scious­ness. Or at least that’s where the re­search money is head­ing.

Just re­cently, Face­book an­nounced it is open­ing a gi­ant ar­ti­fi­cial in­tel­li­gence lab to be pi­loted by Yann LeCun, a re­search­er in the field from New York Uni­versity. “The set of tech­no­lo­gies that we’ll be work­ing on is es­sen­tially any­thing that can make ma­chines more in­tel­li­gent,” LeCun tells WIRED about the ini­ti­at­ive.

Google, too, re­cently hired Ray Kur­z­weil, a fu­tur­ist who has pre­dicted that com­puter in­tel­li­gence will ex­ceed hu­man in­tel­li­gence by 2045, to work on ma­chine learn­ing pro­jects. “I en­vi­sion, some years from now, that the ma­jor­ity of search quer­ies will be answered without you ac­tu­ally ask­ing,” he told Sin­gu­lar­ity Hub after he was hired. “It’ll just know this is something that you’re go­ing to want to see.”

Which is kind of creepy, right?

Let’s put it in­to this con­text: Cur­rently Face­book does a lot with its user data, such as run­ning mass so­cial ex­per­i­ments on Elec­tion Day, and re­search­ing at which rates wo­men take the names of their hus­bands when they get mar­ried (the so­cial net­work makes all these stud­ies pub­lic). But if that’s creepy, what’s to come is still creepi­er.

“There is a huge, seis­mic shift that is hap­pen­ing, that every com­pany wants ar­ti­fi­cial in­tel­li­gence in some way,” Be­longie ex­plains. “They are just drown­ing in big data.”

And an enorm­ous amount of that data is in im­age form, which up to now, hasn’t fed back mean­ing­ful in­form­a­tion about users. “These im­ages are just sit­ting in these serv­ers like dark mat­ter,” he says.

Be­longie says it’s part of the “nat­ur­al pro­gres­sion,” that these com­pan­ies will use pro­grams like his own “for good or for ill — but most likely just to serve up more rel­ev­ant ads.”

I asked Be­longie if he thought his own work was “creepy.”

“I’ve lost my ob­jectiv­ity,” he laughs, “be­cause I find these prob­lems so in­ter­est­ing from a sci­entif­ic per­spect­ive. I don’t find it creepy, but I think people need to be aware of what they are shar­ing.”

*Ed­it­or’s Note: A won­der­ful product.

COR­REC­TION: This art­icle orig­nally un­der­stated the ac­cur­acy of the Urb­an Tribe pro­gram. The sys­tem guesses cor­rectly 48 per­cent of the time.

What We're Following See More »
WITH LIVE BLOGGING
Trump Deposition Video Is Online
2 hours ago
STAFF PICKS

The video of Donald Trump's deposition in his case against restaurateur Jeffrey Zakarian is now live. Slate's Jim Newell and Josh Voorhees are live-blogging it while they watch.

Source:
SOUND LEVEL AFFECTED
Debate Commission Admits Issues with Trump’s Mic
3 hours ago
THE LATEST

The Commission on Presidential Debates put out a statement today that gives credence to Donald Trump's claims that he had a bad microphone on Monday night. "Regarding the first debate, there were issues regarding Donald Trump's audio that affected the sound level in the debate hall," read the statement in its entirety.

Source:
TRUMP VS. CHEFS
Trump Deposition Video to Be Released
4 hours ago
THE LATEST

"A video of Donald Trump testifying under oath about his provocative rhetoric about Mexicans and other Latinos is set to go public" as soon as today. "Trump gave the testimony in June at a law office in Washington in connection with one of two lawsuits he filed last year after prominent chefs reacted to the controversy over his remarks by pulling out of plans to open restaurants at his new D.C. hotel. D.C. Superior Court Judge Brian Holeman said in an order issued Thursday evening that fears the testimony might show up in campaign commercials were no basis to keep the public from seeing the video."

Source:
A CANDIDATE TO BE ‘PROUD’ OF
Chicago Tribune Endorses Gary Johnson
7 hours ago
THE LATEST

No matter that his recall of foreign leaders leaves something to be desired, Gary Johnson is the choice of the Chicago Tribune's editorial board. The editors argue that Donald Trump couldn't do the job of president, while hitting Hillary Clinton for "her intent to greatly increase federal spending and taxation, and serious questions about honesty and trust." Which leaves them with Johnson. "Every American who casts a vote for him is standing for principles," they write, "and can be proud of that vote. Yes, proud of a candidate in 2016."

FUNERAL FOR ISRAELI LEADER
Obama Compares Peres to ‘Giants of the 20th Century’
7 hours ago
THE DETAILS

Speaking at the funeral of former Israeli Prime Minister Shimon Peres, President Obama "compared Peres to 'other giants of the 20th century' such as Nelson Mandela and Queen Elizabeth who 'find no need to posture or traffic in what's popular in the moment.'" Among the 6,000 mourners at the service was Palestinian President Mahmoud Abbas. Obama called Abbas's presence a sign of the "unfinished business of peace" in the region.

Source:
×