So you grow some scruff, start wearing tight jeans, occasionally throw on suspenders, and regularly don plaid. You start hanging out at that artisanal kombucha spot down the street — you know, the one with all the wicker? And then one morning — before you wax that 360-degree handlebar — when you log onto Facebook, you notice something different.
At parties and on the streets, it’s obvious — you’re a total hipster. And now Facebook knows it too, just by the photos you’ve uploaded.
While this dystopian scenario is still set in an undetermined future, the idea that social media can scan your photos for contextual clues about lifestyle has already been proven. In his lab at University of California San Diego, Serge J. Belongie and his students have created a computer algorithm that can guess what “urban tribe” (i.e., subculture) you belong to.
Humans can do this almost without thinking. We hold stereotypes of what the word “hipster” implies, but we know that not one of these variables completely defines the term. A “hipster” is the sum of many parts, like a plaid shirt or tight jeans.
This concept — the ability to use contextual clues to define an object — is what artists and psychologists call gestalt. But that type of cognition is not easy for a computer, which operates on hard rules.
“That’s the theme in my research,” Belongie says. “Whenever I stumble across a pattern that people can see but is not immediately evident from a quantitative perspective, I’d like to probe that to figure out what’s causing that.”
Belongie and his team compile reference photos for each urban tribe and then “teach” the computer to recognize the patterns in colors, textures, and geometric arrangements. The computer then “combs through the database and looks for exceptional examples of each of those categories.” In other words, Belongie is trying to teach the computer the gestalt it needs to navigate a high school cafeteria.
Once the computer gets a feel for these patterns, it can start guessing. Belongie’s program isn’t perfect. The machine operates at just 39 percent better than chance, Belongie says. “This is something that we’re just cracking open a new research area.”
A Seismic Shift
Belongie’s work goes beyond hipsters and goths. This was just an offshoot of his more sober work — teaching computers to recognize cancer in a biopsy slide or dead coral from satellite photos.
And yet, he says his research can’t ignore the pull of social media. “In the old days,” he says, “It was NSF and NIH and DARPA grants — that’s what was kept this field rolling.” But now companies like Facebook and Google are investing heavily in artificial intelligence, and picking off his students when they graduate.
The defining story of the decade continues to be the applications of big data. Yes, the Snowden leaks were the biggest story of the year, but they speak to the larger trend of what huge institutions, such as the U.S. government, can do when they can process terabytes of data quickly into usable information. But here’s where that story is starting to shift. Big data is going to gain (greater) consciousness. Or at least that’s where the research money is heading.
Just recently, Facebook announced it is opening a giant artificial intelligence lab to be piloted by Yann LeCun, a researcher in the field from New York University. “The set of technologies that we’ll be working on is essentially anything that can make machines more intelligent,” LeCun tells WIRED about the initiative.
Google, too, recently hired Ray Kurzweil, a futurist who has predicted that computer intelligence will exceed human intelligence by 2045, to work on machine learning projects. “I envision, some years from now, that the majority of search queries will be answered without you actually asking,” he told Singularity Hub after he was hired. “It’ll just know this is something that you’re going to want to see.”
Which is kind of creepy, right?
Let’s put it into this context: Currently Facebook does a lot with its user data, such as running mass social experiments on Election Day, and researching at which rates women take the names of their husbands when they get married (the social network makes all these studies public). But if that’s creepy, what’s to come is still creepier.
“There is a huge, seismic shift that is happening, that every company wants artificial intelligence in some way,” Belongie explains. “They are just drowning in big data.”
And an enormous amount of that data is in image form, which up to now, hasn’t fed back meaningful information about users. “These images are just sitting in these servers like dark matter,” he says.
Belongie says it’s part of the “natural progression,” that these companies will use programs like his own “for good or for ill — but most likely just to serve up more relevant ads.”
I asked Belongie if he thought his own work was “creepy.”
“I’ve lost my objectivity,” he laughs, “because I find these problems so interesting from a scientific perspective. I don’t find it creepy, but I think people need to be aware of what they are sharing.”
*Editor’s Note: A wonderful product.
CORRECTION: This article orignally understated the accuracy of the Urban Tribe program. The system guesses correctly 48 percent of the time.
What We're Following See More »
President Obama became a surprise topic of contention toward the end of the Democratic debate, as Hillary Clinton reminded viewers that Sanders had challenged the progressive bona fides of President Obama in 2011 and suggested that someone might challenge him from the left. “The kind of criticism that we’ve heard from Senator Sanders about our president I expect from Republicans, I do not expect from someone running for the Democratic nomination to succeed President Obama,” she said. “Madame Secretary, that is a low blow,” replied Sanders, before getting in another dig during his closing statement: “One of us ran against Barack Obama. I was not that candidate.”
It’s all about the 1% and Wall Street versus everyone else for Bernie Sanders—even when he’s talking about race relations. Like Hillary Clinton, he needs to appeal to African-American and Hispanic voters in coming states, but he insists on doing so through his lens of class warfare. When he got a question from the moderators about the plight of black America, he noted that during the great recession, African Americans “lost half their wealth,” and “instead of tax breaks for billionaires,” a Sanders presidency would deliver jobs for kids. On the very next question, he downplayed the role of race in inequality, saying, “It’s a racial issue, but it’s also a general economic issue.”
It’s been said in just about every news story since New Hampshire: the primaries are headed to states where Hillary Clinton will do well among minority voters. Leaving nothing to chance, she underscored that point in her opening statement in the Milwaukee debate tonight, saying more needs to be done to help “African Americans who face discrimination in the job market” and immigrant families. She also made an explicit reference to “equal pay for women’s work.” Those boxes she’s checking are no coincidence: if she wins women, blacks and Hispanics, she wins the nomination.
Under pressure from a judge, the State Department will release about 550 of Hillary Clinton’s emails—“roughly 14 percent of the 3,700 remaining Clinton emails—on Saturday, in the middle of the Presidents Day holiday weekend.” All of the emails were supposed to have been released last month. Related: State subpoenaed the Clinton Foundation last year, which brings the total number of current Clinton investigations to four, says the Daily Caller.