We invite you to join a new experiment we cooked up at Yahoo! Labs called Predictalot, a game that takes NCAA tournament pick ‘em to entirely new extremes.

Here’s how it works. You can invest virtual points on almost any prediction you can think of about the men’s college basketball tournament, like “Duke will advance further than Texas,” or “Every final four team’s name will start with the letter U.” For example, you can invest one point predicting that “there will be exactly 2 upsets in the Elite Eight” and, according to the current Predictalot odds, you’ll win ten points if you’re right.

You can keep your predictions and see how they turn out, or you can sell them at any time, even while you’re following the action on the court. How does that work? Think of your predictions like stocks that can be priced, sold and traded (for virtual points, of course) just like you’d buy and sell stocks, options and futures on the financial exchanges of the world. Predictalot offers hundreds of millions of such predictions, constantly computing prices for them all.

Throughout the tournament, the prices of all the predictions in the system will go up and down based on what’s actually happening in the tournament and on what everyone else thinks those predictions are worth. Based on the value of the predictions you invest in you’ll accumulate points and climb your way to the top of the Predictalot leader board.

In technical terms, Predictalot is what is called a combinatorial prediction market. Some of us at Yahoo! Labs, along with academics like George Mason University professor Robin Hanson, have been studying and writing about them for quite some time, and dreaming about trying them out in the real world. We built the first version of Predictalot during an internal Yahoo! Hack Day. And this year we used the Yahoo! Application Platform to finally build a public version of the game. Like any Yahoo! App, you can install Predictalot to play right on the Yahoo! homepage. (Note that we’re not special in that regard: anyone can develop a Yahoo! App that’s available to millions of Yahoo! users — there’s good sample code, it supports YUI and OpenSocial, and it’s easy to get started. Seriously, try it.)

After some fits and starts, a few late nights, and eventually a few all nighters, we’re proud and excited to go live with Predictalot, version 1.0. I can’t rave enough about the talent and dedication of the research engineers who gave the game a professional look and feel and some real production speed. They turned a very pie-in-the-sky idea into a reality. We have a lot feature ideas in mind for future versions, but the core is in place and we hope you enjoy the game.

With 9.2 quintillion outcomes, or nearly as many as the number of individual insects on Earth, Predictalot is to our knowledge the largest prediction market ever built. We hope that with your participation it will prove a great test to the limits of what the wisdom of crowds can produce.  We’d also like to pave the way for the serious use of combinatorial prediction market technology in a host of other arenas down the road.

Smarter markets will be extremely valuable in a variety of applications, especially online, where markets and exchanges decide prices and allocations for all kinds of goods and services, including advertising inventory. And more and more, the matching of buyers with sellers – which is the core function of any market – is requiring sophisticated algorithms, machine learning and optimization technology. Predictalot attempts to help us better understand these dynamics while also giving us the great satisfaction of picking Duke to go all the way.

(Duke alum) David Pennock and the Predictalot Team:
Mani Abrol, Janet George, Tom Gulik, Mridul Muralidharan, Sudar Muthu, Navneet Nair, Abe Othman, Daniel Reeves, Pras Sarkar

P.S. If you’d like to learn more about the technology hidden in the engine and the scientific factors at play, read our post about Predictalot on the Yahoo! Research website. And don’t forget to also check out all of Yahoo!’s fun tourney experiences.

The Invisible Hand of Machine Learning

Key Scientific Challenges, Entry #6: Machine Learning

On January 27, we announced the kick-off of our 2010 Key Scientific Challenges Program.  To highlight the scientific challenge areas included in the program, we launched a series of guest blog posts on Yodel Anecdotal. Our most recent post covered Web Information Management.

Another big challenge our Yahoo! research scientists are continually examining is machine learning. In this entry, John Langford from Yahoo! Labs shares some thoughts on how Yahoo! is driving research into machine learning and why it’s a fascinating field.

When I wake up in the morning, I can’t resist checking my email and browsing the Internet to see if anything has come up. Then I get to work thinking, writing, searching, finding, and learning various things, all using an Internet that’s powered by machine learning in dozens of ways. When I go to sleep at night, I smile because I know that in addition to using machine learning throughout my day, I’ve also done my part to advance machine learning technology, many others have done likewise, and that by doing so we’re making a major impact on people’s lives.

Even though machine learning has such a broad influence on the Internet, it can be quite difficult to recognize. This is primarily because machine learning’s benefits are often hidden — they are the spam emails you don’t see, the uninteresting news articles you don’t see, and the irrelevant search results you don’t see, just to name a few. In this sense, machine learning is like an invisible hand. It’s also sometimes easier to recognize the flaws in a machine learning system – like “Why did my email end up in my friend’s spam folder?” – than it is to notice its benefits. But despite these quirks, machine learning is one of the best technologies we have for solving some of the biggest problems on the Web.

The problem of spam is representative of why machine learning is so effective. Spammers are constantly changing and adapting their strategies and technology to evade even the most capable filters. Machine learning attacks this problem by aiming to build an automatic system able to stay ahead of the game and continually refine itself in response to its environment. We haven’t completely achieved that goal yet, but progress is steady. Machine learning systems can always get better, learn more, work faster and in ever more ways, because people will always want less spam and more interesting and relevant news articles.
Naturally, this reality means we’re constantly running into both the empirical and theoretical boundaries of machine learning and statistics. How do I learn from so much data that we can’t fit it on a machine? How do we extract evidence of what the best decision was? What if the best decision changes? How do I minimize the need to know the best decision? How do I effectively use the incredibly large quantities of information available on the Internet? And how do I fit it all together in an automatic way that is useful to someone? And how do you know it’s useful?

Good answers to these questions can improve the life of just about everyone, which is the core reason why Yahoo! is sponsoring the Key Scientific Challenges Program. If you are a graduate student working on these questions, you understand how exciting and challenging this field is. And if you aren’t, consider the satisfaction associated with changing fields. :-)

John Langford

Yahoo! Labs

This week at the University of Washington we are thrilled to be kicking off the second half of the 2009-2010 Hack U™ season. The University of Washington hack will be followed by events at Georgia Tech, UT Austin and UC San Diego throughout March and April.

During each of these hack events, Yahoo! developers teach passionate CS, HCI and engineering students about the latest and greatest open tools and technologies and web programming tips in a series of tech talks, then spend 24 hours with them to help them build their dream hack for the competition held at the end of the week. In true Yahoo! style, the all night contest is filled with fun, free food, schwag, prizes, Wii games and plenty of caffeine!

At the end of the season, the winners from each university will be flown by Yahoo! to our University Hack Showdown, which is normally held in conjunction with Yahoo!’s Open Hack Day, where they will hack it out for street cred, cool prizes and the opportunity to get their hack noticed by web industry judges, including VCs, web entrepreneurs, Yahoo! execs and technology gurus.

“The close of 2009 marked the third year of the Hack U™ program and it’s been amazing to watch the innovation, spirit and quality of the hacks continue to grow, said Jamie Lockwood, program manager for Hack U™. “The students used to just mash up as many open technologies as they could barely thinking about UI or what problem the hack solves, but today we see ideas and prototypes coming together that are more and more sophisticated and in some cases almost ready to go to market.”

The winning Hack U™ students from last season had no problem holding their own against the experienced developers that showed up at the Yahoo! Open Hack event in NYC, winning half of the categories including best overall hack.

The program has definitely caught the attention of Yahoo!’s internal open tech leaders, as well as the external web community. The Hack U™ winners from Toronto even snagged an interview at Y Combinator with their hack idea.

You can read more about the program and view some of the other hacks that have been developed at universities across the country and the world (we had our first India Hack U event at IIT earlier this year!) on the Yahoo! Developer Network site.

Hack U events have been held at some of the best engineering universities around the country including UC Berkeley, Stanford, Georgia Tech, Carnegie Mellon, University of Washington and University of Illinois and we’re always on the lookout for other universities that want to be part of the growing Hack U community We also want to keep the technology topics fresh, timely and up to speed with the latest web industry innovations so feel free to send us requests for specific speakers or ideas for suggested topics.

Check out the website for more information, updates and details about the upcoming 2010 schedule.

– Yahoo! Academic Relations and Hack U™ Team

Measuring the Unmeasurable

Key Scientific Challenges, Entry #3: Microeconomics and Social Systems

On January 27 we announced the kick-off of our 2010 Key Scientific Challenges Program.  To highlight the scientific challenge areas included in the program, we launched a series of guest blog posts earlier this month on Yodel Anecdotal. Read our previous post on privacy and security, “Data, Data Everywhere, but How to Keep it Safe.”

Another big challenge are Yahoo!’s research scientists are continually examining is microeconomics and social systems. In this entry, Sharad Goel from Yahoo! Labs shares some thoughts on how Yahoo! is tackling the new opportunities for research into the social sciences that the Web is making possible and why it’s a fascinating field.

What do your friends really know about you? How much do they influence your decisions? How often do we stray from the cultural herd? How do groups organize to solve complex problems?

Answers to such fundamental questions about social behavior have often eluded us. With microscopes we peered into the intangibly small building blocks of life, and with telescopes we found our place in an unimaginably expansive universe. But without the tools to faithfully document human activity—a challenge that by comparison seems so palpable—we had no way to investigate the inner workings of our own communities. Now with an explosion of information on every aspect of our everyday existence—from what we buy, to where we travel, to whom we know—we can measure what until quite recently was thought unmeasurable. In the Microeconomics and Social Systems Group at Yahoo! Labs, we are using this proliferation of data to explore how societies function. It’s a fascinating area of study that is just beginning to shed light on new layers of human behavior, making it a perfect fit for the Key Scientific Challenges Program.

In a recent study that’s garnered some attention, for example, we asked, “How eccentric are people?” Looking at consumer preferences across movies, music, and web browsing, we came to the surprising conclusion that ordinary people have pretty extraordinary tastes. In particular, we found that typical Netflix and Yahoo! Music users regularly watch movies and listen to songs that are not even available in the largest brick-and-mortar retailers. This result not only challenges stereotypes about people blindly following the herd, but also highlights the importance of offering consumers broad selection. That is, specialty products may dramatically boost user satisfaction by providing buyers the convenience of “one-stop shopping” for both their mainstream and niche interests.

In other work, we used web search queries to forecast the commercial success of movies, songs, and video games. Weeks, sometime even months, before a movie opens or a video game is released, one can find traces of pent up consumer demand in the search query logs. We found that these telltale signs of early interest are remarkably good predictors of future success. The catch? Although the search logs do reflect user intent, more mundane indicators, such as production budgets and reviewer ratings, perform equally well at forecasting sales. Thus, the benefit of web search as a prediction tool may have less to do with its superiority over other methods than with its generality, low cost, and real-time nature.

At a time when we are drowning in data, at Yahoo! Labs we’re asking a simple question: what can you do with it? The answer is limited only by our imaginations.

On Wednesday we announced the kick off our 2010 Key Scientific Challenges Program. It is a thought-provoking competition that encourages top graduate students to help invent the future of the Internet by working with Yahoo! Labs to investigate and test their ideas in the real world.
 
The Key Scientific Challenges Program focuses on a variety of scientific issues that we believe are central to developing a better understanding of the Web and the foundational technologies that will accelerate innovation. Over the next couple of months, we’ll be offering a series of guest blog posts here on Yodel Anecdotal that offer a quick overview of these scientific challenge areas from a Yahoo! (or Yahoo!s) who have expertise in the field and can explain how their research can have an impact on making the Web more engaging, relevant and powerful.
 
Today’s our maiden voyage, and the first guest blog post comes from Scott Noteboom. Scott is one of the foremost experts on building data centers that makes it possible for Yahoo! to run some of the fastest, most popular Web sites in the world.  He’s also leading the charge to make Yahoo!’s data centers as efficient as possible, and we’ve asked him to talk about a new challenge area we just added to the Key Scientific Challenges Program this year, green computing.
 
Thanks,
The Key Scientific Challenges Team at Yahoo! Labs
 
Key Scientific Challenges, Entry #1: Green Computing
By Scott Noteboom
 
Increasing demand for the Web services and applications that have become such a central part of our lives (like email and Web video, just to name a few) is also causing a steady rise in the need for more and more computing power to make all of theses services work and work well.  When we talk about computing power, we’re often talking specifically about data centers, buildings that house thousands and thousands of servers working 24-hours-a-day to make sure that the Web sites you want are there on your screen and on your phone when you want them.
 
Of course, while the performance of servers is improving almost everyday, making all kinds of new innovations possible, they also require a lot of power. They need so much power that a 2007 joint report by the Environmental Protection Agency and the Lawrence Berkeley National Laboratory revealed that energy consumption from data centers had doubled between 2000 and 2006 and was expected to double again by 2011. The report further calculated that there would be huge energy and money losses without increases in the efficiency of running and cooling these centers (because servers produce a lot of heat).
 
Recognizing both the problem and the opportunity that this presents, Yahoo! has embraced its role as a leading environmentally sustainable company by addressing efficiency in our data centers head on.  We announced in June 2009 that we’d be committing to a significant reduction in the carbon intensity of our data centers by 2014. And to accomplish this goal, we’ve developed several innovations, including a new high-efficiency data center design that reduces our cooling load and increases utilization in our data centers, increasing the productivity of our servers, and squeezing as much productivity as possible out of every last kilowatt-hour. These efforts have gotten us some recognition and hopefully will inspire more innovation because making the world’s data centers more efficient is also an important element to tackling global warming.
 
Everyone wants to see innovation on the Web and what it makes possible for us in our everyday lives continue to flourish, and that’s where innovation behind the scenes in data centers is so important. By making data centers more efficient, we can make sure that future innovations that make the Internet more and more powerful for all of us will also be environmentally sustainable.  
 
This is by no means a pipe dream, which is why we’re so excited to be part of the Key Scientific Challenges team recruiting some of the best young minds in the world to learn from our experiences and accelerate their own research and ideas. A study by The Climate Group entitled Smart 2020 predicts that, while greenhouse gas emissions from the Internet industry will rise to approximately 1.3 gigatons of CO2, the combined impact of smart grid, smart logistics, smart buildings and videoconferencing could reduce emissions by approximately 7.8 tons.
 
We’re very excited about the next big ideas that will continue to bring radical improvements in energy efficiency and truly green computing. If you’re interested in learning more about the Key Scientific Challenges Program visit the site, and if you’ve got an idea for research into green computing, get working on a proposal. Submissions are due March 5th.

Over the years, Yahoo! Labs has partnered closely with many universities and colleges. As a company, we want to invent the sciences needed for the next-generation Internet. Working with the faculty, researchers, and students of the world’s great universities is one of the best ways to meet that goal.

Looking back, 2009 was our most successful year to date. Through a variety of programs, we brought together a lot of smart folks and important ideas. As we head into 2010, we want to share our excitement about these programs and events.

Hack U:
Our University Hack Day competitions (Hack U) brought Yahoo!’s open technology, top developers, and hack spirit to campuses for technical talks and a 24-hour student programming competition. Students from 11 universities in the U.S., Canada, and India built more than 300 hacks. Winners from each campus participated in the New York Open Hack Day, ultimately winning 6 of the 11 categories.

Yahoo! Big Thinkers Series:
As part of our Big Thinkers distinguished speaker series, Yahoo! brought the brightest minds in the academic community to our campus for talks, and we’ve made those lectures available on the Web for all to see and enjoy. We had talks on
 

• Global climate change with Kenneth Arrow, Nobel Laureate and Professor Emeritus of Economics at Stanford University
• The psychology of the Web with Sandy Pentland, MIT
• Getting around the “you don’t know what you don’t know” syndrome with Ion Stoica, University of California, Berkeley
• How computational thinking can transform education with Jeannette Wing of the National Science Foundation
• Calculating the largest prime number ever found with Ron Graham, University of California, San Diego
• How the Internet and the science of computing are on the verge of driving a revolution in medical and biological science with Leroy Hood, Institute of Systems Biology

 
Next year’s Big Thinkers series should be just as captivating — we’ve got a great lineup for 2010.

Webscope:
Our Webscope™ program offers a reference library of 24 interesting and scientifically useful datasets we’ve made available for noncommercial use by academics and other scientists. More than 880 academic researchers have used the datasets, resulting in 28 technical papers, journal articles and theses so far. Very few companies have the resources and global scale to help academics and students interact with the types of real-world datasets it takes to spark innovation, but Yahoo! is one of them and it’s really paid off.

Key Scientific Challenges (KSC):
Our Key Scientific Challenges program partnered with 21 graduate students in 2009. We gave them scholarships, plus the opportunity to work closely with Yahoo!’s scientists on solving some of the biggest challenges the Web offers. The winners attended the KSC Graduate Student Summit, where they presented the fruits of their labor to fellow students and other Yahoo! researchers. It was the first of what will surely be many peer-reviewed conferences for these talented folks.

Cloud Computing Research:
Our M45 Cloud Computing Cluster is a 4,000-processor testbed being used in academia for the advancement of cloud computing research and education. Faculty members at Carnegie Mellon University have written 40 technical publications based on research performed on M45, and the cluster is now being used by three additional universities. Yahoo! is also part of both the Open Cirrus testbed and the Open Cloud Consortium.

Global Impact – Yahoo! Days in Haifa:
In November we held two very successful “Yahoo! Days” at major Israeli universities – Tel Aviv University and Technion, the Israel Institute of Technology. Yahoo! scientists from around the world joined the event, which featured a keynote by Prabhakar Raghavan, the head of Yahoo! Labs. Pictures from the Tel Aviv and Technion events are available on Flickr.

Netflix Prize-winner Yehuda Koren’s Campus Tour:
Yehuda Koren, a research scientist with Yahoo! Labs in Israel, was part of a team that spanned countries, time zones, and companies, collaborating over a three-year period to win the Netflix Prize, one of the most well-publicized and interesting machine learning contests ever conceived. It’s a story with surprises, twists and turns, game-playing, late nights, and computational brute force. There’s also deep science behind it all — science that will drive future innovation on the Web. Naturally, Yahoo! thought it was the kind of story that students and faculty at some of the world’s best universities would like to hear in person. Yehuda has visited seven universities since the award was announced in September 2009, including MIT, Harvard, Carnegie Mellon, Columbia, Rutgers, Princeton, Penn, and GA Tech. And he’ll be back at in 2010.

Purple Footprints:
And, of course, we continued to sponsor our campus seminar series, leaving “purple footprints” at Carnegie Mellon University, MIT, and University of Illinois at Urbana-Champaign. All of those seminars have been recorded and are available online. Yahoos also presented more than 100 lectures, seminars, workshops and training sessions at campuses worldwide.

If you want to learn more about Yahoo! Academic Relations programs and how you can participate in 2010, please visit us.

Ron Brachman
Vice President
Yahoo! Labs

It has been a stellar year at Yahoo! Labs, and before 2010 arrives, we want to share an overview of the great science that our colleagues have published in 2009. The Internet is changing as rapidly as ever – from what’s possible technologically to how people are interacting with technology and each other, and it’s part of Yahoo! Labs’ mission to help Yahoo! and the world understand that evolution. On that front, we made major progress during these past 12 months, and were thrilled that our work was recognized with seven Best Paper awards at top conferences in our industry, including:

• “Integration of News Content Into Web Results” by Fernando Diaz at Second ACM International Conference on Web Search and Data Mining (WSDM)
• The work Yehuda Koren described in his paper, “Collaborative Filtering with Temporal Dynamics,” was a crucial contribution to his team. It won the Netflix prize well as the Best Paper award at the 15^th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
• “Sources of Evidence for Vertical Selection,” by Jaime Arguello (a Yahoo! intern from Carnegie Mellon University), Fernando Diaz (Yahoo! Labs), Jamie Callan (Carnegie Mellon University), and Jean-Francois Crespo (Yahoo! Labs) at the 32^nd Annual ACM SIGIR Conference (SIGIR)
• “Generating Example Data for Dataflow Programs,” by Chris Olston, Shubham Chopra, and Utkarsh Srivastava at ACM SIGMOD/PODS Conference (SIGMOD)
• “From ‘dango’ to ‘japanese cakes’: Query Reformulation Models and Patterns,” by Francesco Bonchi and Carlos Castillo at the 2009 IEEE/WIC/ACM International Conference on Web Intelligence
• “On the Feasibility of Multi-Site Web Search Engines,” by Ricardo Baeza-Yates, Aris Gionis, Flavio Junqueira, Vassilis Plachouras, and Luca Telloli at the 18th ACM Conference on Information and Knowledge Management (CIKM)
• “Explore/Exploit Schemes for Web Content Optimization,” by Deepak Agarwal, Bee-Chung Chen and Pradheep Elango at IEEE International Conference on Data Mining (ICDM)

 
Yahoo! Labs also led the technical program at WSDM, ending up with a quarter of the total accepted papers at the event. And at the 18^th International World Wide Web Conference (WWW) in April 2009, Yahoo! Labs secured the most accepted papers from a single organization. Two of those papers — “Visual Diversification of Image Search Results,” by Reinier H. van Leuken (Universiteit Utrecht), Lluis Garcia (Yahoo! Labs), Ximena Olivares (Unversitat Pompeu Fabra), and Roelof van Zwol (Yahoo! Labs); and “Social Search in ‘Small-World’ Experiments,” by Sharad Goel, Roby Muhamad (Columbia University), and Duncan Watts — were nominated for the conference’s Best Paper award.

In addition, at SIGMOD, Bee-Chung Chen and Ashwin Machanavajjhala also earned Best Dissertation runner-up awards for their work on “Cube-Space Data Mining” and “Defining and Enforcing Privacy in Data Sharing,” respectively. 

Finally, wrapping up the year at CIKM, Yahoo! Labs topped 2008’s accomplishments and, in addition to the Best Paper award, received awards for Best Student Paper and runner-up Student Paper, and earned a record of 30 accepted papers. The awards for Best Student Paper and runner-up Student Paper went to Michalis Potamias, Francesco Bonchi, Carlos Castillo, and Aris Gionis for “Fast Shortest Path Distance Estimation in Large Networks;” and Matthijs van Leeuwen, Francesco Bonchi, Arno Siebes, and Borkur Sigurbjornsson for “Compressing Tags to Find Interesting Media Groups.” 

Though the year isn’t quite over yet, we at Yahoo! Labs are proud of our colleagues’ accomplishments, and we’re gearing up for what lies ahead in 2010. 

Prabhakar Raghavan
Head of Yahoo! Labs

If you’ve seen “The Godfather,” chances are you might like other Marlon Brando movies. Or films about gangsters. Or those directed by Francis Ford Coppola. But will you like “Napoleon Dynamite”?

This is the central problem posed by the Netflix Prize. Netflix is offering $1 million in prize money to anyone who can substantially improve (by more than 10 percent) the accuracy of its movie recommendation engine. While Netflix suggests movies based on your ratings history, the company isn’t satisfied with how well it can predict what you’ll like.

At Yahoo! Labs, this is just the kind of crazy difficult problem we love to take on. For scientists, it’s a pure challenge, requiring deep study and experimentation across a variety of fields, such as machine learning and data mining.

And for Yahoo! as a whole, these types of scientific problems also happen to be a critical element of what we most want to succeed at: connecting you with the content and information you most want in your life – even if you don’t know it yet.

That’s why we couldn’t be happier to pass along the news that Yehuda Koren, one of our scientists at Yahoo!’s Israel Lab, is part of the first qualifying team for the Netflix Prize.

Yehuda’s team, BellKor’s Pragmatic Chaos, reached first place on the Netflix Prize leaderboard on June 26, with an improvement of 10.05 percent. Achieving a more than ten percent improvement in the quality of movie recommendations is no drop in the bucket. It took Yehuda and his teammates three years to achieve and no other team has matched it yet.

Congratulations to Yehuda and his team. In the past few weeks alone, in addition to the Netflix Prize, Yehuda and his colleagues also received best paper prizes at two of the most important scientific conferences (ACM SIGMOD and ACM SIGKDD) for computer science and the Internet. Yahoo! researchers Christopher Olston, Shubham Chopra, Utkarsh Srivastava, Ashwin Machanavajjhala and Bee-Chung Chen, were also recognized for contributions to the science of how to better query and mine data, which will ultimately make it easier for you to get things done on the Web and beyond.

We may not yet have solved every problem the Internet has thrown our way, but at the very least, you should start feeling a lot more confident about those movies in your Netflix queue.

Prabhakar Raghavan
Head of Yahoo! Labs

Tired of being inundated with the contradictory and offensive beliefs of others? Today, the scientists at Yahoo! are releasing a groundbreaking new search filter that keeps controversy out of your search experience. I’m extremely pleased to announce the immediate availability of Ideological Search, which allows you to control the ideology of your search results.

Our research found that web searchers are regularly affronted by articles, blogs, facts, and pages that contain perspectives directly contradicting their own personal beliefs and values –- whether political, religious, economic, scientific, philosophical, etc. If consumers have the freedom in whether they navigate to the HuffingtonPost.com or FOXNews.com, why not extend that same choice to search? Until today, no other search engine could provide this level of personalization –- ensuring that consumers can search with the utmost confidence, knowing that they won’t be antagonized by their results.

Ideological Search, built on Yahoo! BOSS, is the result of extensive research conducted by virtually every scientist at Yahoo!. The team applied the latest research from the fields of sentiment analysis, intent detection, eye tracking, clustering and empathic reasoning to create this revolutionary service. We also found that adaptations were required within existing technologies to ensure ideologically-biased results. For example, Pig, the large-scale data processing environment, was not compatible with all beliefs, particularly among vegetarians. As a result we developed a sister codebase called Tofu, which proved to be more flexible and gelatinous, albeit less optimized.

To give Ideological Search a test drive, type in “global warming” or “stimulus package” and see for yourself. For more background on how we developed Ideological Search, visit the Yahoo! Labs site.

We hope this is the start of a more peaceful, conflict-free Yahoo! Search experience for you.

Try Ideological Search today!

Prabhakar Raghavan
Head of Yahoo! Labs