A programming model from Google for processing huge data sets on large clusters of servers. It includes distribution, parallelizing and fault tolerant functions. Google uses MapReduce to set up its Web indexes. See Google and Hadoop.
 | Reproduced with permission from Computer Desktop Encyclopedia. Copyright (c) 1981-2009 The Computer Language Company Inc. All rights reserved. |
Additional Resources
- Yahoo pays its 'technical debt' with IT overhaul
- Yahoo had a lot of "technical debt"---systems that most companies would call legacy infrastructure---and has it just about paid off. Sam Pullara, chief technologist at Yahoo, walked developers through its infrastructure changes over the last three years. The talk could have come from any enterprise that finds...
- Blog posts 2009-10-09
- Aster nCluster In-Database MapReduce: Deriving Deep Insights from Large Datasets
- A lack of expressive techniques to transform and analyze massive data volumes in organizations has led to costly workarounds in data warehousing. One of the first to face the challenge of analyzing petabyte scale data, Google pioneered a software framework called MapReduce for high speed processing of large amounts of...
- White papers 2009-10-02
- Microsoft releases Dryad concurrent-programming code to academics
- It's been two years since Microsoft Chairman Bill Gates talked up Dryad, Microsoft's concurrent-programming competitor to Google's MapReduce and Apache Hadoop. But this week, Dryad was back on the radar screen, with Microsoft's release of the Dryad code to academics and researchers. by Mary Jo Foley
- Blog posts 2009-07-17
- MapScale: A Cloud Environment for Scientific Computing
- Parallel programming languages have sought out many different means by which many numbers of cores can be utilized for a common goal. Programming languages such as MPI provide a low-level, message passing system, while others such as UPC provide a high-level, shared memory model. Both of these languages and many...
- White papers 2009-06-12
- Oracle Office, MySQL, and other dreams
- Oracle Office, MySQL, and other dreamsIt also allows Oracle to take baby steps towards the world where databases become a commodity. They will be already are moving up the chain to applications.In the transition, Oracle will have the number one commodity database with the best monetization strategy, and be able...
- Discussion threads 2009-05-02
- Multi-Dimensional Characterization of Temporal Data Mining on Graphics Processors
- Through the algorithmic design patterns of data parallelism and task parallelism, the Graphics Processing Unit GPU offers the potential to vastly accelerate discovery and innovation across a multitude of disciplines. For example, the exponential growth in data volume now presents an obstacle for high-throughput data mining in fields such as...
- White papers 2009-05-01
- On Availability of Intermediate Data in Cloud Computations
- This paper takes a renewed look at the problem of managing intermediate data that is generated during dataflow computations (e.g., MapReduce, Pig, Dryad, etc.) within clouds. It discusses salient features of the intermediate data and outline requirements for a solution. Its experiments show that existing local write remote read solutions,...
- White papers 2009-04-21
- Can Google build open source communities
- Can Google build open source communitiesMore contributions, as more devices are deliveredAs more companies start delivering Android devices to the market, there is likely to be a significant increase in contributions to Android outside of Google. These contributions would be changes that companies made, in the process of building their...
- Discussion threads 2009-04-10
- News to know: IBM-Sun; RIM, Web 2.0; CTIA; Facebook; iPhone
- Here are today’s notable headlines. You can get News To Know via email alert and RSS daily. For continuous updates see BNET’s around-the-Web tech coverage. Larry Dignan: IBM-Sun deal nears finish line; Antitrust worries just starting Sam Diaz: RIM delivers solid Q4 on BlackBerry...
- Blog posts 2009-04-03
- Amazon launches Hadoop data crunching service
- Amazon launches Hadoop data crunching serviceMaking MapReduce MainstreamHadoop is great for teams of developers to crunch data. However, the "tipping point" in bringing the value of MapReduce to companies is by providing enterprise-class database features such as security, tight SQL integration, and more. Aster Data offers nCluster on the Amazon...
- Discussion threads 2009-04-02
- Amazon's BI-on-the-fly using MapReduce-as-a-service brings huge cloud data crunching to the masses
- Amazon's BI-on-the-fly using MapReduce-as-a-service brings huge cloud data crunching to the massesExcellent postDana,Spot on! Thanks.David
- Discussion threads 2009-04-02
- Amazon's BI-on-the-fly using MapReduce-as-a-service brings huge cloud data crunching to the masses
- In essence, the service, Amazon Elastic MapReduce, if it works as advertised, abstracts the complexity and cost of massive parallel and symmetrical programming and processing so non-computer scientists -- you know, business types -- can examine and query huge data sets. by Dana Gardner
- Blog posts 2009-04-02
- Amazon launches Hadoop data crunching service
- Amazon on Thursday announced a new cloud computing service that uses Hadoop, a free software framework, to crunch tons of data. The service, called Amazon Elastic MapReduce, is designed for businesses, researchers and analysts trying to conduct data intensive number crunching statement. Hadoop, which is used by...
- Blog posts 2009-04-02
- Implementation Issues of a Cloud Computing Platform
- Cloud computing is Internet based system development in which large scalable computing resources are provided "As a service" over the Internet to users. The concept of cloud computing incorporates web infrastructure, Software as a Service SaaS, Web 2.0 and other emerging technologies, and has attracted more and more attention from...
- White papers 2009-03-19
- Greenplum aims to eliminate massive data load 'choke points' with Scatter/Gather technology
- Greenplum has taken massively parallel processing MPP of data to the next level with the introduction this week of its "MPP Scatter/Gather Streaming" SG Streaming technology, which manages the flow of data into all nodes of the database, eliminating the traditional bottlenecks with massive data loading. The...
- Blog posts 2009-03-18
- Could Cloudera become the open source Asia?
- Those of you old enough to remember the original Apple Macintosh may also remember the "super-group" known as Asia. The group became notorious for its ego battles, forming, breaking up, and reforming until it became something of a joke. (To the right is the present line-up for...
- Blog posts 2009-03-17
- PPoPP 2009 Day 1: Parallel Thinking
- PPoPP 2009 Day 1: Parallel ThinkingThanks for Covering ThisOne request, could you also give us some information regarding the papers' abstracts? After all, some of those papers may be demonstrating why a concept does not live up to its expectations. After the talk is concluded, will papers be available on...
- Discussion threads 2009-02-17
- LogLogic delivers integrated suite for securely managing enterprise-wide log data
- Companies faced with a tsunami of regulations and compliance requirements could soon find themselves drowning in a sea of log data from their IT systems. LogLogic, the log management provider, today threw these companies a lifeline with a suite of products that form an integrated solution for dealing with audits,...
- Blog posts 2009-02-17
- A technical look at how parallel processing brings vast new capabilities to large-scale BI and data analysis
- A technical look at how parallel processing brings vast new capabilities to large-scale BI and data analysisTighter SQL/MapReduce IntegrationGreat post/podcast - there is a definite trend in applying MapReduce to handle the data loads of today. One of the biggest challenges is elegant integration of SQL so that traditional industries...
- Discussion threads 2009-01-05
- A technical look at how parallel processing brings vast new capabilities to large-scale BI and data analysis
- The core problem we've solved is the ability for our engine to redistribute the data and the computation on the fly, as these queries and analysis are being performed. ... The combination of the software-switch interconnect, which Greenplum built into the Greenplum product, and the underlying use of commodity parallel...
- Blog posts 2009-01-05
Neighboring Terms
Premier Vendor Content Whitepapers, webcasts & resources from our Power Center Sponsors
- Microsoft Dynamics CRM Online - Free Six-Month Trial for Eligible Organizations
-
Microsoft Dynamics CRM Online provides fast online access, simple contact management and better sales performance for a low monthly cost - the best value on the market today.
- Learn more about the free, six-month trial offer>>
- Learn more about tools to grow your business
-
The Business Essentials Guide provides you useful tools and templates to help grow your business and save you time with automated shipping solutions.
- Save time with the UPS Business Essentials Guide
- The more you simplify, the more you save
-
When you transition from your existing Red Hat environment to SUSE Linux Enterprise from Novell, you can recognize dramatic cost savings, perhaps as much 50%
- Learn more >>
SmartPlanet
- Thought-provoking progressive ideas on diverse topics that intersect with technology, business, and life, and matter to the world at large. Visit SmartPlanet
- More from IBM
-
- How to Drive Better Business Outcomes with Exceptional Web Experiences Download the eBook
- Driving Business Agility through SOA Connectivity & Integration Read the White Paper from IBM
- Linking Decisions and Information for Organizational Performance Read the Tom Davenport study
