• June 2013
    M T W T F S S
    « May   Jul »
  • Advertisements

Hip-Hip-Hadoop: Data Mining for Science

Texas Advanced Computing Center (05/24/13) Aaron Dubrow

In 2010, the Texas Advanced Computing Center (TACC) at the University of Texas at Austin began experimenting with Hadoop to test the technology’s applicability for scientific problems. TACC researchers won a Longhorn Innovation for Technology Fund (LIFT) grant to build a Hadoop-optimized cluster on Longhorn. “The LIFT grant let us add local drives and storage to enable researchers to do experimental Hadoop-style studies on a current production system,” says TACC’s Weijia Xu. The system enables researchers to run 48 eight-processor nodes on TACC’s Longhorn cluster for Hadoop in a coordinated way with accompanying large-memory processors. Intel also has been working with TACC to assess the impact of new hardware the company has developed on the performance of Hadoop applications. For example, researchers at Intel and TACC recently described experiments using Intel’s 10GBASE-T network adapters on Hadoop. Xu currently is applying data-mining and machine-learning techniques to study health communication. “While connecting users to those whom they may never be able to connect to otherwise, online communities present a new information environment that does not operate under the old publishing paradigm,” says University of Texas researcher Yan Zhang. “This creates new challenges for users to access and evaluate information.”



Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: