infoTECH Feature

March 16, 2009

Greenplum Releases SG Streaming Technology for Large-Scale Data Warehousing

By Rajani Baburajan
Greenplum, a provider of database software for data warehousing and analytics, has announced the launch of MPP Scatter/Gather Streaming (SG Streaming), a new technology that reportedly accelerates data loading for companies with exponential data growth.
 
SG Streaming, according to Greenplum, enables ‘lightning-fast’ flow of data into the Greenplum Database for large-scale analytics and data warehousing.
 
With SG Streaming, Greenplum customers can achieve production loading speeds of over four terabytes per hour with negligible impact on concurrent database operations, officials said.
 
Greenplum adopts a ‘parallel-everywhere’ approach to loading as opposed to the ‘bulk loading’ approach adopted by traditional technologies. Traditional technologies push data from a single source, often over a single or small number of parallel channels, and result in fundamental bottlenecks and ever-increasing load times.
 
In Greenplum’s ‘parallel-everywhere’ model, data flows from one or more source systems to every node of the database without any sequential choke points. It avoids the need for a ‘loader’ of servers required in the traditional MPP appliances. This feature of Greenplum’s technology helps reduce complexity and cost, the company said.
 
The Greenplum Database is used by popular companies like LindedIn, Fox Interactive Media and O'Reilly Media.
 
“The loading capabilities of this database are remarkable,” said Brian Dolan (News - Alert), director of Research Analytics at Fox Interactive Media. “We're loading at rates of four terabytes an hour, consistently.”
Another client, Bakrie Telecom, is using the Greenplum Database to directly integrate operational data from many sources including those external to the database but with the ease of use of tables inside the database.
“Companies facing growing data volumes need to be able to maintain or shrink their loading windows so they can feed rapid streams of real-time data into the database and query them with low latency,” said Luke Lonergan, CTO, Greenplum.
 
“Greenplum's SG Streaming was designed to meet the needs of these companies,” Lonergan said. “Given the data loading speeds our customers are reporting using this new technology in real-world, production environments, we believe that Greenplum now offers the fastest data loading technology in the industry.”
 

Rajani Baburajan is a contributing editor for TMCnet. To read more of Rajani's articles, please visit her columnist page.

Edited by Stefania Viscusi
FOLLOW US

Subscribe to InfoTECH Spotlight eNews

InfoTECH Spotlight eNews delivers the latest news impacting technology in the IT industry each week. Sign up to receive FREE breaking news today!
FREE eNewsletter

infoTECH Whitepapers