International   

A world of data: it's time to learn your exabytes and zettabytes

Technology researchers do some calculations

BOSTON: A study that estimates how much digital information the world is generating finds that for the first time there is not enough storage space to hold it all. Good thing we delete some stuff.

The report, assembled by the technology research firm IDC, sought to account for all the ones and zeros that make up photos, videos, e-mails, Web pages, instant messages, phone calls and other digital content zipping around. The researchers assumed that on average, each digital file gets replicated three times.

Add it all up and IDC determined that the world generated 161 billion gigabytes — 161 exabytes — of digital information last year. That is like 12 stacks of books that each reach from the earth to the sun. Or you might think of it as three million times the information in all the books ever written. You will need more than two billion of the most capacious iPods on the market to get 161 exabytes.

The previous best estimate came from researchers at the University of California, Berkeley, who in 2003 totalled the globe's information production at 5 exabytes. But that report followed a different trail. It included non-electronic information, such as analogue radio broadcasts or printed office memos, and tallied how much space that would consume if digitised. And it counted only original data, not all the times things got copied.

In comparison, the IDC numbers were made much higher as they included content as it was created and as it was reproduced — for example, as a digital TV file was made and every time it landed on a screen. If IDC tracked only original data, its result would have been 40 exabytes.

Still, even the 2003 figure of 5 exabytes is enormous. For one thing, said an IDC analyst , it is important to understand the effects of the factors behind the information explosion — such as the profusion of surveillance cameras and regulatory rules for corporate data retention.

In fact, the supply of data technically outstrips the supply of places to put it.

IDC estimates that the world had 185 exabytes of storage available last year and will have 601 exabytes in 2010. But the amount of stuff generated is expected to jump from 161 exabytes last year to 988 exabytes (closing in on 1 zettabyte) in 2010.

Fortunately, storage space is not actually scarce and continues to get cheaper. That is because not everything gets warehoused. Not only do e-mails get deleted, but some digital signals are not made to linger, like the contents of phone calls.

But even if the IDC findings do not raise the prospect that disk drives will be virtually bursting at the seams, the study has intriguing implications. Among them: We will need better technologies to help secure, parse, find and recover usable material in this universe of data.

Chuck Hollis, a vice-president at EMC, the data-management company that sponsored the IDC research and the earlier Berkeley studies, said the new report made him wonder whether enough is being done to save the digital data for posterity.

"Someone has to make a decision about what to store and what not to," he said. "How do we preserve our heritage? Who's responsible for keeping all of this stuff around so our kids can look at it, so historians can look at it? It's not clear." — AP

Printer friendly page  
Send this article to Friends by E-Mail

Stories in this Section

70 die in Sumatra quakes
Over 100 Shia pilgrims killed in suicide bombings
China for talks on Iran
JVP plea on ceasefire turned down
Argentina's questions answered
The best and the worst
A world of data: it's time to learn your exabytes and zettabytes
Journalist found dead
Chen under media fire
Intentional crash?
Canada may release classified documents

Copyright © 2007, The Hindu. Republication or redissemination of the contents of this screen are expressly prohibited without the written consent of The Hindu