2004 Backup And Archive- A User's Perspective
Market Study

See Order Form at the bottom of this write-up

 A population of over one thousand IT sites involving ten major industries was surveyed and questioned on their Backup and Archive configurations, practices, objectives and plans.

This report provides statistics on practices, ranks issues and needs, indicates satisfaction ratings, and analyzes trends and plans.

The following parameters are analyzed by market revenue tier, and peculiarities pertaining to each of the major industries are highlighted

Objectives of The Report

Backup and archiving have been constrained for many years by technology and cost. The convergence of factors such as the rapid increase of the volume of data, the threat of disasters, the cost of downtime and the advances of technologies are all fueling a major shift in the way IT managers look at data protection.

Several other factors influenced the changes as well, and they steered our survey questions to attempt to answer each parameter. We all agree on one point, things are bound to change. The unknown is how fast and in what direction. Assessing this was our major goal when we initiated this study and survey

While these were the main objectives, we collected and analyzed several other statistics and demographics, such as storage growth and distribution, storage budget and staffing, distribution of operating systems, servers, and software and library vendors.

 

Survey Methodology

To qualify for the survey, the respondent had to know storage, have at least half a terabyte of total disk capacity, and have responsibility for backup, archive and/or disaster protection

· We developed a questionnaire in collaboration with a number of industry executives.
· We tested the questionnaire with ten IT managers, in one or several telephone interviews
· We asked several thousands IT managers a limited set of questions to determine if they qualified for the survey. 1071 responded
· Over 400 respondents qualified for the full survey. We selected 100 of them, with an attempt to have a relatively even distribution among the industries, as well as the disk capacity ranges
· We sent a detailed questionnaire of over 200 questions to the selected respondents
· We compiled and analyzed the results
· We also included comments resulting from the many contacts we have throughout the year with IT managers, independently of this structured survey

 

List of Figures

1- Site Profiles

Revenue and Employees

Figure 1-1. Screener Survey Company Annual Revenue

Figure 1-2. Screener Survey Company Annual Revenue

Figure 1-3. Full Survey Company Annual Revenue

Figure 1-4. Screening Survey Industry

Figure 1-5. Screening Survey Industry

Figure 1-6. Full Survey Industry

Figure 1-7. Correlation between Annual Revenue and # Employees

Figure 1-8. Correlation between Annual Revenue and SCSI/FC Drives

Figure 1-9. Correlation between Annual Revenue and ATA/SATA Drives

Figure 1-10. Tier 1 Employee Breakdown

Figure 1-11. Tier 2 Employee Breakdown

Figure 1-12. Tier 3 Employee Breakdown

Figure 1-13. Revenue Tier Characteristics

Figure 1-14. Breakdown of Revenue Tiers by Industry

Figure 1-15. Total Drive and Tape Numbers

Figure 1-16. How many Employees at Site

Figure 1-17. Exact Number of Employees at Site
Figure 1-18. Number of Employees Respondent Has Backup Responsibility For

 

Servers and Applications

Figure 1-19. Database Used

Figure 1-20. Most Critical Applications, in Order of Importance

Figure 1-21. Storage Used for Applications

Figure 1-22. Network Topologies Used

Figure 1-23. Exact Number of Data Centers Respondent has Backup Responsibility For

Figure 1-24. Number of Servers

Figure 1-25. Server Operating System Platforms

Figure 1-26. Do You have ESCON or FICON Requirements?

Figure 1-27. Number of Distributed Offices Respondent has IT Responsibility For

 

2- Storage Profiles

 

Capacity Trends

Figure 2-1. Total SCSI/FC Raw Disk Capacity

Figure 2-2. Total ATA/SATA Raw Disk Capacity

Figure 2-3. Total Disk Capacity for All Data Centers (Full Survey)

Figure 2-4. Growth Rate of Raw Disk Capacity During the Last 12 Months

Figure 2-5. Capacity Growth Plans (Petabytes)

Figure 2-6. Expected Growth in Capacity in the Next Year

 

SCSI/FC versus ATA/SATA Drive Utilization

Figure 2-7. Total SCSI/FC Disk Capacity vs. Company Revenue

Figure 2-8. Total ATA/SATA Disk Capacity vs. Company Revenue

Figure 2-9. Total Disk Capacity Used for (Primary Data, Backup/Snapshot, Backup Staging, Mirroring/Replication, and Archiving)

Figure 2-10. SCSI/FC Disk Storage Connected to (Mainframe Only, Open System Only, or Both)

Figure 2-11. SCSI/FC Disk Storage Connected to Open Systems by Revenue Tier

Figure 2-12. Storage Vendors for SCSI/FC Drive Systems

Figure 2-13. Storage Vendors for ATA/SATA Drive Systems

Figure 2-14. Disk Utilization Ratio

 

Tape and Optical Utilization

Figure 2-15. Total Nearline Tape Capacity Screening Survey

Figure 2-16. Total Tape Capacity for All Data Centers (Full Survey)

Figure 2-17. Total Nearline Tape Capacity vs. Company Revenue

Figure 2-18. Total Nearline Tape Capacity Used for (Primary Data, Backup/Snapshot, and Archive)

Figure 2-19. Nearline Tape Storage Used as (Primary Data, Backup, and Archive)

Figure 2-20. Ratio Nearline Tape vs. Disk

Figure 2-21. Ratio Nearline Tape to Disk Capacity vs. Revenue Tier

Figure 2-22. Tape Capacity Growth Rate for 2004

Figure 2-23. Expected Growth in Capacity of Tape in the Next Year per Revenue Tier

Figure 2-24. Total Optical Disk Capacity for All Data Centers

Figure 2-25. Optical Capacity Growth Rate for 2004

 

3- Backup

Backup Needs and Criteria

Figure 3-1. Volume of Data Fully Backup Up at Site.

Figure 3-2. Volume of Data Incrementally Backup Up at Site

Figure 3-3. How Often Perform Full Backup

Figure 3-4. How Often Perform Incremental Backup

Figure 3-5. Time Required for Daily Incremental Backups

Figure 3-6. Do you Need to Improve Dailly Incremental Backup Time?

Figure 3-7. Time Required for Full Backups

Figure 3-8. Do You Need to Improve Full Backup Time?

Figure 3-9. Number Versions of Full Backup Kept On-Line for Most Critical Applications

Figure 3-10. Time Keep Oldest Backup Versions On-Line

Figure 3-11. Total Copies of All Versions of Backup Kept On-Line for the Most Critical

               

                     Applications

 

Figure 3-12. Restore Time Goal

Figure 3-13. Percentage of File and/or Application Servers Backup Up

Figure 3-14. Number of Backup Servers

Figure 3-15. Backup Server Growth Next 12 Months

Figure 3-16. Backup Software Currently Used With NT/Windows 2000

Figure 3-17. Backup Software Currently Used with Unix

Figure 3-18. Backup Software Currently Used

Figure 3-19. Backup Software Plan to Acquire Next 12 Months

Figure 3-20. Criteria for Selecting a Backup Solution (1)

Figure 3-21. Criteria for Selecting a Backup Solution (2)

Figure 3-22. Satisfaction with Current Backup Solution (1)

Figure 3-23. Satisfaction with Current Backup Solution (2)

Continuous Backup

Figure 3-24. Do You Do Continuous Backup?

Figure 3-15. For What Percentage of Data Do Continuous Backup

Figure 3-16. Do You Presently Use Snapshot (or plan to use in the next 12 months)?

Figure 3-17. Time Intervals for Snapshots

Figure 3-18. Percentage of Applications That Use Snapshot and/or Virtual Tape Today

Figure 3-19. Percentage of Snapshots Copied on Tape or Disk

Figure 3-20. Importance of Snapshot

Figure 3-21. Satisfaction with Snapshot

Reliability

Figure 3-22. Percent Unsuccessful Backups and Restores

Figure 3-23. Cause of Backup Reliability Problems

Figure 3-24. Cause of Backup Restoration Reliability Problems

Figure 3-25. Concern with Backup Parameters

Applications, Remote Offices

Figure 3-26. Do You Have a Policy Now or Plan in the Next Two Years to Back Up Data From (Desktops, Laptops, or Mobile Devices/phones)?

Figure 3-27. Do You Use Now or Plan to Use in Next Year An Application Specific Tool for Backing Up Email?

Figure 3-28. Importance of Backup from (Desktops, Laptops, and Mobile Devices/Phones)

Figure 3-29. How Distributed Offices Backup Their Data

Media and Libraries

Figure 3-30. Storage System Used for Backup
Figure 3-31. System and Media Used for Backup in Primary Data Centers

Figure 3-32. Make of Tape Library/Silo

Figure 3-33. Is Your Tape Library Shared Among Multiple Platforms of Various Operating Systems?

Figure 3-34. Number of Drives in Largest Library

Figure 3-35. Total Number of Tape Cartridges Presently Used in all the Libraries

 

4- Disk Utilization in Backup

 

Figure 4-1. Disk Storage Used for Backup

Figure 4-2. Applications Backup Up on Disk

Figure 4-3. Secondary Disk Capacity Today

Figure 4-4. Anticipated Growth of Secondary Disk Capacity (Mean Value)

Figure 4-5. Mean Percentage Backup Data on Disk vs. Time

Figure 4-6. Mean Percentage of Data Backup up on SCSI or ATA Drives vs. Time

Figure 4-7. Percentage Disk Backup Data on SCSI/FC and ATA/SATA Drives

Figure 4-8. Backup Software Used for Secondary Disk Storage

Figure 4-9. Would Reliability or Performance Pervent You from Selecting ATA Drives vs.SCSI/FC for Secondary or Backup Disk Storage?

Figure 4-10. If Yes on Figure 4-9, What are Parameters of Concern for Using ATA Drives for Backup or Secondary Storage?

Figure 4-11. If you had the ability to Save (or Backup) Your Data in Full File Format (Disk Format) as opposed to Tape Format, what is the value?

Figure 4-12. Rating Criteria in Selecting Disk as Backup

Figure 4-13. Most Important Criteria in Selecting Disk as Backup

Figure 4-14. Satisfaction Criteria with Present Disk Backup Solution

Figure 4-15. Advantages of Disk vs. Tape

Figure 4-16. Preferred Vendor Channel for Purchasing Secondary Disk

 

5- Archiving and HSM

Archive vs. Backup, Media, and Reliability

Figure 5-1. Is Archiving Treated Separately from Backup?

Figure 5-2. Archive Separate from Backup per Revenue Tier

Figure 5-3. Specific Applications Archived Today

Figure 5-4. Specific Applications To Be Archived Next 2 Years

Figure 5-5. Volume of Data Archived Nearline

Figure 5-6. Data Retention Policy, Average for Three Most Critical Applications

Figure 5-7. Requirements or Policies That Guide Archiving Needs

Figure 5-8. Is "Write Once" Read Many (WORM) Recording Required for Archiving? (1)

Figure 5-9. Is "Write Once" Read Many (WORM) Recording Required for Archiving? (2)

Figure 5-10. Driver for WORM Recording

Figure 5-11. Importance of Write-Once Format for Archiving

Figure 5-12. Goal for Retrieving an Individual File from Archive

Figure 5-13. Criteria for Selecting an Archive Solution

Figure 5-14. Satisfaction with Present Archive Solution

Figure 5-15. Archiving Media Solutions Used

Figure 5-16. Criteria for Archiving Media Choice

Figure 5-17. Percent of Data Archived on each Media in 2003 and 2004

Figure 5-18. Cause of Backup Restoration Reliability Problems

Figure 5-19. Policies for Archiving Applications Now and in Next 2 Years

Figure 5-20. Plans for Data Format Criteria To Access Archived Data

HSM

Figure 5-21. Implementation and Plan for HSM

Figure 5-22. Implementation and Plan for HSM per Revenue Tier

Figure 5-23. HSM Use

Figure 5-24. Criteria to Select HSM for an Open System

Figure 5-25. Most Important Criteria to Select HSM for an Open System

 

6- Industry Profile

 

Figure 6-1. Telecommunications SCSI/FC Disk Capacity

Figure 6-2. Teleconcommunications ATA/SATA Disk Capacity

Figure 6-3. Education SCSI/FC Disk Capacity

Figure 6-4. Education ATA/ATA Disk Capacity

Figure 6-5. Total SCSC/FC Disk Capacity vs. Industry

Figure 6-6. Total ATA/SATA Disk Capacity vs. Industry

Figure 6-7. Total Nearline Tape Capacity vs. Industry

 

________________________________________________________________________________________

 

ORDER FORM
2004 BACKUP AND ARCHIVE

Fax 408-978-8184

 

NAME:_____________________________________________________

TITLE:_____________________________________________________

COMPANY: _____________________________________________________

STREET ADDRESS: ______________________________________________

CITY: ______________________STATE: _____________ZIP: ___________

Country _________________________________________________________

TELEPHONE: __________________________FAX: ______________________

E-MAIL:

First Print Copy $4,950 Additional copies to same address $350 per copy
California Locations add 7.75% sales tax - International Shipping, add $40

NUMBER OF COPIES: n = ----
First copy                                 $4,950 ---------------------------------------------------------------------------- 
Additional Copies:                 n x $350 -------------------------------------------------------------------------
Tax (CA only) 7.75% =                                 --------------------------------------------------------------------
International shipping or overnight delivery $40 --------------------------------------------------------
(No charge for basic UPS ground delivery)

PDF version with unlimited right for the company $6,950 -------------------------------------------

Complete raw basic material in Excell form (no company names) - Add $5,000 ------------

TOTAL  ---------------------------------------------------------------------------------------------------------------------
______

Check Enclosed or PO Number:
Charge to Visa, or MaterCard - NoExpires

Order two reports and save

Backup and Archive + Business Continuance for $7,500 instead of $9,900

 

SIGNATURE @: __________________________________________

 

 

Make checks payable to: Coughlin Associates 
Mail to:  1665 Willowmont Ave., San Jose, CA  95124

Email: TmCoughlin@aol.com
Telephone: 408-978-8184