Home
Topics
Enterprise Network Security
Network Intrusion Detection and Analysis
Security Event Management
How to estimate log generation rates

Ask the Expert

How to estimate log generation rates

Mike Chapple, Enterprise Compliance

Are there any calculators to help estimate log generation based on number of devices and best practices?

Requires Free Membership to View

Login

By submitting you agree to receive email communications from
TechTarget and its partners. Privacy Policy Terms of Use.

Estimating log generation rates is tricky, and it's difficult to create a credible, generic estimation tool. Many security information and event management (SIM/SIEM) vendors have proprietary Excel-based calculators that they offer to current and prospective clients, but the objectivity of these tools is questionable given their source. I was unable to locate an independent calculator that offers this functionality.

Why is this so difficult? Log generation rates vary significantly based upon the configuration of devices. For example, you and I may both run Microsoft SQL Server databases, but I may have the logging and auditing settings configured to track almost every activity the database performs, while you may have minimal (or no) logging configured. Additionally, I may be in a high-load 24x7 data processing environment, while you may be running a database with low transaction volume. Therefore, it's impossible to provide a meaningful estimate of the log volume generated by a "typical" SQL Server database. Add in hundreds or thousands of other diverse devices, and the problem magnifies in scope quickly.

So how is it possible to develop a meaningful estimate for your environment? There's only one solution: measure your current activity by, for example, setting up a simple syslog server and measuring the volume of traffic it receives. If the systems are similarly configured, you can save time by measuring the logs generated by a representative sample of your organization's devices and extrapolate from there.

More information:

Learn how log management reins in security and network device data.

See why the PCI Data Security Standard has forced companies to seek log management help.

More News and Tutorials

Articles
Sponsored Articles
- Building the Foundation for an Agile Data Infrastructure
- NetApp Flash Pool and Flash Cache: A Deep Dive
- How Do You Measure and Report Storage Efficiency?
- CERN Unlocks Secrets Of The Universe With NetApp Storage
- Taking An Integrated Approach To Patient Care

Related glossary terms

Terms for Whatis.com - the technology online dictionary
- security information management (SIM)
- security event (security incident)

This was first published in February 2009

Join the conversationComment

Share

Comments

Results

Contribute to the conversation

All fields are required. Comments will appear at the bottom of the article.

Back to top

More from Related TechTarget Sites

Cloud Security
Consumerization
Financial Security
SMB Security
Security AU
Security IN
Computer Weekly

Cloud Security
- Storing data in the cloud: Addressing data location security issues
  
  When storing data in the cloud, ignoring the physical location of cloud data is a major mistake. Learn how to prevent data location security issues.
- An introduction to enterprise hybrid cloud security
  
  A custom cloud infrastructure requires a special set of security controls. Get advice on how to implement hybrid cloud security the right way.
- SOC 2 reports: The de facto cloud provider security standard
  
  They're not perfect, but SOC 2 reports are becoming the baseline for cloud provider security assessments. Expert Dave Shackleford discusses.
Consumerization
- Network connectivity, security issues hinder mobile strategies
  
  Enterprises are limited in implementing mobile strategies due to security issues, network connectivity and compatibility.
- Upcoming iOS 7 mobile management features affect MDM tools
  
  New mobile management capabilities coming in Apple iOS 7 have some enterprise mobility management vendors, including VMware changing their approach.
- What do you know about dual-persona technology?
  
  Dual persona is fairly new, so you may not be familiar with it yet. Take our quiz to see how much you know -- and learn more -- about the technology.
searchFinancialSecurity
- PayPal CISO: Laws must foster better cybersecurity information sharing
  
  PayPal's Michael Barrett says many firms fear misuse of shared cybersecurity data. He also discusses the evolution of PCI DSS and mobile payment security.
- Cybergang plans to use Trojan against U.S. banks
  
  A cybergang in Eastern Europe revealed plans to attack U.S. banks with a Gozi-like Trojan, according to RSA.
- Improved Shylock Trojan targets banking users
  
  The latest variant of the banking Trojan is causing numerous problems, Symantec said.
searchMidmarketSecurity
- Windows Phone 7 security: Assessing WP7 security features
  
  Windows Phone 7 security features are proving to be a mixed bag. Sam Cattle assesses the enterprise security pros and cons of the latest Windows mobile platform.
- Choosing the best security certifications for your career
  
  Whether starting your career or planning your next step as an IT security professional, this tip will guide you toward the best certifications for your interests and experience.
- A step-by-step SMB IT security risk assessment process
  
  Assessing your organization's security threats and risks takes just five steps, says Robbie Higgins. Check out his quick guide to the SMB security risk assessment process.
searchSecurityAU
- Black Hat 2013: Experts urge elliptical curve cryptography adoption
  
  A session by a team of crypto experts at Black Hat USA 2013 argued that RSA and Diffie-Hellman should be abandoned in favor of ECC.
- New advanced persistent threat protection: Beyond perimeter defense
  
  Firewalls and antivirus are ineffective in the face of APT attacks. Expert Nick Lewis offers suggestions for advanced persistent threat protection.
- Cisco spends cool $2.7 billion in Sourcefire acquisition
  
  In biggest security acquisition since 2011, Cisco has announced it will buy IDS maker Sourcefire for $2.7 billion.
Information Security
- Indian banks step up security amid mobile banking acceleration
  
  The Indian banking system is at the begining of a new era, driven by mobile technology, but the widening of access to banking services brings with it security risks
- Web app attacks demand automated defences, study finds
  
  Automation is the most effective way to tackle multiple prolonged cyber attacks on web applications, a study has confirmed
- BlackBerry ready to enable India to track messages
  
  BlackBerry is ready to provide Indian law enforcement authorities with a way to track emails, email attachments and chats sent over its services
Computer Weekly
- NHS Central Midlands CSU updates datacentre with standardised data warehousing
  
  It improved the quality and safety levels of healthcare for over 5 million citizens across the West Midlands by standardising data warehousing
- BlackBerry looks for a buyer to focus on BES and BB10
  
  The board of directors at BlackBerry are considering the sale of the troubled smartphone company, in a bid to focus on BlackBerry 10
- ICO to investigate London bins that track smartphones
  
  Information Commissioner's Office is making enquiries into bins in London that track passing smartphones to target advertising to owners

All Rights Reserved,Copyright 2000 - 2013, TechTarget