Log Types: AWS

Overview

Amazon Web Services (AWS) is a cloud computing platform provided by Amazon that offers various computing services and cloud based products that are accessible over the internet, such as compute, storage, databases, analytics, networking, mobile, developer tools, management tools, IoT, security, etc.

Majority of this services and products can generate and publish logs which can be collected by Snare Central for further processing.

 

Collection

Snare Central can be configured to collect logs from supported AWS services via CloudWatch Log’s subscription filters, to get access to an almost real-time feed of log events and have it delivered to Amazon Kinesis Data Stream, then it can be pulled back and ingested by the Snare Central using the appropriate AWS Kinesis Data Stream API which were called periodically.

 

Supported AWS Service Logs

Many of the AWS services or cloud based products can publish logs to CloudWatch Logs and Currently Snare Central supports the following AWS service logs:

  • AWS CloudTrail Logs

  • AWS VPC Flow Logs

  • AWS Web Application Firewall (WAF)

 

Common fields for all AWS Service log types

These fields are also the default fields for unsupported/unrecognizable AWS collected logs (AWSGenericLog).

Field

Description

Field

Description

DATE

Event date, in the format YYYY-MM-DD

TIME

Event time, in the format HH:MM:SS

SYSTEM

The source system.

Supported AWS log type were source system information is not applicable or not available will be classified as AWS Internal

All other unsupported type will be classified as UNKNOWN

TABLE

For supported types: AWS<ServiceName>Log.

All other unsupported types will be classified as AWSGenericLog

COLLECTIONDATETIME

Snare Central’s local date and time of the actual log collection from AWS Kinesis Data Stream in RFC3339Nano format

CWLDATETIME

AWS CloudWatch Log’s timestamp when it receives the event log from other AWS services in RFC3339Nano format

DATETIME

The timestamp of the event log in RFC3339Nano format

SNAREDATAMAP

All unclassified field/s in the log will be pushed into the SNAREDATAMAP.

 

Notes

https://docs.aws.amazon.com/whitepapers/latest/aws-overview/introduction.html

https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/WhatIsCloudWatchLogs.html

https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/Subscriptions.html

https://docs.aws.amazon.com/streams/latest/dev/introduction.html