AWS CloudWatch (Logs)

Log Group

• Collection of Log Streams
• Retention (e.g. 30 days)
• Filters -> CloudWatch Metrics
  • Count (ocurrences of string)
  • Interpret (pattern language)
  • e.g. Apache web request latency

Log Stream

• Sequence of Log Events
  
  • e.g.  Individual service log file from particular EC2 instance

Log Event 

• Individual event recorded by application (timestamp + UTF-8 data)

Subscriptions

• Deliver log feed to other service for analysis
  • Kinesis Stream
  • Kinesis Firehose (S3)
  • Lambda
• Process
  • Create receiving source
  • Create subscription filter
• Use cases
  • custom processing
  • analysis
  • loading to other systems
• Subscription Filter
  • Log Group Name
  • Filter Name
  • Filter Pattern
  • Destination ARN
  • Role ARN (e.g. allow to insert to Kinesis)