Streaming of Access Logs

Flumotion Smart Multi CDN allows you to collect CDN access logs in a unified format.

Logs from all configured CDNs are streamed using the same format, making them easier to process and analyze.

To configure log streaming, you first need to create a Log Destination. Then, you need to configure a Behavior to stream logs to that destination.

Creating a Log Destination #

To create an access log destination:

1. Navigate to your service.
2. In the sidebar, select Logs, and then select Log Destinations.
3. Click the Add Destination button.
4. Complete the new destination form:

• Destination Name – Enter a friendly name for the destination.
• Destination Type – Select the destination type:
  • AWS S3 bucket
  • S3 Compatible
  • Hydrolix
• For an S3 bucket:
  • Select either Assume Role or Access Key as the credentials type and enter the required bucket credentials.
  • Bucket Name – Enter the S3 bucket name.
  • Path – Use / for the root path, or specify another path prefix within the bucket.
  • Region – Enter the region where the bucket is located.
• For Hydrolix:
  • Provide the authentication details: User, Password, and Authentication Token.
  • Provide the Endpoint, Project, and Table where the logs will be stored.

5. Select Anonymize IP if you want to obfuscate the end user’s IP address by removing the first octet of the IP address.

6. Select the Log File Format:

• JSON List – A plain json list.
• JSON Object – A json object containing a records field.
• Delimited Line JSON – Each line contains a json record.
• CSV – A csv file.

7. Click Save Changes.

Once created, the new destination will appear in the list of Log Destinations.

Streaming Logs to a Destination #

In this step, you will configure log streaming to the destination by using a Behavior.

You can either create a new Behavior or add an Action to an existing one.

To stream logs by creating a new Behavior:

1. Navigate to your service.
2. Select the Behaviors tab.
3. Click the Add New Behavior button.
4. Complete the new Behavior form:

• Name – Enter the name of the new Behavior.
• Path Pattern – Enter a wildcard expression that identifies the paths to which the Behavior should apply.
• Click the Add Action button.
• From the Action Type dropdown, select Stream Logs.
• Log Destination – Select the Log Destination you previously created.
• Sample Rate – Enter the percentage of logs that should be sampled and sent to the destination.

Note #

Configuring log streaming for a Path Pattern with a high traffic volume and a high Sample Rate can result in a large volume of logs being sent to your Log Destination.