Forwarding Canvas Activity Logs Externally

Wondering if anyone would be willing to share how they might be forwarding Canvas activity logs to an external logging system (Splunk or syslog)? More specifically, how you are getting analytics out externally to see student activity logs of assignment submissions, authentication, etc. Thanks!

Find more posts tagged with

Admin

Accepted answers

ColinMurtaugh

We forward data from Canvas Live Events into Splunk using an SQS Queue and Lambda Function running in AWS. You can see a public version of the code that we use to do this here: https://github.com/Harvard-University-iCommons/canvas-live-events-splunk

This gets activity data into Splunk in near real time.

--Colin

All comments

ColinMurtaugh

This gets activity data into Splunk in near real time.

--Colin

reynlds

We have a similar setup as @ColinMurtaugh , however, there are no lambdas involved. The Canvas/Caliper live events are sent directly to a Splunk heavy forwarder which hands them off to the indexer. Delay for indexing is 15 to 30 seconds, so it's nearly real-time.

pgo586

We have the same setup as @ColinMurtaugh (AWS SQS and Lambda, which pushes Canvas Live events from the queue onto Splunk via the Splunk API. We originally had the machinery on the Splunk side (used a Splunk connector to the AWS queue where Canvas Live Events get deposited; then decided to switch at the suggestion of Splunk, as it seemed to present more flexibility).

morgan_j

@ColinMurtaugh , @reynlds , @pgo586, thank you for your replies regarding my query. Appreciate you taking the time to provide this information. 😁

Unanswered Questions

EDUCAUSE Insights: Data and Decision-Making
EDUCAUSE is full of inspiration, whether you’re onsite or following from afar. Join the evolution by sharing what sparks your curiosity, the questions you have, and the insights you discover. We'll learn from each other, expand our networks, and strengthen our Community. Your perspective matters, and the more we share,…
Problems with GraphQL in User Pageviews reports
Prompted by the most recent Canvas release notes, we looked into the Page Views feature, and we were happy with the new documented changes. However, we notice that more user actions are done by GraphQL API, which does not provide details in the page view report, either in the GUI or in the CSV file download. We and most…
Metrics Easy Button
I am currently teaching five courses this semester with more than 70 students. To track their progress, I currently have to review each course and section individually, which is very time-consuming. Ideally, I would like to consolidate key information for all students into a single Excel file—showing class attendance…
Analytics API / Metrics calculation logic
Hello, We are currently using the Analytics API provided in the Instructure Developer Documentation Portal to retrieve certain metrics-related data. We would like to know if it’s possible to replicate these datasets using the Canvas Data Platform (CDP), instead of relying on API calls. For example, could you please advise…
CD2: Enhanced Rubrics
Is there a way to tell via CD2 if a course is using Enhanced Rubrics? I didn't see it in the entity diagram for Rubrics table, but I might have missed something... Thanks Ian