CD2 page_views and requests not working?

Question

We have consultants helping us pull data from CD2 They are having issues pulling some data, and have asked us for help….can anyone give me any guidance I can bring back to them: …we were able to successfully extract data from Canvas using the available APIs and load it into Databricks. However, the requests and page_views resources/tables are currently not accessible in Canvas which is part of the requirements. We would appreciate your guidance on enabling access to these two endpoints. Additionally, if page_views and requests are not available, please recommend any alternative tables/resources that should be considered to support the required engagement and activity tracking use cases.Below are few fields that we are looking for from each of these endpoints Page_views - created_at, url, action, participated requests (CD2) - user_id, course_id, timestamp, action (GET), url

Gergely Schmidt · Accepted Answer

You might have been looking for web_logs in canvas_logs namespace.

Please note canvas_logs.web_logs data source only provides the last 30 days of data.

There is a separate data source that is called page views but it is not in CD2, it is Canvas API. There are two ways to get it within Canvas API:

* Get the last 30 days as a REST API response for a single user
* Get the data up to last 1 year for a single user, but it is available as an async API manner, similar to CD2

The differences between the two Canvas API based page views endpoints are:

* Data retention: 1st is last 30 days, 2nd is last 1 year
* Data granularity: in the 2nd, async way, the smalled chunk you can request is 1 user / 1 calendar month.
* Data format: in the 2nd, async way you can request it in CSV and JSON, while in the 1st you can only get the result in JSON.
* The 2nd, async way misses a parameter: interaction_seconds from the dataset, which we are working on to fix it.

The difference between page views and web logs in general is that web logs only contain log data that is generated by the web server, while page views also contain data from the iOS and Android Student and Teacher mobile apps, but not all web logs.

To visualise the difference:

Hope this helps.