-
Is there a way to translate bash script to Azure with dapclient
So, not super familiar with Azure but we've managed to set up a pipeline (but getting occasional fails) and debating finisihing incremental approach. I do ultimately want to get this into a postgres db. At the moment I get far more reliable data using a simple script on localhost dev! Have noted 1.0.0.0 is now out; I've…
-
Problem with dap 1.0.0 schema synchronization
Hi -- I'm having trouble getting dap syncdb to work in a reliable/predictable manner w/r/t the application of upstream table schema changes to my local database. For some reason it seems to be trying to execute ALTER TABLE statements every time, even though the table schemas are up to date as far as I can tell. This is…
-
"Visible course nav tools" question
A higher-up asked my boss and me whether it's possible to track which faculty members are using the Attendance (Roll Call) tool in their courses. Since we have it disabled by default in all of our credit-bearing courses, we thought we might be able to answer this by finding out in which active courses it appears as an…
-
"DLL load failed while importing _rust" error (dap-client v1.0.0)
Hi, I've just updated to the latest v1.0.0 version of the dap-client plus updated the cryptography to v42.0.5 & even when I now attempt to run just 'dap --version' I get the aforementioned DLL load error. Anyone else experiencing this? Anyone resolved or got any suggestions to try? Regards, Mark
-
DAP Client 1.0.0 change in processing???
After upgrading to the 1.0.0 DAP client yesterday, I'm now getting a very specific error: ERROR - [Errno 28] No space left on device It appears that the DAP client is now loading up my /tmp location (which is very limited) for holding and assembly of the various file parts prior to assembly and shipment to Postgres. If I'm…
-
Canvas Data 2 - Get Row Count in a Table without fetching all the data
When using CD2, is there a way to retrieve the total rows in a specific CD2 table? I am using CD2 to load data in a visualization tool. After pulling data using a full snapshot, i periodically pull incremental snapshot for changes I also collect quality metrics like row count. Since the incremental snapshots only provide…
-
Canvas Data 2 Gradebook activity
Greetings, I'm working on a Canvas Data 2 query I'd like assistance with. The goal is to identify courses where the Canvas Gradebook is not being used. Scenarios I can envision are courses that do not have assignments with gradebook entries or assignments are past their due date with no grade. Checking the Canvas Data 2…
-
Canvas Data 2 - Successful initdb but discrepancy in rows imported to PostgreSQL using Python DAP Cl
Hi all, I was able to populate local PostgreSQL using the Python dap client, but there seems to be a discrepancy in the number of rows imported compared to what I see in the Canvas web app. For example, I can see more than 900 courses in the Canvas web app, but there are only 166 rows in the local database. Command used:…
-
Tracking LTI usage data in era of CD2
A couple of years ago, I submitted this question to the community: https://community.canvaslms.com/t5/Data-and-Analytics-Group/How-to-Track-External-App-Usage/m-p/529110#M1466 Now that Canvas Data Portal has gone away, I don't know how to retrieve data files such as assignment_dim, course_dim, etc., or their CD2…
-
Gathering Data on Assigments that don't have a submission type?
We are working on some data models to be displayed in PowerBI. I have a question regarding assignments when there is not a submission type, the assignment table will have a value of None. So, I can calculate the number of assignments submitted by student from the submissions table if the assignment has a submission type.…
-
How to study the data in web_logs table
Hi all, According the datasets from CD2, https://data-access-platform-api.s3.eu-central-1.amazonaws.com/tables/catalog.html#schemas.canvas_logs.web_logs. It states that web_logs defines as follow: Stores the Canvas web application server access/request logs. Logs include all interactions made with your instance of Canvas,…
-
Any update on the next release of the DAP api? We are excited to use DAP with SQL server.
-
Can retrieve CD2 web_logs data which is older than 30 days?
Hi all, My institution starts to use Canvas since 2014, and now we focus on CD2 web_logs. As I know that the DAP API can only retrieve the latest 30 days data. May I ask is it possible way to get back the web_logs data from 2014? If no, is there any charged service can do that? Many thanks
-
Code error for DAP library
Hi all, I refer the section 'Getting latest changes with an incremental query' from the link https://data-access-platform-api.s3.amazonaws.com/client/README.html#command-line-usage and program the code to retrieve the web_logs with datetime range.…
-
Processing CD2 web_logs in AWS
Hi everyone, does anyone have any experience or lessons learned in regards to processing the CD2 web_logs table in AWS (Glue / Athena / etc)? We don't have any immediate specific use cases, but we know that researchers will want to query data eventually. So one option would be to just download the data as parquet files…