-
CD2 dap issues
Hey all, CD2 has been a big pain implementing for my organization, once we finally got the DAP tool working now we have v1.1 out with this mandatory namespace issues now and a mountain of new errors. With this new 1.1 dap tool, has anyone received and error like: AssertionError: Data should not be empty…
-
How to Access Page Views using Canvas Data 2 Tables
Hi All, I am trying to find where in Canvas Data2 tables can i determine the number of page views a student has on a particular course. I saw a few community page solutions that talks about utilising wiki_page_fact table > view counts seen in this link…
-
Assignment Override Flags Are Often Incorrect
I'll state up front that I may not understand the purpose of the OVERRIDDEN columns found in the assignment_overrides table. However, given the documentation associated with the columns, then one or more of the values in the columns appear to be incorrect 57% of the time. The columns in question…
-
web logs and remote_ips
Hi I'm looking for advice about working with web_logs and in particular how we might track students' usage through remote_ips. I'm currently maintaining a small server running MariaDB which uses the dap client to retrieve CD2 tables. Firstly - how feasible is it to download all of your web_logs? We've been a Canvas…
-
Duplicate Comment For Different Columns
From the PostgreSQL DDL script for the "assignments" table, the columns EXCLUDE_BIBLIO and EXCLUDE_QUOTED have the same comment. Here's the comment: Selecting this option will exclude text appearing in the bibliography, works cited, or references sections of student papers from being checked for matches when generating…
-
CD2 issues continue - table initdb inserts only fraction of data
Hi Folks! After running into the issue of no data being inserted after syncdb, I reinstalled everything, including python, DAP client, PostgreSQL and upgraded to tsv2py 0.6.2. That seemed to solve the issue of *no* data being inserted into my PostgreSQL db. However, now I notice that the "courses" table only inserts 215…
-
AWS Harvard Data 1 extract conversion to Data 2
Has anybody that was using the Harvard Data 1 extract successfully converted it to use Data 2 and was it just changing the API data?
-
DAP parquet file transformation strategy
We are looking to download certain table data, transform it, and then upload to our Azure DataLake storage. The solution I have been working on involves a Python Azure Function app. Since the DAP parquet files have a "key", "value", and "meta" columns to represent the data, it requires using something like pandas to…
-
Total Activity Report
In a course's People list, each user has their total activity (hh:mm:ss) listed. Is there any way a teacher in the course could export this data as a report? Or as an admin, for the entire account activity? It would be ideal if admins could report on total activity at account level (all users in the account, total amount…
-
pysqlsync - no rows to upsert/insert - tsv2py not solving issue, syncdb not updating postgres
Good morning folks! After updating to the new stable release of the DAP CLI tool, I was able to smooth out some existing issues which some of you have already experienced: TCI_KEEPIDLE issue was an OS/Python issue "Please use initdb" when trying to use syncdb was corrected by updating to the new stable release of 1.1.0…
-
CD2 - Weblogs
I'm trying to extract all clicks to a specific URL from web logs, with user ID-level detail. However, when filtering the logs to that URL, I noticed some users have multiple records (5-10) with timestamps only a few seconds apart. This suggests repeated clicks on the same link within a short span, which seems unlikely. Can…
-
Incremental query with missing pseudonym entries
Hi - I'm using DAPClient 1,1 and postgres 16 With an incremental query I've discovered we seem to have started losing pseudonym "id"'s. e.g. users.id 2720 has pseudonym.id 2689, but in the pseudonymn table 2689 has been skipped, so has 2693. Confirmed that this relationship does exist in live API. No errors in DAP output…
-
SCORM Usage in Data 2
Hi, Does anyone have any idea how to track the usage of SCORM packages across the entire instance. I need the number of packages deployed and the number of courses that have at least one package deployed
-
Obtaining Roster emails: Allow New Analytics to run before publishing the course
To follow standard best practices in online courses, we require our facilitators to send welcome messages (sometimes more than one) to participants before the course is published. The roster in grades and people shows student logins or SIS ID's (which are basically useless to facilitators), and it does not show accurate…
-
Error running initdb with DAP 1.1
On several table downloads using initdb I'm getting dozens of the error below. This has only been on a few tables so far. I have tried dropping the table and re-running, that worked once but not on the conversation_messages table. We're using Python 3.12, DAP 1.1, Postgresql 15.6 File "C:\Program…