The most recent content from our members.
The issue -- we currently pull reports from the api/v1/reports several times a day, and the person who is responsible for those jobs that has complained to me on multiple occasions that they take a long time and often get stuck or fail, because of the size of the reports. It looks like all of the data in those reports is…
In case it's helpful for anyone, here's my working-and-also-work-in-progress DAG ("Directed Acyclic Graph" -- it's a fancy word for "workflow" or "batch job") for Apache Airflow. It will probably work as far back as 2.4, and I currently have it running on Airflow 2.10. If you're familiar with python, it's probably pretty…
Hello, With the deployment of the 1.3.0 client, I've decided to TRY and migrate from Postgres into my native SQL Server environment. I have successfully initialized ~88 tables, but I know that's not enough. I'm seeing an issue within the Assignments table that probably exists in other tables. The script that's creating the…
I am trying to populate a database with ALL the tables in the Canvas namespace. I am following the instructions on this documentation to initialize my database using the initdb command. Below is my CLI: dap initdb --connection-string my_connection_string --namespace canvas but I get an error saying the table argument is…
Currently looking at canvas.courses table. I want to link all the courses / modules to their respective main Programs so that different programs can be analysed separately. For instance - a computer science Y1 main program could have 6 modules/courses (database, AI, ML, QC, ANN, DS) Is there a way these "sub" courses can…
sgergely and @GergelyTar - I was just wondering if there's anything on the DAP client roadmap for syncing to an S3 location and/or using Iceberg? We're going w/ PostgreSQL for convenience in making our transition from CD1 to CD2, but we have a strong preference for a data lake approach. In the interim, we're using an…
DAPClientError: malformed HTTP response occurs at least twice in a month. and was unable to identify the exact issue. DAPClientError Traceback (most recent call last)Cell In [35], line 3 1 if __name__ == '__main__': 2 loop = asyncio.get_event_loop()----> 3 res = loop.run_until_complete(main()) 4 try: 5 loop.close() File…
After upgrading to the 1.0.0 DAP client yesterday, I'm now getting a very specific error: ERROR - [Errno 28] No space left on device It appears that the DAP client is now loading up my /tmp location (which is very limited) for holding and assembly of the various file parts prior to assembly and shipment to Postgres. If I'm…
When we are running our DAP synchronizer python script, we are running into issues going back to Feb 27. This was the last time it ran successfully and we noticed it 2 days ago. When diving into the issue we are finding that several tables now are trying to cast automatically to type uuid. How do we fix this? Should we…
Hello, I am trying to use DAPSession.stream_resource to stream resources/files directly into an S3 bucket. The idea is to pipe the stream directly into S3 without downloading and storing the entire file locally first, and then reuploading it into S3. However, I am not sure how to use that method. First, I am not sure how…
Sign in to enhance your access to articles, forums, and events—and to participate by sharing insights, engaging in discussions, and connecting with your network of edtech peers.