CD2: DAP Client Plans to support non-postgresql databases

Will the DAP client support other databases (specifically MS SQL Server)? If so, is there an estimated timeline for this? It seems the DAP client is the best tool for building an automated pipeline to a data warehouse and does a lot of the work that would otherwise be tedious via the API.

Find more posts tagged with

cd2

dap

Accepted answers

LeventeHunyadi

Yes, we plan on supporting multiple database engines, and DAP client library has been engineered with this in mind. However, there is currently no timeline for adding support for other database engines such as Microsoft SQL. Currently, we are working on consolidating an extension interface such that contributors can easily add integrations for other database engines. DAP client library database integration is based on SQLAlchemy, which is an abstraction layer supporting many databases. However, there are some PostgreSQL-specific pieces that we need to get rid of or hide behind an interface before new engines like Oracle, Microsoft SQL, MySQL, etc. can be seamlessly integrated.

Would you be interested in contributing Microsoft SQL support, or beta-testing such an integration if it were available?

All comments

LeventeHunyadi

Would you be interested in contributing Microsoft SQL support, or beta-testing such an integration if it were available?

tyler_clair

We would possibly be interested in helping with the Oracle side.

pkreemer

Hi, I'd be interested in testing any beta (or alpha) version of a MS SQL plugin for DAP! It's great to see the plugin framework documented now (https://data-access-platform-api.s3.amazonaws.com/client/plugins.html) but even better to see some early form of MS SQL plugin. 🙂

thanks-

Paul (WA state community colleges)

Gergely Schmidt

Hello @ismail_orabi, @pkreemer, @laned, @tyler_clair!

I'm happy to announce that we have released the DAP CLI 1.3.0 where we have added support for MS SQL.

Please check it out and let us know how it works for you!

AlanWallace

Great news on the MS SQL support! Our destination database, unfortunately, is Oracle, and we would be interested in testing anything that you come up with.

Unanswered Questions

Error initializing large table using dap on python 3.14
Hi — I've been struggling to initialize our "submissions" table using the dap CLI and I've narrowed down the problem to Python 3.14. I'm able to successfully run the same exact initdb command (on the same EC2 instance) under Python 3.13 and 3.12. On Python 3.14.2, the import successfully processes about 34 million records…
EDUCAUSE Insights: Data and Decision-Making
EDUCAUSE is full of inspiration, whether you’re onsite or following from afar. Join the evolution by sharing what sparks your curiosity, the questions you have, and the insights you discover. We'll learn from each other, expand our networks, and strengthen our Community. Your perspective matters, and the more we share,…
Problems with GraphQL in User Pageviews reports
Prompted by the most recent Canvas release notes, we looked into the Page Views feature, and we were happy with the new documented changes. However, we notice that more user actions are done by GraphQL API, which does not provide details in the page view report, either in the GUI or in the CSV file download. We and most…
Metrics Easy Button
I am currently teaching five courses this semester with more than 70 students. To track their progress, I currently have to review each course and section individually, which is very time-consuming. Ideally, I would like to consolidate key information for all students into a single Excel file—showing class attendance…
Analytics API / Metrics calculation logic
Hello, We are currently using the Analytics API provided in the Instructure Developer Documentation Portal to retrieve certain metrics-related data. We would like to know if it’s possible to replicate these datasets using the Canvas Data Platform (CDP), instead of relying on API calls. For example, could you please advise…