Skip to content

Migration to SQLAlchemy#424

Open
benjwadams wants to merge 157 commits intomainfrom
develop
Open

Migration to SQLAlchemy#424
benjwadams wants to merge 157 commits intomainfrom
develop

Conversation

@benjwadams
Copy link
Copy Markdown
Contributor

Next major upgrade for Glider DAC, moves over to SQLAlchemy for database storage.

Glider DAC v3.0 will likely be released shortly after this is merged.

benjwadams and others added 30 commits April 12, 2024 13:27
Uses application factory pattern.

Moves over to SQLAlchemy from MongoKit.
Removes BerkeleyDB for user authentication, instead using User model
to store password.  FTP PAM authentication methods will need to be
updated to use SQL instead.
Adds a model attribute/DB column for whether CF Standard names
are all compliant after Compliance Checker runs.  Also updates NCEI
archival scripts to utilize this column as part of the criteria
prior to determining whether datasets should be archived by NCEI.
Removes a non-functioning dataset removal task which didn't properly get
queued up due to Flask application context error.  In theory even for
removing many files from the web application from a delayed mode
dataset the operation should not take much time and deletions are not a
common occurrence.  If needed can be fixed and re-added later.
Adds feature file for example scenarios with deployments.
Tests are currently not implemented for these feature files
but will likely be implemented later using pytest-bdd.
Adds BDD testing steps for glider deployment creation, ensuring
that a user can create a deployment successfully, have an email
sent out to Glider DAC group, and ensure the proper filesystem
directory and file structure is created for the dataset.
Fixes password login with Flask-Security by specifying
singly hashed sha512_crypt passwords.  Sets default
to bcrypt instead of argon2 for compatibility purposes.
Display extra_atts.json content inline on deployment detail page
Adds file sync, valid file, and QC information to deployment file listing
Removes now unused/outdated email logic
Further ruff fixes, including errors requiring manual fixing
Further manual fixes indicated by ruff
Fix incomplete deployment email sending and related models
Adds appropriate databases event listeners for Deployment model creation
(.save) and delete (.delete)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants