Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Preload AI Data Script #800

Merged
merged 6 commits into from
Feb 7, 2025
Merged

Preload AI Data Script #800

merged 6 commits into from
Feb 7, 2025

Conversation

kadamidev
Copy link
Contributor

@kadamidev kadamidev commented Feb 6, 2025

Description of the Problem / Feature

A script to iterate over nodes and process their AI data, currently the script doesn't make mutations to the manifest, it preloads the data that has a long TTL in dynamo, so frontend retrieval should be quick.
We can modify it to mutate the manifest, though it may also not be the best idea as we make improvements in the AI API, the latest changes won't be synced to the manifest in the future, or we'd have to delete old data, and reapply new data.

  • Also updated the backend AI API to use the CID upload method.

@kadamidev kadamidev marked this pull request as ready for review February 7, 2025 12:07
@kadamidev kadamidev merged commit 2cc1891 into develop Feb 7, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant