Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minio Upgrade #15241

Closed
seeker25 opened this issue Feb 4, 2023 · 15 comments
Closed

Minio Upgrade #15241

seeker25 opened this issue Feb 4, 2023 · 15 comments
Assignees
Labels
Dev Tasks for developers Pay Work for Pay Team SRE SRE team task

Comments

@seeker25
Copy link
Collaborator

seeker25 commented Feb 4, 2023

We need to upgrade Minio because it doesn't support files (Affidavits) with commas and special characters.

It's also 4 years old.

@seeker25 seeker25 added Dev Tasks for developers Pay Work for Pay Team labels Feb 4, 2023
@seeker25 seeker25 added devops technical continuous improvement SRE SRE team task and removed devops technical continuous improvement labels Mar 8, 2023
@PCC199 PCC199 unassigned seeker25 and Jxio Mar 9, 2023
@bolyachevets bolyachevets self-assigned this Mar 29, 2023
@bolyachevets
Copy link
Collaborator

bolyachevets commented Apr 13, 2023

We've been using Minio image built on Mar 28 10:10:12 2018 -0700
There are a couple of 'breaking' changes beginning with ~2022 Minio releases:

  1. Minio admin console is served on a separate port, hence we need 2 separate routes for api and console.
  2. File storage data format has been removed from Minio around 2022-10, if we want to upgrade past that release, we need to migrate our data via tedious steps described here: - https://min.io/docs/minio/linux/operations/install-deploy-manage/migrate-fs-gateway.html

For dev I updated image to minio/minio:RELEASE.2023-04-13T03-08-07Z.fips and followed data migration procedure above. New admin console url for dev: https://minio-admin-dev.apps.silver.devops.gov.bc.ca

For test I updated image to minio/minio:RELEASE.2022-09-25T15-44-53Z.fips (a slightly older image that does not require data migration - we can check to see if this will be sufficient in the interim, as we aim to migrate to google cloud storage eventually anyways) and the new admin console route is: https://minio-admin-test.apps.silver.devops.gov.bc.ca

@bolyachevets
Copy link
Collaborator

@seeker25 let me know if updating to minio/minio:RELEASE.2022-09-25T15-44-53Z.fips is good enough to resolve the outstanding issues (in the context of above comment)

@seeker25
Copy link
Collaborator Author

seeker25 commented Apr 13, 2023

I was wondering why Minio wasn't working in TEST haha.

Should we wire up DEV Payment / AUTH / LEAR? (not sure if LEAR uses minio) so it uses this new minio?

@AshnaMehta probably would need your assistance here for testing.

@bolyachevets
Copy link
Collaborator

I was wondering why Minio wasn't working in TEST haha.

Should we wire up DEV Payment / AUTH / LEAR? (not sure if LEAR uses minio) so it uses this new minio?

@AshnaMehta probably would need your assistance here for testing.

The api url should be unchanged - just admin console url changed. not sure what wiring up would necessary?

@seeker25
Copy link
Collaborator Author

Sounds good. @AshnaMehta could you test this functionality on DEV/TEST please?

@seeker25
Copy link
Collaborator Author

seeker25 commented Apr 20, 2023

2 for us to figure out

@seeker25
Copy link
Collaborator Author

image

image

@seeker25
Copy link
Collaborator Author

image

@seeker25
Copy link
Collaborator Author

seeker25 commented May 2, 2023

There's also a spot in business-filings-ui FileUploadPdf.vue

@seeker25
Copy link
Collaborator Author

seeker25 commented May 3, 2023

AUTH-WEB done, business-create-ui business-filings-ui to go

I'll handle business-edit-ui

@seeker25
Copy link
Collaborator Author

seeker25 commented May 3, 2023

business-create-ui, business-filings-ui, auth-web, business-edit-ui is done.

@AshnaMehta Could you please verify on DEV - business-create-ui, business-filings-ui, auth-web (business-edit-ui doesn't use
minio yet, but I have it in code)

After that's done, we can let Andriy know he can push the changes to TEST - We'll have to look at entity-filer and payment-jobs to ensure they're still working as well.

I think you'll have to test it again after we push to TEST as well

@seeker25
Copy link
Collaborator Author

seeker25 commented May 5, 2023

Cool thanks @AshnaMehta

@piahmed
Copy link

piahmed commented May 5, 2023

Had to make the public bucket have anonymous readonly access:
image

@seeker25
Copy link
Collaborator Author

seeker25 commented May 5, 2023

Ahh I was looking in the wrong spot - thank you for that.

We need to wait until the UIs get pushed out to PROD before proceeding with moving Minio to Production.

We also have to spot check the backend services to make sure minio is working correctly in TEST.

@PCC199 PCC199 closed this as completed May 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Dev Tasks for developers Pay Work for Pay Team SRE SRE team task
Projects
None yet
Development

No branches or pull requests

6 participants