http://packages.synocommunity.com down ? #3719

techbliss · 2019-06-05T16:17:42Z

Hello i get no response from http://packages.synocommunity.com via DSM
and website https://synocommunity.com/ seems to have cloudfare problems, and it have been like this for some days now.
Anyone knows when the site will be back up.

sstraus · 2019-06-05T20:30:22Z

same problem here

JoveYu · 2019-06-06T11:32:16Z

try to use https://packages.synocommunity.com

cytec · 2019-06-06T11:36:34Z

@Dr-Bean @ymartin59 seems to be server related...
seems to be on/off a lot lately: #3718

acolomb · 2019-06-06T12:00:52Z

I can confirm the "502 Bad Gateway" message from Cloudflare, for both packages.synocommunity.com as well as synocommunity.com. Using HTTPS in both cases. Seems like #3718 wasn't fixed after all...

ymartin59 · 2019-06-09T06:01:51Z

Today repository is back online - I had to restart service, but CPU usage is still high.

jucor · 2019-06-09T08:10:01Z

Thanks @ymartin59 for restoring access -- very helpful :)

jucor · 2019-06-09T08:19:52Z

Woops, down again, 502 Bad Gateway, same as @acolomb above.

ymartin59 · 2019-06-09T18:45:11Z

It really depends on system load... Not a DoS but it looks like there are more and more DSM connected to our repository, and probably packages history in repository has impact - I will do so clean up too.

Qrbaker · 2019-06-09T23:20:05Z

@ymartin59 Anything we can do to help? If the repo is on a cloud service, I would donate to spin up some more instances. Additionally, perhaps the CDN edge servers could cache packages?

ymartin59 · 2019-06-10T07:16:46Z

@Qrbaker Thanks for proposal. Current system is an old linux running on 3 cores at OVH hosted by founder @Diaoul
redis server should act as cache, so that CloudFlare too, but top requests "check to know if an installed package has updates" do not take benefits of any of theses as URI parameters contain timezone, dsm minor version... so from my point of view, relevant option is to improve caching in python/flask SynoCommunity/spkrepo#16

Diaoul · 2019-06-10T07:48:05Z

Infrastructure wise, the cost astronomical go put everything in the cloud. Mainly because we serve 90+GB or packages every day. The proper solution would be some private S3 hosting and public cloud for the app only with proper caching. CDN cannot cache POST requests and unfortunately this is how some NAS still query the package server. Le lun. 10 juin 2019 à 09:16, Yves Martin <notifications@github.com> a écrit :

…

@Qrbaker <https://github.com/Qrbaker> Thanks for proposal. Current system is an old linux running on 3 cores at OVH hosted by founder @Diaoul <https://github.com/Diaoul> redis server should act as cache, so that CloudFlare too, but top requests "check to know if an installed package has updates" do not take benefits of any of theses as URI parameters contain timezone, dsm minor version... so from my point of view, relevant option is to improve caching in python/flask SynoCommunity/spkrepo#16 <SynoCommunity/spkrepo#16> — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#3719?email_source=notifications&email_token=AACN55DFDMBBVEBDQD6IEL3PZX5V7A5CNFSM4HT5524KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODXJDYJY#issuecomment-500317223>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AACN55FZWF5RNFGXGODI5PLPZX5V7ANCNFSM4HT5524A> .

Qrbaker · 2019-06-10T16:58:15Z

@ymartin59 I use OVH as well, I'm happy to loan some time to help.

@Diaoul long shot, but could there be an option for distributed (i.e. torrent) packages? At the least, for people with transmission installed or a personal torrent client, they could get the spk and manually install as a fallback.

BenjV · 2019-06-10T17:16:40Z

Most likely the problem is not the downloaden of packages, but the constant pounding of every Synology Nas in the World to check if one of their packages needs an update.

ghost · 2019-06-12T10:12:42Z

I just bought a new synology and finally got to the point where I add synocommunity only to be blocked by this lovely issue

chickenandpork · 2019-06-12T14:41:29Z

@BenjV “constant pounding”
@Diaoul “CDN cannot cache POST”

Nginx caches POST requests:

proxy_cache_methods POST;

http://nginx.org/en/docs/http/ngx_http_proxy_module.html#proxy_cache_methods

It may be enough to layer on a quick reverse-proxy with the caching of POSTs turned on to focus the load of the backend towards new and unique requests.

Nginx revproxy can be some in a very small alpine-based docker that would be light enough to run on eachother’s VPS or a small cloud offering. Effectively community-sponsored CDN that does POST.

This would also allow a fan-out of more proxies than backend to scale in a broad, shallow direction. Interested parties may be able to contribute materially by, for example, individually supporting a single proxy instance in a small-resources AWS or GCP or Azure image that points to the upstream and shards load.

ymartin59 · 2019-06-12T20:02:51Z

@chickenandpork Alan, I am really not convince your proposal will help.

There is already:

CloudFlare as CDN
Nginx as reverse-proxy in front of uwsgi python code Flask
and redis-server as Flask object-mapper cache over PostgreSQL

So again, please review SynoCommunity/spkrepo#16 and any PR proposal is welcome, as I do not known these Python stacks and frameworks enough to implement it quickly.

chickenandpork · 2019-06-12T20:11:17Z

Hey Yves; you're correct -- even though "Nginx as reverse-proxy" is there, we can't assume that POST is cached; that said, the data in SynoCommunity/spkrepo#16 shows why my suggestion doesn't affect it, and why I should not try to add to a conversation while on commuting between jobs.

I'll armchair-quarterback another idea over on spkrepo#16 (and sorry -- you're quite gracious to answer everything)

ymartin59 · 2019-06-12T20:35:55Z

@chickenandpork Be sure I do not answer everything - considering volume I receive from GitHub in my mailbox... I have to consider severity, urgency and priority for anything requiring my attention and time from community, my job and the remaining of my real life...

kekukui · 2019-06-13T20:41:06Z

maybe use zeronet or IPFS for P2P distribution?

valdearg · 2019-06-15T19:40:12Z

Any idea when it might be up? I could do with getting the mediainfo package again.

CyberBlaed · 2019-06-22T07:21:17Z

Any idea when it might be up? I could do with getting the mediainfo package again.

Still down for me, Http error 400 when I try, that said, manually download the SPK from the website and install as a manual package.. seems fine that way.. as a work around for now :)

ymartin59 · 2019-07-17T05:47:58Z

Looks like server requires regular reboot (every ~100 days) probably because of some leaks in kernel...

s1r14na · 2020-03-18T00:53:11Z

synocomunity.com down again?

Diaoul · 2020-03-18T07:45:22Z

Indeed

Diaoul · 2020-03-18T07:48:50Z

Rebooted, should be ok now.

noplanman · 2020-04-07T21:17:33Z

I see, the classic then 😹

ymartin59 · 2020-04-07T21:31:55Z

In my opinion, spkrepo code cache is not optimal, it should discard some request parameters in key when value does not depend of that parameters.
Many concurrent requests consume almost all CPUs, so answers get longer to come, nginx and/or cloudflare considers system as out-of-order, and so 502 are emitted for a safety period...
I have already tried to tune nginx and wsgi servers to accept delay on requests, queueing them if possible, but CPUs are lacking.
Then spkrepo probably suffers of a memory leak and the more it has processed requests, the more CPU is consumed... I tried to set parameters to restart wsgi after thousand of requests. End of 2019, a server restart was required once a month... now it is already every two days, or even more frequently.

ymartin59 · 2020-04-07T21:34:11Z

Even if admin interface, I have to re-submit my requests up to 5 times before "catching a slot"...

ymartin59 · 2020-04-07T21:36:54Z

spkrepo holds 257 version of packages, and thanks to generic packages (x64, aarch64, armv7), number of builds are expected to decrease... but it still requires regular manual cleanup to discard old versions and reduce data processing.

Diaoul · 2020-04-08T09:57:30Z

Although the SQL model of the database is great to avoid inconsistencies, it causes very heavy requests on the database with huge JOINs thus taking a long time. This coupled with improper caching results in excessive load.
To compute a response we need to pull all the versions of a package, filter on architecture, take DSM version into account and determine with those constraint (and some more) what is the "latest" version.
Looking back on the design, I think I wouldn't mind something simpler on the database side with more application code for consistency.
Ideas welcome.

nkqiaolin · 2020-05-20T15:32:27Z

Sorry to raise : seems http://packages.synocommunity.com is down again? @Diaoul

Diaoul · 2020-05-20T15:41:00Z

See #3981
Migration should start as soon as I find some time, most probably during the weekend if all goes well.

nkqiaolin · 2020-05-20T15:46:51Z

That's cool! Thanks so much~~~

thehoff · 2020-05-21T23:23:21Z

@Diaoul happy to help if I can. located in AU and could help out supporting the servers under your guidance if that helps at all. Monitoring, admin etc. Just hit me up if you want/need help.

matrixn · 2020-05-22T15:51:22Z

Looks like today in London http://packages.synocommunity.com/ is down again... do we have a mirror for this repo? I would like to host one if is possible...

thbl · 2020-05-22T17:47:24Z

is it down again ?

matrixn · 2020-05-22T18:17:24Z

yeah...still down... at least from London i can't access it

publicarray · 2020-05-23T00:25:17Z

@matrixn @thehoff While we appreciate the offer, the current architecture does not lend itself well for mirroring. If have suggestions on how this can be done have a look at https://github.com/SynoCommunity/spkrepo.
This time around the outage is due to a server migration and not to an overloaded server. See #3981 Also once the server is migrated Fastly.com has kindly offered to be our CDN.

carloscae · 2020-05-24T09:59:23Z

Hi there. Are the SPKs available somewhere so I can manually download/install?
I came into a stupid situation of migrating my volumes and need to get one package there quite urgently. :(

(Hass.io in this case)

Thanks.

publicarray · 2020-05-24T13:12:05Z

@carloscae https://github.com/publicarray/spksrc/releases/download/hassio-20191224/hassio_x64-6.1_20191224-1.spk

baya44 · 2020-05-24T15:01:01Z

Any update about the migration ? I need the git spk for my ds1817+ after changing my volume last week.. There is any link to find it ?

publicarray · 2020-05-25T02:34:35Z

Yes see #3981 all further updates regarding the migration will be announced on that issue.
@baya44 I just build git for you: https://github.com/publicarray/spksrc/releases/tag/git-2.24.1 for the ds1817+ you need the git_x64-6.1_2.24.1-12.spk

jbega · 2020-05-26T09:17:18Z

Hi.
I have been trying to install the fuse libraries for several days but the synocomunity website is down. How could I install them on my 218+?
Thank you

hgy59 · 2020-05-26T09:56:30Z

@jbega in #3981 you find the current status. Migration to the new server is still in progress.

Do you mean you need synocli-disk for the fuse libraries?

jbega · 2020-05-26T10:01:52Z

So, is there no other way to install fuse libraries?

hgy59 · 2020-05-26T10:44:43Z

on my DS218+ there is already libfuse (and fusermount) installed

lrwxrwxrwx 1 root root     16 May 26 11:39 /usr/lib/libfuse.so -> libfuse.so.2.9.4
lrwxrwxrwx 1 root root     16 May 26 11:39 /usr/lib/libfuse.so.2 -> libfuse.so.2.9.4
-rwxr-xr-x 1 root root 245792 May  7 02:40 /usr/lib/libfuse.so.2.9.4

And this are the SynoCommunity Packages containing libfuse and fusermount (currently version 2.9.9)

synocli-disk
synocli-net (contains sshfs that installs libfuse)
sshfs (contained in synocli-net, no dedicated package anymore)
itools (includes ifuse that depends on libfuse)

hgy59 · 2020-05-26T10:47:01Z

@jbega please open a new issue for further discussions regarding fuse libraries.

jabarel · 2020-05-27T07:04:25Z

When will be up... i need transmission for 718+

brucey531 · 2020-05-27T18:45:06Z

Does anyone have the Synology package for Mosquito so I can install manually until Syno community is back.

Thanks

eRaz3r · 2020-07-09T09:29:42Z

Have a big Problem too. I need the Syncthing-File for my 212+ because it is broken after updating. Are there any news, what is the problem with SynoCommunity about? I can't klick on my architecture to dowlad the .spk manually.

acolomb · 2020-07-09T21:15:45Z

@eRaz3r I wish I could be of help with an updated testing build from PR #4027 which should fix your issue. However the DS212+ has an 88f6282 architecture and should be compatible with the armv5 build, which is not included there.

Possibly armv5 is listed as an unsupported architecture for the package? I can't check myself right now but maybe these hints will enable you to find a solution.

Totally unrelated to the offline package server though.

bluet · 2021-05-26T23:18:44Z

Hello I see 400 Bad request. Is it down again?

publicarray · 2021-05-27T02:11:19Z

You opened the url in your browser. That url is supposed to be used on your nas. You can visit https://synocommunity.com/ in your browser.

If someone has an issue please create a new one. Locking this one

ymartin59 assigned ymartin59 and Diaoul Jun 9, 2019

ymartin59 added repo issues related to synocommunity/spkrepo status/help-wanted labels Jun 9, 2019

ymartin59 closed this as completed Jul 17, 2019

eRaz3r mentioned this issue Jul 9, 2020

Cannot download .spk-Files manually #4064

Closed

SynoCommunity locked and limited conversation to collaborators May 27, 2021

http://packages.synocommunity.com down ? #3719

http://packages.synocommunity.com down ? #3719

Comments

techbliss commented Jun 5, 2019

sstraus commented Jun 5, 2019

JoveYu commented Jun 6, 2019 • edited Loading

cytec commented Jun 6, 2019 • edited Loading

acolomb commented Jun 6, 2019

ymartin59 commented Jun 9, 2019

jucor commented Jun 9, 2019

jucor commented Jun 9, 2019

ymartin59 commented Jun 9, 2019

Qrbaker commented Jun 9, 2019 • edited Loading

ymartin59 commented Jun 10, 2019

Diaoul commented Jun 10, 2019 via email

Qrbaker commented Jun 10, 2019

BenjV commented Jun 10, 2019 • edited Loading

ghost commented Jun 12, 2019

chickenandpork commented Jun 12, 2019

ymartin59 commented Jun 12, 2019

chickenandpork commented Jun 12, 2019

ymartin59 commented Jun 12, 2019

kekukui commented Jun 13, 2019

valdearg commented Jun 15, 2019

CyberBlaed commented Jun 22, 2019

ymartin59 commented Jul 17, 2019

s1r14na commented Mar 18, 2020

Diaoul commented Mar 18, 2020

Diaoul commented Mar 18, 2020

noplanman commented Apr 7, 2020

ymartin59 commented Apr 7, 2020

ymartin59 commented Apr 7, 2020

ymartin59 commented Apr 7, 2020

Diaoul commented Apr 8, 2020

nkqiaolin commented May 20, 2020

Diaoul commented May 20, 2020

nkqiaolin commented May 20, 2020

thehoff commented May 21, 2020

matrixn commented May 22, 2020

thbl commented May 22, 2020

matrixn commented May 22, 2020

publicarray commented May 23, 2020 • edited Loading

carloscae commented May 24, 2020

publicarray commented May 24, 2020

baya44 commented May 24, 2020

publicarray commented May 25, 2020 • edited Loading

jbega commented May 26, 2020

hgy59 commented May 26, 2020 • edited Loading

jbega commented May 26, 2020

hgy59 commented May 26, 2020

hgy59 commented May 26, 2020

jabarel commented May 27, 2020

brucey531 commented May 27, 2020

eRaz3r commented Jul 9, 2020 • edited Loading

acolomb commented Jul 9, 2020

bluet commented May 26, 2021

publicarray commented May 27, 2021

JoveYu commented Jun 6, 2019 •

edited

Loading

cytec commented Jun 6, 2019 •

edited

Loading

Qrbaker commented Jun 9, 2019 •

edited

Loading

BenjV commented Jun 10, 2019 •

edited

Loading

publicarray commented May 23, 2020 •

edited

Loading

publicarray commented May 25, 2020 •

edited

Loading

hgy59 commented May 26, 2020 •

edited

Loading

eRaz3r commented Jul 9, 2020 •

edited

Loading