Site outages

Where goats go to escape
User avatar
Ymx
Posts: 8557
Joined: Mon Jun 29, 2020 7:03 pm

Anyone else getting these.

One just finished now.

Got one yesterday too, during the Aus v NZ match. Possibly the same time.

Any background admin jobs running causing this?
User avatar
Sandstorm
Posts: 11881
Joined: Mon Jun 29, 2020 7:05 pm
Location: England

Yes. Full “site not available“ 10 mins ago, plus random 5 sec delays loading a page. Bored is not healthy :thumbdown:
User avatar
sturginho
Posts: 2594
Joined: Tue Jun 30, 2020 12:51 pm

Who will volunteer to set up notnotplanetrugby.com??
User avatar
Ymx
Posts: 8557
Joined: Mon Jun 29, 2020 7:03 pm

Think just a few teething issues with admin stuff, I’m sure.
User avatar
TB63
Posts: 4344
Joined: Mon Jun 29, 2020 9:11 pm
Location: Tinopolis

ASMO was downloading some "ahem" large files purely for research purposes..
I love watching little children running and screaming, playing hide and seek in the playground.
They don't know I'm using blanks..
User avatar
MungoMan
Posts: 487
Joined: Mon Jun 29, 2020 9:53 pm
Location: Coalfalls

I read this as 'Shite outrages' and looked forward to listing supposed tw@tterstorms etc about which I not one fuck gave.

Am very disappoint.
User avatar
Mr Bungle
Posts: 745
Joined: Mon Jun 29, 2020 6:14 pm

sturginho wrote: Sun Nov 01, 2020 10:12 am Who will volunteer to set up notnotplanetrugby.com??
:lol:

No offence, Asmo.
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

Mr Bungle wrote: Mon Nov 02, 2020 2:09 am
sturginho wrote: Sun Nov 01, 2020 10:12 am Who will volunteer to set up notnotplanetrugby.com??
:lol:

No offence, Asmo.
None taken, will look into it
stemoc
Posts: 1228
Joined: Sun Jul 05, 2020 7:10 am

maybe a better name, "wearerugby" or galaxyrugby.com :P
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

Have seen the errors in the logs, its a hosting issue, shitty email sent to the provider, lets see how they respond.
User avatar
Insane_Homer
Posts: 5529
Joined: Tue Jun 30, 2020 3:14 pm
Location: Leafy Surrey

I got this a couple of times yesterday and again just now trying to edit a post.

Code: Select all

403
Forbidden
Access to this resource on the server is denied!
“Facts are meaningless. You could use facts to prove anything that's even remotely true.”
User avatar
OomStruisbaai
Posts: 16051
Joined: Fri Jul 03, 2020 12:38 pm
Location: Longest beach in SH

Ymx wrote: Sun Nov 01, 2020 9:56 am Anyone else getting these.

One just finished now.

Got one yesterday too, during the Aus v NZ match. Possibly the same time.

Any background admin jobs running causing this?
You have been banned
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

And the reply, so please bear with us for now, it will get fixed
I can confirm the server you're hosted on still has an ongoing stability issue relating to MySQL which is causing performance problems (i.e slowness of sites loading). This problem is sporadic and appears once every few hours for a few minutes. Engineers are working on tracking this down and it is our primary focus at this moment in time to resolve the issue as quickly as possible. Please accept my sincere apologies in the meantime.

Sunday morning's outage of around 10 minutes was caused by an upgrade to the web server. We have moved to Litespeed as requested by many customers, and we this will provide many benefits, including:

1) More stability
2) Faster site loading
3) Integrated Wordpress caching features

Going forward, we anticipate the sever to be a lot more stable with no extended downtime, but there will be occasional slowness until the MySQL issue mentioned above is resolved, which we hope to be by the first half of this coming week. In the meantime, making use of the Litespeed caching feature will keep your site fast during the issue.
User avatar
Sandstorm
Posts: 11881
Joined: Mon Jun 29, 2020 7:05 pm
Location: England

:thumbup:
User avatar
Ymx
Posts: 8557
Joined: Mon Jun 29, 2020 7:03 pm

Was really slow at 7.40am

Refreshes taking about 10 seconds on main page.

Has sprung back to life now.

Search indexing job? Cron jobs?
User avatar
Guy Smiley
Posts: 6815
Joined: Mon Jun 29, 2020 7:52 pm

Just had an SQL error now. Lasted about 3 minutes.
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

Apologies, there are still a few wrinkles to be ironed out with the new hosting, i am working on it. Overall the site is running like lightning 99.9% of the time so its getting there, also as a bonus, the new hosting is 100% green so all renewable energy, energy efficient servers etc.
User avatar
Guy Smiley
Posts: 6815
Joined: Mon Jun 29, 2020 7:52 pm

Only mentioned it to give you a heads up ASMO, no complaints from me, very grateful for the site👍
User avatar
Insane_Homer
Posts: 5529
Joined: Tue Jun 30, 2020 3:14 pm
Location: Leafy Surrey

weird one now,

got a 403 from my PC. then posted ok.

Now getting site cannot be reached from PC, but fine from phone over 4G (this post). but not on my wifi.
“Facts are meaningless. You could use facts to prove anything that's even remotely true.”
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

seems to be running fine for me, most odd
User avatar
Saint
Posts: 2274
Joined: Tue Jun 30, 2020 8:38 am

Been 24 hours since I've been able to load the site at all. Just been getting timeouts
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

Saint wrote: Sun Nov 08, 2020 10:09 am Been 24 hours since I've been able to load the site at all. Just been getting timeouts
Its most definately a server side security issue, something to do with certain words or combinations of words triggering the security as it thinks they might be part of a script trying to hack into the site.
User avatar
Insane_Homer
Posts: 5529
Joined: Tue Jun 30, 2020 3:14 pm
Location: Leafy Surrey

weird one now,

got a 403 from my PC. then posted ok.

Now getting site cannot be reached from PC, but fine from phone over 4G (this post). but not on my wifi.
“Facts are meaningless. You could use facts to prove anything that's even remotely true.”
User avatar
Saint
Posts: 2274
Joined: Tue Jun 30, 2020 8:38 am

ASMO wrote: Sun Nov 08, 2020 10:11 am
Saint wrote: Sun Nov 08, 2020 10:09 am Been 24 hours since I've been able to load the site at all. Just been getting timeouts
Its most definately a server side security issue, something to do with certain words or combinations of words triggering the security as it thinks they might be part of a script trying to hack into the site.
Narrowed it down a bit. I can't join from my home wireless from any device (on Virgin Media). I also can't join on my local 4G. But if I'm 10 miles up the road on a different mast it works fine
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

To be honest, the feels like a local issue which i dont think can be resolved by anything i can do here
User avatar
Saint
Posts: 2274
Joined: Tue Jun 30, 2020 8:38 am

ASMO wrote: Sun Nov 08, 2020 1:26 pm To be honest, the feels like a local issue which i dont think can be resolved by anything i can do here

My guess is an SP issue. I presume your Internet access is bundled in with your hosting service? Something isn't resolving between them and what appears to be a number of national SP providers. You occasionally see something similar with SIP service providers being unable to route calls to mobile networks, O2 being the most frequent.

I'm not sure what ISP IH is with, but if it's Virgin Media then you could probably raise a ticket with your provider on that basis
User avatar
Ymx
Posts: 8557
Joined: Mon Jun 29, 2020 7:03 pm

Saint wrote: Sun Nov 08, 2020 12:25 pm
ASMO wrote: Sun Nov 08, 2020 10:11 am
Saint wrote: Sun Nov 08, 2020 10:09 am Been 24 hours since I've been able to load the site at all. Just been getting timeouts
Its most definately a server side security issue, something to do with certain words or combinations of words triggering the security as it thinks they might be part of a script trying to hack into the site.
Narrowed it down a bit. I can't join from my home wireless from any device (on Virgin Media). I also can't join on my local 4G. But if I'm 10 miles up the road on a different mast it works fine
Yours will be a separate problem. Possibly cloudflare security blocking.

Though it sounds like the widely experienced problem is with the MySQL database becoming flooded at certain intervals.

Which obviously wreaks of a schedule based background job, such as indexing or other admin function running at those times blocking all other db requests.

Or it might be something as simple as the number of concurrent MySQL connection setting being too low.
User avatar
Insane_Homer
Posts: 5529
Joined: Tue Jun 30, 2020 3:14 pm
Location: Leafy Surrey

I'm also on Virgin media for my home connection.
“Facts are meaningless. You could use facts to prove anything that's even remotely true.”
User avatar
Insane_Homer
Posts: 5529
Joined: Tue Jun 30, 2020 3:14 pm
Location: Leafy Surrey

tracert leaves virgin network,
goes through nntli.net
and then gets to gtt.net
dies after pulsant.net (46.249.203.74) - Scotland
“Facts are meaningless. You could use facts to prove anything that's even remotely true.”
User avatar
Insane_Homer
Posts: 5529
Joined: Tue Jun 30, 2020 3:14 pm
Location: Leafy Surrey

Seems I get 403 Access denied when I try to post a link, today it was a link to a BBC news article on the Breshit threat. If I remove the link, I can post. If I edit and try add it back, I get a 403.

if I persist, I think this is what results in the host/site banning the IP.
“Facts are meaningless. You could use facts to prove anything that's even remotely true.”
User avatar
Insane_Homer
Posts: 5529
Joined: Tue Jun 30, 2020 3:14 pm
Location: Leafy Surrey

yup, another couple 403s and now my work IP is blocked too. 😂

ASMO, your new hosts are a bunch of incompetent cowboys.
“Facts are meaningless. You could use facts to prove anything that's even remotely true.”
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

Insane_Homer wrote: Tue Nov 10, 2020 10:04 am yup, another couple 403s and now my work IP is blocked too. 😂

ASMO, your new hosts are a bunch of incompetent cowboys.
I have submitted a ticket with your issues on it, lets see what they come back with.
User avatar
sturginho
Posts: 2594
Joined: Tue Jun 30, 2020 12:51 pm

I got a couple of 403s the other day too but didnt think anything of it
User avatar
Insane_Homer
Posts: 5529
Joined: Tue Jun 30, 2020 3:14 pm
Location: Leafy Surrey

ASMO wrote: Tue Nov 10, 2020 11:15 am
Insane_Homer wrote: Tue Nov 10, 2020 10:04 am yup, another couple 403s and now my work IP is blocked too. 😂

ASMO, your new hosts are a bunch of incompetent cowboys.
I have submitted a ticket with your issues on it, lets see what they come back with.
thanks 👍
“Facts are meaningless. You could use facts to prove anything that's even remotely true.”
User avatar
Insane_Homer
Posts: 5529
Joined: Tue Jun 30, 2020 3:14 pm
Location: Leafy Surrey

...and I'm back from my work IP. will check home connection later :thumbup:
“Facts are meaningless. You could use facts to prove anything that's even remotely true.”
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

Insane_Homer wrote: Tue Nov 10, 2020 12:28 pm ...and I'm back from my work IP. will check home connection later :thumbup:
Once you are home i will need to get your IP and get it unblocked.
User avatar
Sandstorm
Posts: 11881
Joined: Mon Jun 29, 2020 7:05 pm
Location: England

ASMO wrote: Tue Nov 10, 2020 12:51 pm
Insane_Homer wrote: Tue Nov 10, 2020 12:28 pm ...and I'm back from my work IP. will check home connection later :thumbup:
Once you are home i will need to get your IP and get it unblocked.
Yeah IH, I'll need your IP and some other info too please.
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

IP's unblocked, let me know if it all works now guys
User avatar
Saint
Posts: 2274
Joined: Tue Jun 30, 2020 8:38 am

Cheers Asmo - IPs unblocked so I now get to see the SQL errors!
User avatar
ASMO
Posts: 5612
Joined: Mon Jun 29, 2020 6:08 pm

Saint wrote: Wed Nov 11, 2020 10:07 am Cheers Asmo - IPs unblocked so I now get to see the SQL errors!
Hopefully a lot of those are fixed! :-)
Post Reply