Server

Krystal Network Status

Clear communication throughout service affecting events

View latest announcements

Announcements

8th April 2020

No incidents reported


7th April 2020

No incidents reported


6th April 2020
Server Updates (1 day ago)
, scheduled 1 day ago

Event Description:

As a part of our ongoing commitment to stability and security, Krystal Engineers will be performing kernel and package upgrades to our hosting servers. This upgrade requires our team to reboot these devices.

Note that while we do 'live patch' kernels so security vulnerabilities are closed as quickly as possible, with no service interruption, it is still occasionally necessary to reboot servers.

Scope:

The work will affect the following server(s):

salacia.uksrv.co.uk

aphrodite.krystal.co.uk

apollo.krystal.co.uk

ares.krystal.co.uk

artemis.krystal.co.uk

athena.krystal.co.uk

Typically, a server reboot will take between 5 and 10 minutes. If a file system check (FSCK) is required on boot then the outage will be extended and we will update if that is the case.

Time and Date:

2200 hours on Monday, 6th April 2020 (GMT/UTC)

Updates will be provided via this thread.

Updates:

22:30 - Ares is now being rebooted.
22:39 - Ares is back online.
22:47 - Aphrodite & Apollo are now being rebooted.
22:49 - Aphrodite is back online & Salacia is being rebooted.
22:55 - Apollo & Salacia are now back online.
23:12 - We have postponed the reboots for Artemis & Athena due to a potential package conflict which would cause problems after a reboot. These servers will be rebooted at a later date.

This concludes tonight's server maintenance.

Network connectivity issues (2 days ago)

15:02 - We are currently investigating network connectivity issues, we will post an update shortly.
15:25 - We're starting to see network services restore, we will update this notice as we continue to investigate this outage.
15:55 - We're continuing to investigate the cause of the outage to ensure we can provide a detailed report to all customers. Apologies for any disruption caused.

RFO for Network Connectivity – 06/04/2020

Impact: From 1457 until 1522 (25 minutes) on Monday, 6th of April 2020, we lost connectivity for all shared and reseller servers hosted in our London Central facility. The outage was due to a SYN flood attack (a form of DOS attack) against our network which resulted in the firewall pair protecting these servers to begin restricting SYN connections.

Remedial Steps: Once our team determined the source of the problem and to get things back online as quickly as possible, we temporarily disabled SYN flood protection on the relevant firewall pair. Note that this action does not decrease the security of our network and servers.

Going forward, we have increased the packet threshold for SYN flood attacks. This variable had been erroneously set too low for an attack situation and well below what our network and firewalls are capable of safely handling. We are confident this is now set suitably and do not expect further issues.

We are extremely sorry to our customers for the inconvenience caused and we thank you for your patience and understanding. We do appreciate it.

Engineering Team Krystal Hosting Ltd.


5th April 2020

No incidents reported


4th April 2020

No incidents reported


3rd April 2020
Server Updates (4 days ago)
, scheduled 4 days ago

Event Description:

As a part of our ongoing commitment to stability and security, Krystal Engineers will be performing kernel and package upgrades to our hosting servers. This upgrade requires our team to reboot these devices.

Note that while we do 'live patch' kernels so security vulnerabilities are closed as quickly as possible, with no service interruption, it is still occasionally necessary to reboot servers.

Scope:

The work will affect the following server(s):

hera.krystal.co.uk

hermes.krystal.co.uk

ixion.uksrv.co.uk

Typically, a server reboot will take between 5 and 10 minutes. If a file system check (FSCK) is required on boot then the outage will be extended and we will update if that is the case.

Time and Date:

2200 hours on Friday, 3rd April 2020 (GMT/UTC)

Updates will be provided via this thread.

Updates:

22:02 - Hera is now being rebooted.
22:03 - Hermes is now being rebooted.
22:06 - Ixion is now being rebooted
22:15 - Hera, Hermes & Ixion are now back online and is operating as expected.

This concludes tonight's server maintenance.

Ixion Abnormal Performance (4 days ago)

We are currently investigating abnormal performance which has occurred on Ixion after the earlier scheduled reboot.

Further updates will be provided as soon as possible.

Apologies for any disruption caused.

Updates:

23:26 - Ixion is now stable and functioning as expected. The underlying cause has been patched also to prevent further issues. Apologies for any disruption caused.

2nd April 2020

No incidents reported


Previous Week

Server Status

  • Domains Services
  • Live Chat
  • Axiom
  • DNS Cluster
  • Spam Experts Mail Cluster
  • Hubble
  • Hawking
  • Fermi
  • Faraday
  • Einstein
  • Darwin
  • Copernicus
  • Kepler
  • Archimedes
  • Demeter
  • Dionysus
  • Hera
  • Hermes
  • Hestia
  • Poseidon
  • Zeus
  • Aphrodite
  • Apollo
  • Ares
  • Artemis
  • Athena
  • Gibson
  • Karoo
  • Guban
  • Antarctica
  • Monte
  • Karakum
  • Patagonia
  • Arrakis
  • Atacama
  • Mojave
  • Ordos
  • Gobi
  • Kalahari
  • Sahara
  • Thar
  • Victoria
  • Medon
  • Helio
  • Varda
  • Salacia
  • Huya
  • Orcus
  • Ceres
  • Eris
  • Pluto
  • Sedna
  • Varuna
  • Haumea
  • Ixion
  • Helium
  • Hydrogen
  • Lithium
  • Beryllium
  • Boron
  • Carbon
  • Nitrogen
  • Oxygen
  • Fluorine
  • Neon
  • Sodium
  • Magnesium
  • Aluminium
  • Silicon
  • Phosphorus
  • Sulfur
  • Chlorine
  • Argon
  • Potassium
  • Calcium
  • Scandium
  • Titanium
  • Vanadium
  • Chromium
  • Manganese
  • Iron
  • Cobalt
  • Nickel
  • Copper