Belgium / Brussels / Info / Maintenance /
Dear customers,
Proximus has planned a maintenance in order to replace network hardware.
This maintenance may affect your services.
Please find all details below:
| Start*: |
2020-10-07 01:00 |
| End*: |
2020-10-07 06:00 |
| Duration: |
potential impact: up to 2h30min |
| Impacted services: |
All internet services |
| Affected Areas**: |
Brussels regions: Ixelles, Uccle, Watermael-Boitsfort, Auderghem, Woluwe-Saint-Pierre |
We apologize for the inconveniences.
Best regards
The edpnet team
* All times are listed in CET, Central European Time
** Check the different areas & zones on our support site
Belgium / Info / Internet / Netherlands /
Dear customers,
Starting from Friday edpnet was subject to major Denial of Service attacks (DDoS). An overview of the attacks and the time frames can be found below:
- Friday 28/08/2020, 18:00 – 19:00
- Sunday 30/08/2020, 20:30 – 20:45
- Sunday 30/08/2020, 22:20 – 00:55
- Monday 31/08/2020, 04:05 – 05:05
- Monday 31/08/2020, 11:15 – 18:45
In the past edpnet was always capable of mitigating these attacks ourselves by blocking these at the edge of our network. It looks like we were lucky in the past, and our luck ran out.
The attacks were this time directed towards our core networking equipment, primary and backup, and the traffic reached 200 Gbps, way too much for us to handle ourselves, causing DNS issues, and slow internet connections towards multiple destinations. Therefore we decided to contact a party (NBIP-NaWas) specialized in resolving these attacks, and setup a connection with them. This connection was up and running by midnight, and they mitigated 5 more attacks (three of 100 Gbps, two of 200 Gbps) without impact for our customers, proving it works. Two examples of such attacks can be found below:
This setup is permanent, and this way we can minimize these kind of attacks much quicker, reducing the impact to a bare minimum.
You can read some background information online:
https://datanews.knack.be/ict/nieuws/ddos-aanval-treft-edpnet/article-news-1635675.html
https://datanews.levif.be/ict/actualite/une-attaque-ddos-touche-edpnet/article-news-1326101.html
https://tweakers.net/nieuws/171594/belgische-provider-edpnet-heeft-al-vier-dagen-te-maken-met-ddos-aanvallen.html
We sincerely apologize for any inconveniences caused.
Customer-friendly regards
The edpnet team
P.S. Today 04/09 we can confirm there were no new attacks in the last 48 hours.
Belgium / Info / Issue / Netherlands / outage /
Dear customers,
We have experienced an outage with internet services (traffic drops) due to several DDoS attacks*** on our network. The attacks occurred at different hours and were causing intermittent connection, speed issues and packet loss. The heaviest one took place on Monday 31/08 and lasted from 11h15 until 18h45. Outside of those hours, everything was normal. Our Network Operations team has found and applied (on 01/09 at 1h29) a permanent solution to prevent and immediately mitigate such attacks in the future.
Please find all details below:
| Start*: |
2020-08-28 18:00* |
| End*: |
2020-09-01 01:29* |
| Duration: |
1) 2020-08-28 18:00 – 2020-08-28 19:00
2) 2020-08-30 20:30 – 2020-08-30 20:45
3) 2020-08-30 22:20 – 2020-08-31 00:55
4) 2020-08-31 04:05 – 2020-08-31 05:05
5) 2020-08-31 11:15 – 2020-08-31 18:45
|
| Impacted services: |
all internet services |
| Affected Areas**: |
all areas |
EDIT 12:30*: We have been under attack again since approximately 11:15. Access to our issues blog was limited so we were unable to keep you updated. Our apologies. We are doing our best to mitigate and solve the problem.
EDIT 2: 15h12*: Seems that the last attack is still ongoing. We are working hard to try to minimize the impact. Rebooting your modem/router to receive new DNS servers can help (but not guaranteed). In general surfing should be possible, only certain destinations will be difficult to reach. We keep you posted.
EDIT 3: 20h25*: The last attack finished at 18:45. We did our best to mitigate what was possible but the overload was extensive. Edpnet DNS servers are currently available again. We are working very hard with an external party towards providing a permanent solution to minimize the impact of any further attacks.
We apologize for the inconveniences.
Best regards
The edpnet team
*All times are listed in CET, Central European Time
** Check the different areas & zones on our support site
*** DDoS (Distributed-Denial-of-Service- attack) is kind of a cyber-attack, when malicous users seek to make a machine or network resource unavailable by flooding the provider or target with superfluous requests, which results in systems overload and connectivity issues
Belgium / Info / Issue / Netherlands / outage / Solved /
Dear customers,
We are currently experiencing an outage with internet services (traffic drops). Our Network Operations team is investigating the outage.
Further details on the affected areas and an estimated duration will be released as soon as possible.
EDIT 19:40*: Our DNS-servers were the target of a concerted DDOS-attack for approximately one hour (18:00 – 19:00), involving large amounts of traffic and major network saturation. At this time the attack has cleared up and we are investigating further.
EDIT 30/8 20:35*: It seems like we’re being attacked again since a few minutes. Our Network Operations team is investigating. More updates will follow soon.
EDIT 20:45*: The attack was mitigated after some actions from our Network Operations team. It was smaller than last time, but still very much able to knock out our DNS-servers. We’re working to restore all services.
EDIT: 21:15*: All services are restored.
EDIT: 31/8 5h05 We experienced other waves of DDoS attacks between 30/8 22h20 and 31/08 05h05. For the moment, the attacks are fully mitigated.
We apologize for the inconveniences.
Best regards
The edpnet team
Belgium / Internet / outage /
UPDATE 11h45: The issue is also solved for Ath
UPDATE 11h25: Outage in Châtelet has been solved.
Dear customers,
We are currently experiencing an outage with internet services in regions Ath and Châtelet. Our Network Operations team is investigating the outage.
Further details on the affected areas and an estimated duration will be released as soon as possible.
We apologize for the inconveniences.
Best regards
The edpnet team
Belgium / Info / Maintenance / Planned / Scheduled /
Dear customers,
Proximus has planned a maintenance in order to replace network hardware.
This maintenance may affect your services.
Please find all details below:
| Start*: |
2020-07-01 01:00 |
| End*: |
2020-07-01 06:00 |
| Duration: |
potential impact: up to 2h30min |
| Impacted services: |
All internet services |
| Affected Areas**: |
Machelen, Zaventem, Kraainem, Woluwe-Saint-Lambert |
We apologize for the inconveniences.
Best regards
The edpnet team
* All times are listed in CET, Central European Time
** Check the different areas & zones on our support site
Belgium / Info / Maintenance / Planned / Scheduled /
Dear customers,
Proximus has planned a maintenance in order to replace network hardware.
This maintenance may affect your services.
Please find all details below:
| Start*: |
2020-06-17 01:00 |
| End*: |
2020-06-17 06:00 |
| Duration: |
potential impact: up to 2h30min |
| Impacted services: |
All internet services |
| Affected Areas**: |
Londerzeel, Meise |
We apologize for the inconveniences.
Best regards
The edpnet team
* All times are listed in CET, Central European Time
** Check the different areas & zones on our support site
Belgium / Info / Internet /
Dear customers,
Since we strive to maintain an open communication with our customers, we owe you a short report about our outage of last week.
On Tuesday 12/05/2020 at the end of the day we saw an issue with a card in our POP in Germany on our European fiber ring. Luckily all traffic is rerouted via the other side of the ring. One of our network engineers leaves the next day, Wednesday 13/05/2020, in the early morning to Germany to replace the defective card.
Between Tuesday night and Wednesday morning, 13/05/2020 Eurofiber had a planned fiber maintenance in Antwerp. To be clear, our fibers were not involved in this maintenance. But at 5h30 an Eurofiber engineer accidentally jams one of our fiber cables between a cabinet door. This caused a second cut/outage on our fiber ring. This double cut/outage resulted in a disconnection from our Belgian network and our locations in Amsterdam and Germany. As a big part of our traffic is transmitted to Amsterdam and Frankfurt, we didn’t have enough capacity anymore in Belgium to handle peak traffic.
At 9h06, the Eurofiber engineers located the issue with our jammed fiber and solved it. At that moment we were back online but issues occurred when we started to rebuild our (fiber) wavelengths towards Amsterdam and Germany. As traffic was growing, our internal links inside the Belgian network were oversaturated. This caused time-outs to websites for many of our DSL customers.
Our network engineer arrived at 12h20 in our German site. The card was replaced within half an hour. At 13h01 we were able to get the wavelengths up and running as it should and our European ring was again fully redundant. Almost 1 hour later, at 14h15 our BGP communications with the outside world went back to normal after being disturbed due to the high amounts of attempts to get the fiber wavelengths back up.
What will we do to prevent this in the future?
We will install a backup for our out of band management interface which manages our equipment for traffic transportation, so even when there are 2 cuts on the ring, we can reach them from outside our own networks. This would result in a shorter repair time and better overview in case of issues like this.
Once again, we apologize for any inconveniences caused.
Belgium / Info / Maintenance / Planned / Scheduled /
Dear customers,
Proximus has planned a maintenance in order to replace network hardware.
This maintenance may affect your services.
Please find all details below:
| Start*: |
2020-06-03 01:00 |
| End*: |
2020-06-03 06:00 |
| Duration: |
potential impact: up to 2h30min |
| Impacted services: |
All internet services |
| Affected Areas**: |
Herentals, Grobbendonk, Herenthout, Olen, Westerlo, Geel |
We apologize for the inconveniences.
Best regards
The edpnet team
* All times are listed in CET, Central European Time
** Check the different areas & zones on our support site
Belgium / Info / Issue / outage / Solved /
UPDATE 14h15: all links have been restored. The problem is completely resolved. Further details about this major incident will be shared later this week.
UPDATE 13h05: main path is restored , the peerings are being re-enabled , the traffic flow should get back to normal very soon.
UPDATE 11h49: Sorry for the delay in our update. We are hoping to solve the root cause of our problem as soon as possible. If you want to read some background information, you can read this Datanews article:
Dutch: https://datanews.knack.be/ict/nieuws/glasvezelprobleem-zorgt-voor-panne-bij-edpnet/article-news-1598649.html
French: https://datanews.levif.be/ict/actualite/un-probleme-de-fibre-optique-provoque-une-panne-chez-edpnet/article-news-1288179.html
UPDATE 10h13: Internet services in all areas are affected. Our engineers are working on it.
Dear customers,
We are currently experiencing a fiber outage within our network. You may notice capacity issues. Our Network Operations team is investigating the outage.
Further details and an estimated duration will be released as soon as possible.
We apologize for the inconveniences.
Best regards
The edpnet team
