Outage: General DDoS on edpnet services

Dear customers,

We are currently experiencing an distributed denial of service attack (DDoS) on all of our services. This may cause you to experience problems with all of our services.  Our Network Operations team is investigating this outage.  Further updates will be released as soon as possible.

Please find all details below:

Start*: 15-09-2021 16:15
End*: 19-09-2021 22:24
Duration: //
Impacted services: All services are impacted
Affected Areas**: All areas

EDIT 16:44*: As soon as we identified the issue, we have started routing our data through a scrubbing service (which tries to identify harmful sources & data and removes it).

EDIT 17:19*: The situation seems to be improving as we identify more and more attack vectors and sources. It seems like for most impacted customers, the situation has improved markedly since approximately ~17h.

EDIT 16/09/2021 10:12*: During the night we had two more attacks. We are working with the authorities, who have confirmed they are looking into it and are doing everything in their power to find the responsible individuals. We were contacted by an individual who verified he was behind the attacks, asking for a ransom.

EDIT 13:18*: We are being DDoS’ed again. We are doing what we can to mitigate the issues.

EDIT 15:41*: The attacks are still on-going. To give you a perspective of what we are dealing with, this is what our filtering service has been able to filter out so far:

EDIT 16:39*: We are monitoring the situation closely, and are discussing the situation both with our anti-DDoS provider and Belgian official instances. We hope to improve the situation as soon as possible and will keep you in the loop of our progress.

EDIT 17/9 15:47*: The attacks have started again. All of our uplinks are entirely congested. We are trying to mitigate the DDoS once more.

EDIT 18/09 12:41*: Yesterday evening and past night we were hit with multiple attacks.  Currently no attacks since 03:00. We still expect more attacks to come.  We are monitoring 24/7.  And we will communicate accordingly.  We try to answer questions or comments on social media as good as we can.

EDIT 20/09 9:48: There were some attacks on Sunday afternoon. No new attacks since then. We keep monitoring and do our best to minimize impact in case of new spikes.

We apologize for the inconveniences.

Best regards
The edpnet team

*All times are listed in CET, Central European Time
** Check the different areas & zones on our support site


Maintenance planned on 03/02/2021 – impacted services: All internet services : CLOSED

Dear customers,

Proximus has planned a maintenance in order to replace network hardware.

This maintenance may affect your services.

Please find all details below:

Start*: 2021-02-03 01:00
End*: 2021-02-03 06:00
Duration: potential impact: up to 2h30min
Impacted services: all internet services
Affected Areas**: Dilsen-Stokkem, As;
Zonnebeke, Moorslede;
Florennes;
Erezée;
Habay

 

We apologize for the inconveniences.

Best regards
The edpnet team

* All times are listed in CET, Central European Time
** Check the different areas & zones on our support site


Maintenance planned on 12/10/2020 – impacted services: SDSL & VDSL Expert Plus high upload

Dear customers,

Edpnet has planned a maintenance on one of our core routers in order to improve the performance and the quality of our services.

This maintenance will cause an interruption (up to 20 minutes) of your internet connection. If you experience a longer downtime, please reboot your modem/router.

The maintenance only affects SDSL and VDSL Expert Plus high upload subscriptions.

Please find all details below:

Start*: 2020-10-12 06:00
End*: 2020-10-12 07:30
Duration: up to 20 minutes downtime
Impacted services: SDSL & VDSL Expert Plus high upload
Affected Areas**: All areas

 

We apologize for the inconveniences.

Best regards
The edpnet team

* All times are listed in CET, Central European Time
** Check the different areas & zones on our support site


Info: Report on the recent DDoS issue

Dear customers,

Starting from Friday edpnet was subject to major Denial of Service attacks (DDoS). An overview of the attacks and the time frames can be found below:

  • Friday 28/08/2020, 18:00 – 19:00
  • Sunday 30/08/2020, 20:30 – 20:45
  • Sunday 30/08/2020, 22:20 – 00:55
  • Monday 31/08/2020, 04:05 – 05:05
  • Monday 31/08/2020, 11:15 – 18:45

In the past edpnet was always capable of mitigating these attacks ourselves by blocking these at the edge of our network. It looks like we were lucky in the past, and our luck ran out.

The attacks were this time directed towards our core networking equipment, primary and backup, and the traffic reached 200 Gbps, way too much for us to handle ourselves, causing DNS issues, and slow internet connections towards multiple destinations. Therefore we decided to contact a party (NBIP-NaWas) specialized in resolving these attacks, and setup a connection with them. This connection was up and running by midnight, and they mitigated 5 more attacks (three of 100 Gbps, two of 200 Gbps) without impact for our customers, proving it works. Two examples of such attacks can be found below:

This setup is permanent, and this way we can minimize these kind of attacks much quicker, reducing the impact to a bare minimum.

You can read some background information online:

https://datanews.knack.be/ict/nieuws/ddos-aanval-treft-edpnet/article-news-1635675.html

https://datanews.levif.be/ict/actualite/une-attaque-ddos-touche-edpnet/article-news-1326101.html

https://tweakers.net/nieuws/171594/belgische-provider-edpnet-heeft-al-vier-dagen-te-maken-met-ddos-aanvallen.html

We sincerely apologize for any inconveniences caused.

Customer-friendly regards
The edpnet team

P.S. Today 04/09 we can confirm there were no new attacks in the last 48 hours.


Outage notification: Internet services down – regions: Ath & Châtelet : SOLVED

UPDATE 11h45: The issue is also solved for Ath

UPDATE 11h25: Outage in Châtelet has been solved.

Dear customers,

We are currently experiencing an outage with internet services in regions Ath and Châtelet. Our Network Operations team is investigating the outage.

Further details on the affected areas and an estimated duration will be released as soon as possible.

We apologize for the inconveniences.

Best regards
The edpnet team


Info: Report on the outage of 13/05/2020

Dear customers,

Since we strive to maintain an open communication with our customers, we owe you a short report about our outage of last week.

On Tuesday 12/05/2020 at the end of the day we saw an issue with a card in our POP in Germany on our European fiber ring. Luckily all traffic is rerouted via the other side of the ring. One of our network engineers leaves the next day, Wednesday 13/05/2020, in the early morning to Germany to replace the defective card.

Between Tuesday night and Wednesday morning, 13/05/2020 Eurofiber had a planned fiber maintenance in Antwerp. To be clear, our fibers were not involved in this maintenance.  But at 5h30 an Eurofiber engineer accidentally jams one of our fiber cables between a cabinet door.  This caused a second cut/outage on our fiber ring.  This double cut/outage resulted in a disconnection from our Belgian network and our locations in Amsterdam and Germany. As a big part of our traffic is transmitted to Amsterdam and Frankfurt, we didn’t have enough capacity anymore in Belgium to handle peak traffic.

At 9h06, the Eurofiber engineers located the issue with our jammed fiber and solved it. At that moment we were back online but issues occurred when we started to rebuild our (fiber) wavelengths towards Amsterdam and Germany. As traffic was growing, our internal links inside the Belgian network were oversaturated.  This caused time-outs to websites for many of our DSL customers.

Our network engineer arrived at 12h20 in our German site.  The card was replaced within half an hour.  At 13h01 we were able to get the wavelengths up and running as it should and our European ring was again fully redundant.  Almost 1 hour later, at 14h15 our BGP communications with the outside world went back to normal after being disturbed due to the high amounts of attempts to get the fiber wavelengths back up.

What will we do to prevent this in the future?

We will install a backup for our out of band management interface which manages our equipment for traffic transportation, so even when there are 2 cuts on the ring, we can reach them from outside our own networks. This would result in a shorter repair time and better overview in case of issues like this.

Once again, we apologize for any inconveniences caused.


Outage: DSL services (regions: Namur/Charleroi/Liège/Mons) #SOLVED

Dear customers,

We are currently experiencing an outage with our DSL services in the southern provinces.  Our Network Operations team is investigating this outage.  Further updates will be released as soon as possible.

Please find all details below:

Start*: 2020-03-31 06:29*
End*: 2020-03-31 11:15*
Duration: 4:45h
Impacted services: All DSL services
Affected Areas**: 41GRE: Liège, Namur, province of Luxembourg
71GIL: Charleroi, Mons, Tournai, Namur

EDIT 10:30*: The cause is found. During a migration to proactively improve our capacity due to the increasing bandwidth usage, an issue with our supplier’s hardware occurred causing them to block traffic. We are currently working with the supplier to rectify this problem as soon as possible, this happens region per region.

EDIT 11:15*: All regions have been brought back online. The issues should be resolved. It is possible you will need to restart your modem to come back online.

We apologize for the inconveniences.

Best regards
The edpnet team

*All times are listed in CET, Central European Time
** Check the different areas & zones on our support site


Maintenance planned on 18/02/2020 – impacted services: all internet services : CLOSED

Dear customers,

Edpnet has planned a maintenance in order to increase the network capacity.

This maintenance will cause a short interruption (up to 30 minutes) of your internet connection. If you experience a longer downtime, please reboot your modem/router.

Please find all details below:

Start*: 2020-02-18 05:00
End*: 2020-02-18 06:00
Duration: expected impact: up to 30 minutes of service interruption
Impacted services: All internet services
Affected Areas**: 71GIL: Walloon Brabant, Hainaut
41GRE: Liège, Namur, province of Luxembourg

 

We apologize for the inconveniences.

Best regards
The edpnet team

* All times are listed in CET, Central European Time
** Check the different areas & zones on our support site


Outage notification: DDoS attack on Saturday

Dear customers,

On Saturday afternoon we experienced an issue with internet services due to a large-scale DDoS attack. After investigating, it has become clear that various services, users and providers in Belgium were the target of this attack. We are working to provide better mitigation for this type of attack in the future.

We apologize for the inconveniences.

Best regards
The edpnet team


Maintenance planned on 03/12/2018 – impacted services: internet connectivity and telephony : Closed

Dear customers,

Edpnet in cooperation with Proximus has planned a maintenance in order to replace fiber hardware.

This maintenance may affect your services.

Please find all details below:

Start: 2017-12-03 00:00*
End: 2017-12-03 06:00*
Duration: 30 minutes
Impacted services: internet connectivity and telephony
Affected Areas: Kraainem, Wezembeek-Oppem, Sterrebeek, Zaventem

 

We apologize for the inconveniences.

Best regards
The edpnet team

*All times are listed in CET, Central European Time