The partial network problems in LAX should already be resolved now.
The NOC of Twelve-99(a.k.a Arelion, Telia) put a wrong interface configuration on their end at 1 AM PDT today without noticing us immediately.
We have withdrawn the BGP announcement temporarily and the network profile will be rolled back once they fix this issue.
The NOC of Twelve-99(a.k.a Arelion, Telia) put a wrong interface configuration on their end at 1 AM PDT today without noticing us immediately.
We have withdrawn the BGP announcement temporarily and the network profile will be rolled back once they fix this issue.
/var/log/DMIT-NOC.log
Our team recently found the Intel 85299 NIC, and its' driver is unreliable for the long term running virtualization environment. Our new architecture has already switched to Mellanox CX3/4/5. This caused many problems, including the incident happening at…
DMIT LAX Pro, sPro will be migrated to 7443p / ConnectX node very soon.
There are 3 of the 7402p / 82599 nodes that are under very unstable situations due to memory leaking of ixgbe drivers ( it can only be resolved by reboot; rmmod unable to fix ). We have already isolated these 3 nodes to reduce the impact of the cluster.
You don’t need to worry about your data. It has already been migrated to the NVMe Ceph node days ago.
We’ll try our best to live-migrate your VM to the new node. If unable, your VM will reboot once.
There are 3 of the 7402p / 82599 nodes that are under very unstable situations due to memory leaking of ixgbe drivers ( it can only be resolved by reboot; rmmod unable to fix ). We have already isolated these 3 nodes to reduce the impact of the cluster.
You don’t need to worry about your data. It has already been migrated to the NVMe Ceph node days ago.
We’ll try our best to live-migrate your VM to the new node. If unable, your VM will reboot once.
Dear customer,
Please kindly be informed that there will be an urgent maintenance and more information as below.
Time window (Date/Time):
2022-06-08 16:00:00 - 2022-06-08 22:00:00 UTC
2022-06-09 00:00:00 - 2022-06-09 06:00:00 UTC+8
Maintenance Description:
Hidden-faulty troubleshooting
Service Impact:
The circuit will experience outage up to 120minutes during the maintenance window.
Affected Circuit(s):
TYO-GIA
From CTG NOC
Please kindly be informed that there will be an urgent maintenance and more information as below.
Time window (Date/Time):
2022-06-08 16:00:00 - 2022-06-08 22:00:00 UTC
2022-06-09 00:00:00 - 2022-06-09 06:00:00 UTC+8
Maintenance Description:
Hidden-faulty troubleshooting
Service Impact:
The circuit will experience outage up to 120minutes during the maintenance window.
Affected Circuit(s):
TYO-GIA
From CTG NOC
/var/log/DMIT-NOC.log
Our team recently found the Intel 85299 NIC, and its' driver is unreliable for the long term running virtualization environment. Our new architecture has already switched to Mellanox CX3/4/5. This caused many problems, including the incident happening at…
LAX.Pro/sPro should all running on the 7443p + 3200 RAM system right now.
DMIT is now replacing our ASN from AS54574 to AS906 step by step.
It might slightly affect the network but we’ll try to lower the impact during this process.
Please let us know if you see there are any routing changes that not as expected.
It might slightly affect the network but we’ll try to lower the impact during this process.
Please let us know if you see there are any routing changes that not as expected.
/var/log/DMIT-NOC.log
DMIT is now replacing our ASN from AS54574 to AS906 step by step. It might slightly affect the network but we’ll try to lower the impact during this process. Please let us know if you see there are any routing changes that not as expected.
IP Transit BGP flapped in TYO and LAX due to ASN changes.
The Internet route should been recovered 2hr ago for LAX, and 10 mins ago for TYO.
The Internet route should been recovered 2hr ago for LAX, and 10 mins ago for TYO.
DMIT is now offering 10G/100G waves between Equinix SV10 ~ Hurricane Electric FMT2.
10G $500MRC $600NRC
100G $1500MRC $5000NRC
Starting with a 12mo contract
24mo 20% NRC discount
36mo 40% NRC discount
- Delivery starts in late July.
- Both end delivery with 1310nm SMF 10km.
- Prepaid only.
- XC on customers.
- DMIT could help to order Equinix IX San Jose.
Contact with sales@dmit.com or ticket
10G $500MRC $600NRC
100G $1500MRC $5000NRC
Starting with a 12mo contract
24mo 20% NRC discount
36mo 40% NRC discount
- Delivery starts in late July.
- Both end delivery with 1310nm SMF 10km.
- Prepaid only.
- XC on customers.
- DMIT could help to order Equinix IX San Jose.
Contact with sales@dmit.com or ticket
unexpected reboot during kernel patch for 2 nodes in HKG.
You could start the server on your own or wait for an automatic boot-up.
You could start the server on your own or wait for an automatic boot-up.
Maintenance Notice:
Hong Kong and Los Angles
Date & Time: 17:00-21:00, July 8, 2022. Eastern Daylight Time.
Duration: upto 30 mins per location.
What: Major Network Configuration
Impact: Internet fully disconnection is possible.
Hong Kong and Los Angles
Date & Time: 17:00-21:00, July 8, 2022. Eastern Daylight Time.
Duration: upto 30 mins per location.
What: Major Network Configuration
Impact: Internet fully disconnection is possible.
/var/log/DMIT-NOC.log pinned «Maintenance Notice: Hong Kong and Los Angles Date & Time: 17:00-21:00, July 8, 2022. Eastern Daylight Time. Duration: upto 30 mins per location. What: Major Network Configuration Impact: Internet fully disconnection is possible.»
/var/log/DMIT-NOC.log
Maintenance Notice: Hong Kong and Los Angles Date & Time: 17:00-21:00, July 8, 2022. Eastern Daylight Time. Duration: upto 30 mins per location. What: Major Network Configuration Impact: Internet fully disconnection is possible.
LAX in progress
LAX Delay. We might complete this late today.
LAX Delay. We might complete this late today.
/var/log/DMIT-NOC.log
LAX in progress LAX Delay. We might complete this late today.
LAX in progress. ETA 30 mins
DMIT.io might unable to reach
DMIT.io might unable to reach
Scheduled Network/Backbone Maintenance & Construction
Purpose: To set up a multi-level DMIT backbone network; Prepare for a brand-new framework "DMIT.com"
Time: EDT 3 PM ~ 8 PM, Between Jul 26 ~ Aug 1
Impact: Short-term network interruption(blackout) or service degradation(loss optimization).
Notes: The time only shows when the maintenance will be performed and when will be an impact, instead of how long we need every day.
Purpose: To set up a multi-level DMIT backbone network; Prepare for a brand-new framework "DMIT.com"
Time: EDT 3 PM ~ 8 PM, Between Jul 26 ~ Aug 1
Impact: Short-term network interruption(blackout) or service degradation(loss optimization).
Notes: The time only shows when the maintenance will be performed and when will be an impact, instead of how long we need every day.
/var/log/DMIT-NOC.log
Scheduled Network/Backbone Maintenance & Construction Purpose: To set up a multi-level DMIT backbone network; Prepare for a brand-new framework "DMIT.com" Time: EDT 3 PM ~ 8 PM, Between Jul 26 ~ Aug 1 Impact: Short-term network interruption(blackout) or…
TYO: Unexpected JunOS crash during maintenance/configuration.
Reloading
Reloading
/var/log/DMIT-NOC.log
Scheduled Network/Backbone Maintenance & Construction Purpose: To set up a multi-level DMIT backbone network; Prepare for a brand-new framework "DMIT.com" Time: EDT 3 PM ~ 8 PM, Between Jul 26 ~ Aug 1 Impact: Short-term network interruption(blackout) or…
HKG maintenance delay due to multiple reason, performing right now