/var/log/DMIT-NOC.log
TYO: Pending reboot action in an hour, expect VM reboot, and upto 1hr.
- Extend 45 mins again. Due to the initial RH does not record the label correct; it took many time to trace and re-cable.
- Ready in 11:30 JST
/var/log/DMIT-NOC.log
Content:
- Network Upgrade
- Hardware Upgrade
- Storage Upgrade
- Network Upgrade
- Hardware Upgrade
- Storage Upgrade
- Network Upgrade in progress.
-- Adding: RETN 100G, NTT 100G, BBIX 100G;
-- Remove: Equinix IX 10G, Cogent 10G; NTT 10G;
-- ETA: within a week.
- Hardware Upgrade completed
-- 7402P > 7443P
-- 10G * 2 per Node > 100G * 2 per Node
-- 20G uplink per rack > 100G * 2 uplink per rack.
- Storage Upgrade completed
-- SATA 10G SDS Cluster > NVMe 100G*2 SDS Cluster.
-- Adding: RETN 100G, NTT 100G, BBIX 100G;
-- Remove: Equinix IX 10G, Cogent 10G; NTT 10G;
-- ETA: within a week.
- Hardware Upgrade completed
-- 7402P > 7443P
-- 10G * 2 per Node > 100G * 2 per Node
-- 20G uplink per rack > 100G * 2 uplink per rack.
- Storage Upgrade completed
-- SATA 10G SDS Cluster > NVMe 100G*2 SDS Cluster.
Adjusting TYO network arch, some product experienced downtime, and it has been fixed now.
There are couple works need to be done before return to stable.
There are couple works need to be done before return to stable.
Edge Router hardware swap.
Time: 10AM-1PM JST, 12/18/2024
Expected maximum downtime: 60mins
Time: 10AM-1PM JST, 12/18/2024
Expected maximum downtime: 60mins
DMIT already aware about LAX EB packet loss on China direction.
We observe there is no packet loss on PtP segment.
The CMIN2 NOC response there is an issue on NCP submarine. Their capacity has been impacted due to the submarine issue.
DMIT will keep you updated.
We observe there is no packet loss on PtP segment.
The CMIN2 NOC response there is an issue on NCP submarine. Their capacity has been impacted due to the submarine issue.
DMIT will keep you updated.
/var/log/DMIT-NOC.log
DMIT already aware about LAX EB packet loss on China direction. We observe there is no packet loss on PtP segment. The CMIN2 NOC response there is an issue on NCP submarine. Their capacity has been impacted due to the submarine issue. DMIT will keep…
CTGnoc report, partial Tokyo CN2 CTGnet also been detour because NCP failure.
/var/log/DMIT-NOC.log
DMIT already aware about LAX EB packet loss on China direction. We observe there is no packet loss on PtP segment. The CMIN2 NOC response there is an issue on NCP submarine. Their capacity has been impacted due to the submarine issue. DMIT will keep…
We worked with CMIN2 to have the LAX.EB's current situation to be relieved.
Please check again.
Please check again.
/var/log/DMIT-NOC.log
Unexpected issue happend on TYO.Pro; investigating
Issue resolved;
Encounter JunOS software design defact.
VRF table refresh (deactivate & activate, table name remain unchange) make the VRF obtained a new FIB Table ID;
The PBR (which use "name" of table) does not update the Table ID after that.
Which bring the VM traffic been directed to a blackhole.
Resolved by disable PBR in Firewall, then reactivate.
Encounter JunOS software design defact.
VRF table refresh (deactivate & activate, table name remain unchange) make the VRF obtained a new FIB Table ID;
The PBR (which use "name" of table) does not update the Table ID after that.
Which bring the VM traffic been directed to a blackhole.
Resolved by disable PBR in Firewall, then reactivate.
/var/log/DMIT-NOC.log
DMIT already aware about LAX EB packet loss on China direction. We observe there is no packet loss on PtP segment. The CMIN2 NOC response there is an issue on NCP submarine. Their capacity has been impacted due to the submarine issue. DMIT will keep…
CMI NOC indicated the issue has been resolved.
DMIT has confirmed this resolution after 3 days of observation.
DMIT has confirmed this resolution after 3 days of observation.
From China Telecom,
For Los Angeles CN2 GIA.
====
Dear customer,
Please kindly be informed that there will be an planned maintenance and more information as below.
Time window (Date/Time):
2025-01-10 16:00:00 - 2025-01-22 22:00:00 UTC
2025-01-11 00:00:00 - 2025-01-23 06:00:00 UTC+8
Maintenance Description:
Facilities relocation
Maintenance Location:
American company, International
Service Impact:
The circuit will experience outage up to 360 minutes during the maintenance window.
For Los Angeles CN2 GIA.
====
Dear customer,
Please kindly be informed that there will be an planned maintenance and more information as below.
Time window (Date/Time):
2025-01-10 16:00:00 - 2025-01-22 22:00:00 UTC
2025-01-11 00:00:00 - 2025-01-23 06:00:00 UTC+8
Maintenance Description:
Facilities relocation
Maintenance Location:
American company, International
Service Impact:
The circuit will experience outage up to 360 minutes during the maintenance window.
/var/log/DMIT-NOC.log pinned «From China Telecom, For Los Angeles CN2 GIA. ==== Dear customer, Please kindly be informed that there will be an planned maintenance and more information as below. Time window (Date/Time): 2025-01-10 16:00:00 - 2025-01-22 22:00:00 UTC 2025-01-11 00:00:00…»
Observed CT CU routes has been withdrawn by CMI on Tokyo EB.
Waiting updates from CMI.
Waiting updates from CMI.
DMIT HKG Maintenance:
In 3 hours, upto 30 mins.
Replace / Upgrade Edge Router routing engine.
In 3 hours, upto 30 mins.
Replace / Upgrade Edge Router routing engine.
Network downgrade has been detected
Impact: CMIN2, Los Angeles.
The latency to China Mobile of LAX.EB, and LAX.Pro has increase.
No increaed packet loss rate has been observed.
LAX.Pro used CMIN2 for China Mobile inbound, the latency will also be impacted.
Notes: The only low latency inbound optimization for China Mobile is CMIN2.
CM-on-Net (CMI AS58453) has at least 150-180ms during normal time.
Issue has been reported to China Mobile International NOC already.
===
Jan 3, 2024 1AM EST
No update from CMI, but the latency return to normal hours ago.
Impact: CMIN2, Los Angeles.
The latency to China Mobile of LAX.EB, and LAX.Pro has increase.
No increaed packet loss rate has been observed.
LAX.Pro used CMIN2 for China Mobile inbound, the latency will also be impacted.
Notes: The only low latency inbound optimization for China Mobile is CMIN2.
CM-on-Net (CMI AS58453) has at least 150-180ms during normal time.
Issue has been reported to China Mobile International NOC already.
===
Jan 3, 2024 1AM EST
No update from CMI, but the latency return to normal hours ago.
Out of Stock Notice of DMIT Los Angeles Data Center
DMIT was unable to complete the expansion at the end of December 2024, due to HPE delivery overruns.
To ensure stable operation for existing customers, DMIT suspended sales of most instances in Los Angeles.
We expect to resume sales of all regular instances within 2 weeks.
Please contact us if you have any urgent need on specific one.
DMIT was unable to complete the expansion at the end of December 2024, due to HPE delivery overruns.
To ensure stable operation for existing customers, DMIT suspended sales of most instances in Los Angeles.
We expect to resume sales of all regular instances within 2 weeks.
Please contact us if you have any urgent need on specific one.