/var/log/DMIT-NOC.log
4.92K subscribers
189 photos
6 files
117 links
Download Telegram
When DMIT migrate network architecture in SJC;
DMIT has to disconnect with AS174 for a while.

At this time AS1299 applied an emergency maintenance, which caused Transit blackout.

We will bring AS174 back soon.
CTGnet partial unreachable issue on TYO Pro which happened 6 hrs ago has been resolved.
/var/log/DMIT-NOC.log
DIRECT MESSAGE FROM RETN.NET [HKG] Failure Notification Description: Our regional capacity is significantly reduced due to submarine fiber cuts in the Asia region. During peak hours, multiple destinations may experience overutilization, resulting in packet…
Subsea fiber cut on Sofia - Singapore section. Start: 19.04 | Restored 28.06
Subsea fiber cut on Marseille - Singapore section. Start: 19.04 | Restored 28.06
Subsea fiber cut on the Hong Kong - Taipei section. Start: 13.03 | ETR: 01.07
Subsea fiber cut on Hong Kong - Singapore section. Start: 10.03 | ETR: 15.07
Subsea fiber cut on the Milan-Singapore section. Start: 24.02 | ETR: 07.07
To all TYO.Pro customers.

CTGnet:

Dear customer,

Please kindly be informed that there will be an planned maintenance and more information as below.

Time window (Date/Time):
2024-07-30 16:00:00 - 2024-07-30 22:00:00 UTC
2024-07-31 00:00:00 - 2024-07-31 06:00:00 UTC+8

Maintenance Description:
System / Equipment upgrade

Maintenance Location:
International/Overseas

Service Impact:
The circuit will experience outage up to 180 minutes during the maintenance window.

Affected Circuit(s):
TYO-GIA-
To offer better experence for our customers, DMIT built a quick start manual to assist our customer knowing our services in rapid.

Please check the following link to access the manual:
https://docs.dmit.io/
Observed AS4837 for LAX.Pro and EB has detour to AS1299 recently.

DMIT is investigating and solve it ASAP.
/var/log/DMIT-NOC.log
Observed AS4837 for LAX.Pro and EB has detour to AS1299 recently. DMIT is investigating and solve it ASAP.
observed China Unicom to all Pro network profile are bypassing Internet. We’re working with CTG about it.
/var/log/DMIT-NOC.log
observed China Unicom to all Pro network profile are bypassing Internet. We’re working with CTG about it.
DMIT is still actively working with China Telecom to resolve this matter.
Current information: Unicom should accept the existing customers' prefix based on the agreement. Telecom is working with them.
/var/log/DMIT-NOC.log
DMIT is still actively working with China Telecom to resolve this matter. Current information: Unicom should accept the existing customers' prefix based on the agreement. Telecom is working with them.
China Unicom reponse:
CU will recover the routing for HKG and TYO CTGnet within 2 weeks.


The provider CU said the whitelist will be took effect in two weeks.
HKG EB customers,

DMIT is now bringing direct routing back for HKG.EB network profile. Incl those Lite transition instances.

Besides that, DMIT also offers direct China inbound routing EBv2.
From China > DMIT HKG EBv2
- CT: via AS4809 CN2 GIA. (By AS23764)
- CU: via AS4809 CN2 GIA. (By AS23764-AS10099)
- CM: via AS58453 CMI.

From DMIT HKG EBv2 > China CT, CU, CM: CMI AS58453.

Based on the obvious reason, the costs of CMI is sky rocket. DMIT has to revise the routing to ensure profitability, stability and prevent overselling.

For the current customers:
Whatever you order, you can keep it and keep renewing.
The inbound routing (CN->DMIT) will not be changed or routed to CN2GIA.

=====
Existing customer transition plan:
Contact us by ticket.

- From EB(Transition from Lite, no version suffix) : Upgrade with 15% discount.
HKG-EB-UPGRADE-TO-V2-15OFF-RECUR

- From EBv2(Ordered before Aug 1, 2024): Upgrade for free to the same package in v2
=====
New order discount:
15% OFF, with annual payment.
HKG-EB-V2-ANNUALLY-15OFF-RECUR

=====
The new EBv2 benefits:
- China routing guaranteed.
- CT CU via CN2 inbound.
Due to heavy packet loss between CTGnet and CUG; we have removed the AS4837 <> AS23764 announcement in temporary.

DMIT is working on it to find the best solutions.
HKG EB:
Temporary detour China via TYO; reroute back in next 72 hours.
LAX.Pro & LAX.EB

From China Telecom Group Beijing:

China Unicom now confirms they will not accept any China Telecom CN2 international routing incl. customers.

This will impact all CN2 customers, including existing, permanently.
CT will peer CU overseas to solve this.

=====
DMIT experience and plan:

As everyone sees in HK and TY, the peer between AS4809/AS23764 and AS10099 is congested.

DMIT will access China Unicom in HK, TY, and LA to improve the network quality for China Unicom customers.

=====
DMIT observed network packet loss for China Unicom; it was caused by the above reason.

Since LAX.Pro is CN2 GIA guaranteed; and LAX.EB is CMIN2 guaranteed;

DMIT wasn’t planning to use any other networks on the above network profiles.

Based on the current situation, at least we will bring China Unicom access for inbound direction. (CU > DMIT.)

We will keep you posted.
/var/log/DMIT-NOC.log pinned «LAX.Pro & LAX.EB From China Telecom Group Beijing: China Unicom now confirms they will not accept any China Telecom CN2 international routing incl. customers. This will impact all CN2 customers, including existing, permanently. CT will peer CU overseas…»
/var/log/DMIT-NOC.log
LAX.Pro & LAX.EB From China Telecom Group Beijing: China Unicom now confirms they will not accept any China Telecom CN2 international routing incl. customers. This will impact all CN2 customers, including existing, permanently. CT will peer CU overseas…
There is no impact on return routing from DMIT -> China.

The LAX.Pro will keep using 100% CN2 GIA without any change; (From DMIT -> China.)

The LAX.EB will still use 100% CMIN2 without any change. (From DMIT -> China.)
Scheduled maintenance

Location: All HKG servers (Except Alpha Test new VMs and nodes)

Time: August 27, 2024 to September 1, 2024

Duration:
- Estimated 30 minutes for each VM;
- Estimated 2 hours for each node.

Impact:
- Server reboot;
- Spec upgrade;
- May lead server key change (due to hardware key may change.)

Content:
Move all the current client VMs from Ceph to the new clustering storage system.
Performance improving and VM spec upgrade.

Please Backup your data and ensure Cloud-init and QEMU GUEST AGENT is working.