/var/log/DMIT-NOC.log
4.7K subscribers
189 photos
6 files
117 links
Download Telegram
HKG.Pro

DMIT completed the new vendor connection for HKG Pro and DMIT would like to make the following adjustments for our customers.

TINY:
- 200GB > 400GB (Transfer)
- 0.75 GB > 1.0GB (RAM)
- 10GB > 20GB (SSD)
- 40Mbps > 100Mbps

STARTER:
- 500GB > 800GB (Transfer)
- 20GB > 40GB (SSD)
- 1.5GB > 2.0GB (RAM)
- $69.9 > $79.9 (Keep the price for existing order)

MINI:
- 800GB > 1200GB (Transfer)
- 40GB > 60GB (SSD)
- 100Mbps > 200Mbps
- $109.9 > $119.9 (Keep the price for existing order)

MICRO:
- 1000GB > 1600GB (Transfer)
- 40GB > 80GB (SSD)
- 100Mbps > 200Mbps
- $139.9 > $159.9 (Keep the price for existing order)

MEDIUM:
- 1500GB > 1800GB (Transfer)
- 80GB > 160GB (SSD)

LARGE:
- 2000GB > 2400GB (Transfer)
- 160GB > 240GB (SSD)

GIANT:
- 4000GB > 4800GB (Transfer)
/var/log/DMIT-NOC.log pinned «HKG.Pro DMIT completed the new vendor connection for HKG Pro and DMIT would like to make the following adjustments for our customers. TINY: - 200GB > 400GB (Transfer) - 0.75 GB > 1.0GB (RAM) - 10GB > 20GB (SSD) - 40Mbps > 100Mbps STARTER: - 500GB > 800GB…»
HKG.Pro

Received notification from the vendor that the AS-Path needs to be corrected; after completing the configuration, the BGP session restarted twice which causing the CN2 routing convergence limit to be triggered.

CN2 has route convergence restrictions, CTGnet accepts the route but CN2 does not, resulting in an null route.

It takes 30 minutes to be back to normal.
HKG Update:
- AS10099 finished AS-Path filter update;
- AS2914 finished patching;
- AS2914 - AS4809 direct connection has been recoverd.

TYO Update:
- AS2914 - AS4809 direct connection has been recoverd.
Investigation result of the packet loss for LAX.Pro. Keep you posted.
/var/log/DMIT-NOC.log
Investigation result of the packet loss for LAX.Pro. Keep you posted.
Dear Valued Customer,

Please kindly note that our engineer feedback the services were migrated to an alternate option thus restoring service to a stable state.
Unplanned maintenance
Location: LAX
Restart two hosts to resolve kernel errors.
/var/log/DMIT-NOC.log
The Ceph of LAX has been upgraded to Quincy; The next release should contain the bug fix.
https://docs.ceph.com/en/latest/releases/quincy/#v17-2-6-quincy

os/bluesore: cumulative backport for Onode stuff and more (pr#50048, Igor Fedotov, Adam Kupczyk)

v17.2.6 QUINCY resolved this problem;
After testing, we've update ceph in all locations to V17.2.6.
Possiable failure on AS174 Los Angeles; We saw Internet routes that annouced by Cogent but unable to reach via Cogent.

DMIT rejected Cogent routes to prevent possible null-route on Internet.

We will recover it once Cogent solved the problem.
Planned maintenance
Date: Jun 15-18 2023 Hong Kong Time

Content:
Fix management node issues; install DDoS mitigation facilities, complete installation of new nodes, rebuild old cabinets.

Possible scenarios: Network downgration, VM reboot, Unable to access control panel.
/var/log/DMIT-NOC.log pinned «Planned maintenance Date: Jun 15-18 2023 Hong Kong Time Content: Fix management node issues; install DDoS mitigation facilities, complete installation of new nodes, rebuild old cabinets. Possible scenarios: Network downgration, VM reboot, Unable to access…»
/var/log/DMIT-NOC.log
Planned maintenance Date: Jun 15-18 2023 Hong Kong Time Content: Fix management node issues; install DDoS mitigation facilities, complete installation of new nodes, rebuild old cabinets. Possible scenarios: Network downgration, VM reboot, Unable to access…
We are currently migrating your VM to the new nodes;
There will be less than 10min downtime (avg) for each VM.

Since the old infra has huge difference than the new one; reboot is unpreventable.
We are diagnosing an error on one of the new nodes.
We are working on a glitch on this device; there may be multiple reboots.

10% VMs are affected.
problem solved by remove vhost_net experimental_zcopytx=1
It leads to no log system freeze. No kernel panic, no crash log.
Emergency maintenance for one of Tokyo nodes.
DMIT HKG Pro now has the IPv6 direct connection with China.