Local loop vendor for TYO Pro schedule maintenance

Start Date and Time: Wed, 18 Jan 2023 10:00:00 UTC
End Date and Time: Wed, 18 Jan 2023 19:00:00 UTC

Incident report:
Time frame: recent 24hrs.
Location: Los Angeles
Event: Observed null route on some Internet destinations.
Reason: Cogent port flapped, which caused FIB/RIB to be refreshed times. The unstable RIB routeing situation leads to a FIB ASIC writing error.

The routing has already recovered 8 hrs ago. The cogent route has been temporarily suspended. We’ll try to reactivate the Cogent session later. The route suppression on the Transit session has been configured.

All SJC and most LAX plans (starting with pockets) will not be suspended after traffic exhaustion now.

The rate limit will apply when out of traffic. The rate limit will be automatically removed on the billing date.

If your service have already been suspended, please send us a ticket to cancel the suspension.

If you feel that the network of your VM is very slow, please check if the traffic is exhausted before sending a ticket.

DMIT now accepts transfer reset requests

Previously we required you to upgrade your product to remove the suspension when your service is running out of transfer.

Now we will only limit your bandwidth, rather than service suspension.
If you want to unrestrict bandwidth of your data exhausted service, you can request a traffic reset.
When the traffic has been reset, the bandwidth limit will be restored.

(Coming to HKG/TYO soon, only available for SJC/LAX now.)

Self service is now avaliable.

Please be aware:
This action will deduct the equivalent monthly fee directly from your credit. This deduction is irreversible.

The fee is calculated as the following formula:
Recurring Payment Amount / Payment Cycle

If you pay monthly: The deduction is for the actual cost you paid.
Quarterly payments: Payment amount / 3.0; round to 2 decimal.

DMIT increased the granularity of the transfer statistics, during this we found some problems in the traffic statistics.

This is to quickly apply the rate limit after the transfer runs out or reset.

When we updated the code, we used >= instead of > as the last sync time comparison.

This leads to the traffic at the last time point be counted multiple times for each sync time.

Solution: We reset all transfer statistics and restored all suspensions due to transfer runs out. Please contact us if your VM is still in suspension.

We’ve already working on the network issue in Tokyo Pro.

CTGnet response they already fix it, but we found it’s not.

There is no much detail we could offer right now.

For TYO.Pro:

We are still working hard to communicate with China Telecom; we will update here as soon as there is progress.

Chine Telecom is still working on this.

This network fault is caused by China Telecom. There is a network issue on the CTGnet device.

Fault 1: The return routing should be CN2 instead of AS4134.

Fault 2: TCP packet loss.

===
DMIT is currently working with China Telecom for restore this service.

Once the service has been restored, we will offer SLA compensation.

Please test the TYO Pro.

CT responds circuit backs to normal. We confirmed this situation based our general diagnosis.

Submit / reply to the ticket ASAP if you still have problems.

We are still following up with CTGnet for incident investigation and report;
SLA compensation detail will be posted here within 2 weeks.

TYO Pro RFO (Reason of Outage) From CTGnet:

Quote:
> hardware fault, and the circuit was restored after manufacturer urgent fixed it.


DMIT will issue SLA compensation for all active orders placed before Feb 8, 2023, for TYO Pro. Please wait for more detail.

We will issue a 7-day equivalent credit to your account.

Please contact us via ticket. In order to process faster, you could add [TYO SLA] to the front of the title. This is optional.

DMIT.io maintenance; ETA 2hr

Extend for 2hr;

The maintenance has complete 2hrs ago;
We've improved the performance of control panel.
Please let us know if you found any error or hard-to-use case in this new control panel.

Thanks for assistance.

DMIT is now support PTR record update;

For IPv6, we also support /64 PTR wildcard record;
But the more specific record for IPv6 will not be supported.

PTR update can be accessed by click the change hostname icon on the right side of your hostname.

The AUP will be also appied to PTR.
DMIT does not support Dest. TCP 25 outbound access.

The snapshot feature has become available in LAX.
Every LAX Pro instance has 1 quota; sPro has 2 quotas.
The extra snapshot upgrade and selection on order will be available soon.

This feature will become available for SJC next, then HKG, last is TYO.

SJC is out of hardware resources.

The new SSD, RAM, and servers are on the way.

1. Two nodes will be rebooted next weekend ( March 17 or 19) for a RAM upgrade.

2. The block storage will be doubled, and the snapshot will be available this weekend (March 10 or 12).

3. Your VM might be cold-migrated (one reboot) without notice to a new node since tight hardware resources.

4. The new instance purchase will be available the next day after the action ( March 11 or 13. ) if the no.2 action is completed on time.

We have to performe emergency reboot for some SJC node. It will be done very soon.