2025-10-13
We are aware of the network outage and are investigating the issue.
[22:07 PDT] Ryan arrived at the Fremont datacenter.
[01:31 PDT] FMT2 technician located faulty Ethernet crimp on their side...
[04:00 PDT] Customer instances should be online by 10:00 AM.
[10:22 PDT] Instances are back online. Customers will be emailed later today.
2025-09-03
Everything is back online. We appreciate your patience.
A more detailed write-up will be published in the updates section.
(2025-10-13: sorry about the delay...
a more detailed write-up beyond our initial
email summary is still coming.)
2025-08-31 We are still in the process of migrating cabinets to accommodate increased power consumption and network demands. Apologies for the downtime. We are working as quickly as possible to get everything back online.
Tuesday morning is a safe estimate, but ideally service will be restored sooner. For those who are curious: we will publish a post-mortem once everything is resolved. Please reach out via email if you have any questions.
2022-06-15
Hypervisors #3 and #4 experienced power loss. Downtime: ~15 minutes.
Still waiting on a post-mortem from the Sacramento datacenter.
UPDATE: There
was a problem with a PDU, it
was replaced and the 2 servers
were brought back online.
2022-02-12
Hypervisors #1 through #4 are experiencing a network outage. We are working
with the datacenter to resolve the issue. All VMs should still be powered on.
UPDATE: Resolved around 11:20 AM.
2021-11-22
Hypervisor #2 is experiencing issues. Looking into it.
UPDATE: Resolved.
2020-02-21
Datacenter reported network disruptions from 9 AM to 12 PM.
There is a systemd service hosting iperf3 for users to test the network speeds.
# Notes: # By default, iperf3 measures upload speed (you --> datacenter). # Use the -R flag to measure download speed (datacenter --> you). # # Use -4 and -6 flags to force IPv4 or IPv6 respectively. $ iperf3 -R -c iperf3.zfs.rent Connecting to host iperf3.zfs.rent, port 5201 Reverse mode, remote host iperf3.zfs.rent is sending [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 107 MBytes 900 Mbits/sec [ 5] 1.00-2.00 sec 109 MBytes 918 Mbits/sec [ 5] 2.00-3.00 sec 104 MBytes 875 Mbits/sec [ 5] 3.00-4.00 sec 109 MBytes 915 Mbits/sec [ 5] 4.00-5.00 sec 109 MBytes 917 Mbits/sec [ 5] 5.00-6.00 sec 109 MBytes 912 Mbits/sec [ 5] 6.00-7.00 sec 109 MBytes 917 Mbits/sec [ 5] 7.00-8.00 sec 109 MBytes 916 Mbits/sec [ 5] 8.00-9.00 sec 98.3 MBytes 825 Mbits/sec [ 5] 9.00-10.00 sec 104 MBytes 874 Mbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.02 sec 1.05 GBytes 897 Mbits/sec 115 sender [ 5] 0.00-10.00 sec 1.04 GBytes 897 Mbits/sec receiver iperf Done.
Caveats: