This week, BitMEX has seen a higher-than-normal rate of account takeovers due to accounts and email addresses protected only with a single, reused password across many services. This opens your account up to significant risk if any service you use is compromised, or your email is compromised. Please be very careful with your BitMEX account and follow these steps to stay safe:
If you are locked out of your account, please contact Support. You may have already received an email from our administrators.
This post is part of a new weekly series of status updates on changes to the BitMEX platform, encompassing not just our backend development work, but new products, article updates, and features.
Last week was extremely busy! BitMEX’s engineering team is expanding rapidly while we face new scaling challenges daily. We know users demand better performance than we are delivering, and fixing this issue is our top priority.
About 13:00 UTC today, the BitMEX platform sustained a record amount of traffic, both in orders and in number of realtime subscriptions. This traffic caused our proxies’ network traffic to be throttled on our cloud host, which caused data streams to back up. Those data streams eventually backed up enough that they caused a cascade of website users to request new data images, which was a volume of traffic large enough to render the site unusable.
We recovered the platform by temporarily disabling trading, reprovisioning the effected services, and restarting trading. Performance remained sluggish for a few hours afterward, but we have successfully scaled one of the two main systems responsible for the slowdown. Our readings show socket latency well below the 24hr average at the time of writing.
The second system will be migrated shortly and will mitigate this problem going forward. We are still experiencing slowdowns on the engine layer that will result in the dreaded “Overload” messages for many users despite the above scaling. We are very aware of the issue and have a team dedicated to solving this problem as quickly as possible. The solution in progress involves rearchitecting certain systems integral to BitMEX operation, so extensive planning and testing is in progress. We will update you once this work is complete.
In other news, a number of major updates to the frontend have hit, including a new popout chat box. Some users may have stuck caches on the chart due to an upgrade. If you are seeing this, please full-screen the chart, then close the fullscreen window. If that doesn’t work, please clear your browser cache.
BitMEX completed the sale of all Bitcoin Cash (BCH) held on behalf of our users. Bitcoin Cash sale details:
Note: A number of users received an email with an incorrect value in the subject line. The body of the email contains the correct credit. You can verify your credit at https://www.bitmex.com/app/wallet, where this transaction will be listed as a
The Insurance Fund was credited with 120.5321631 XBT due to its holdings of Bitcoin Cash.
Tezzies currently are not tradable on Bittrex, Kraken, or Poloniex. Therefore, as specified by the Tezos Series Guide, the BitMEX Tezos/Bitcoin 29 December 2017 futures contract, XTZZ17, will settle at the ICO price of 0.0002 XBT.