Challenge, approach, and impact

• Hard Overbudgeting

  For a few years in a row, the client struggled with the burden of skyrocketing infrastructure charges caused by imperfect product architecture. The platform that was initially rushed into development to test hypotheses and attract early users unexpectedly evolved into a long-term commitment even though it wasn't ready for this.

• Unscalable Functionality

  Despite data mining being a big part of the product core, its functionality was built in a non-scalable manner. The absence of parallel processing, along with deep-first crawl and imbalanced web scraping, posed challenges to both product expansion and infrastructure enhancement.

• High Commitments

  With 50K users relying on stable access to real-time data daily, the client is steadfast in its commitment to providing seamless services and top-notch user experience. Fully aware that even minor errors or interruptions could result in critical data loss, the client wanted to reduce the frequency of issues and downtime to an absolute minimum.