SOLUTION

  • To get this project done in a timely manner, we divided the development team into two groups, working in parallel. Group A worked on the UiPath automation script/bot that would scrape the data from the web and send it to the back-end while Group B developed the backend service, APIs and the web based dashboard using Java & Spring framework.
  • As it was a Single Page Application (SPA), the front end was developed using Angular JS, and used Angular Material and Bootstrap components. This gave the appearance of a modern site with impressive styles and animations.
  • In cases where the URL themselves were dynamic, we overcame the challenge presented by analyzing the sites over a period of time and identified the varying attributes affixed to the URL (for example, current day/month/year) to nail the target website url to scrape from.
  • To present the information on the dashboard using charts/graphs, we rendered the data in 8-10 different types of charts using Chart.js, a robust, reliable, and Open Source library. The type of chart presented was determined based on the type of data and its frequency.
  • Our team deployed the complete system on an AWS EC2 Windows instance and had the client test it for a week to ensure that the RPA bot was collecting the right data for the whole week. That same data was then rendered on the dashboard.

The application is currently live and available here and accessible only to users with the right credentials.

BENEFITS

  • The solution we developed eliminated 16 hours of daily monotonous work for 2 FT employees in Singapore, which amounted to ~ US $50,000 in aggregate annual savings.
  • Because of this RPA solution, decision makers were able to access this information in real time irrespective of office hours
  • The automatic trigger notifications we added for threshold breaches helped the client make proactive and informed purchasing decisions well in advance, thus saving them at least 20% in material costs in some cases.
  • Lack of a need for manual intervention improved the data accuracy by 40%.
  • Employee productivity and morale increased as they could focus on their core function instead of performing manual and monotonous tasks throughout the day.