Automated data Collection
What is automated data collection?
To build high quality AI models, or to build rich and consistent sources of external data for insights & decision-making – data collection from various websites, apps and social media is often very important. It’s usually done through setting up automated web/app scraping algorithms and we work closely with our clients to identify the most relevant and feasible sources of data points to scrape from.
Tools we use
Sample case study
We have built a demo dashboard that displays hourly-updated information about the prices, trends, news and social media sentiment of the top 10 crypto-currencies in the world. To build this dashboard, we have set up automated scraping mechanisms from two different websites for prices & trends, another website for news and Twitter for analyzing the sentiment of tweets about those crypto-currencies and accordingly built a scoring system for Buy/Hold/Sell recommendations (for top 3 currencies).
Sample Dashboard Link
