Previously we have identified and explained what Crawler, parser, grabber or spider is!
Let's clarify what technical capabilities the crawler can perform. Our crawlers are incredibly smart. They have self-learning abilities.
With pre-built settings the crawler can:
- Collect Price, availability, promo and markdowns.
- Collect Min price, 'buy box,' only new products excluding refurbished (Amazon or eBay).
- Take the price from price collecting websites or product markets.
- Make accurate promo identification like "Present, free shipping, buy in parts, etc."
- The crawler can check the product category and eliminate incorrect entries.
- Collect the product variations, like color or size from drop-down menu.
- The crawler can log into websites as a typical user and collect the prices.
- Eliminate the harm from anti boot systems.
- Collect information that identifies graphical objects.
- Yet it cannot take the information from the graphical object.