Man pages for burtonlueth/webPrices
Screen scraping for collecting wholesale product pricing on web

hd_add_main_urlPaste the main page url for homedepot.com to a character...
hd_build_multi_page_linksConstruct the urls for the multiple return pages for a given...
hd_catalog_scrapeGet product and price details for all products in a section...
hd_find_category_from_sitemapUse a string to search product categories on home depot's...
hd_get_product_linksScrape all product urls from a catalog page on HD
hd_product_modelScrape and format model number for a given product from HD...
hd_product_priceScrape and format price from HD product page
hd_product_specsScrape and format product specifications from a product's web...
hd_tidy_priceGet product and price details from HD web page in a tidy...
hd_tidy_scrapeGet product and price details for a list of product urls on...
next_pageExtract the max page number from bottom of product catalog...
scrape_loopLoop a given function through a list of links and store data...
slitSplit a string (e.g. of a url) to extract parts between a...
burtonlueth/webPrices documentation built on May 13, 2019, 8:47 a.m.