A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Repository Index
47,133 repositories indexed
1–3 of 3 · Most stars
Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.
Uses parselets and rwget to generate csv files from websites