Skip to content

Latest commit

 

History

16 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Javascript Crawler example

This project is an example of how to use cheerio js for making a crawler to get the information of a page and proccess it.

Getting Started

Download the project if it doesn't appear in your machine the nodes_modules folder run npm install.

When you are done for using the crawler you should import it as in the example folder and call the crawler method setting the max number of entries and the URL. To run the example write in the command line: node example/crawlerRunExample.js

Test

For this example we use mocha to test the application To run a test is only neccesary to run in the main folder: npm test

Prerequisites

node js cheerio js

End with an example of getting some data out of the system or using it for a little demo

Contributing

When contributing to this repository, please first discuss the change you wish to make via issue, email, or any other method with the owners of this repository before making a change.

Please note we have a code of conduct, please follow it in all your interactions with the project.

Pull Request Process

  1. Ensure any install or build dependencies are removed before the end of the layer when doing a build.
  2. Update the README.md with details of changes to the interface, this includes new environment variables, exposed ports, useful file locations and container parameters.
  3. Increase the version numbers in any examples files and the README.md to the new version that this Pull Request would represent. The versioning scheme we use is SemVer.
  4. You may merge the Pull Request in once you have the sign-off of two other developers, or if you do not have permission to do that, you may request the second reviewer to merge it for you.

For more details please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.

Author

  • David Proaño - Initial work -

License

This project is licensed under the MIT License - see the LICENSE.md file for details

Acknowledgments

  • This was written for stack builder code challenge

About

Web Crawler using Javascript library called cheerio

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages