Skip to content

Scraping Research #3

Description

@selvarajuv

DUE 09/22 11:59 PM

Identify what scraping tools we can use the extract external factors
Identify what external data sources are available to us

Considerations:

  • How can we stay compliant with TOS (rate limiting, ect...)
  • Paid vs Free?
  • Are there sources that have APIs we can access?
  • Live updates (time-sensitive)

Acceptance criteria:

  • Documentation of at least three scraping tools and their pros and cons
  • Documentation of at least three options for each external factor (weather, events, competitor pricing, flights)
  • Test scraping ability through a Jupyter notebook or simple file
  • Be ready to present findings next meeting (09/23)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

featureIntroduces a new and complete feature

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions