this post was submitted on 16 Sep 2023
92 points (95.1% liked)

Canada

7193 readers
487 users here now

What's going on Canada?



Communities


🍁 Meta


πŸ—ΊοΈ Provinces / Territories


πŸ™οΈ Cities / Local Communities


πŸ’ SportsHockey

Football (NFL)

  • List of All Teams: unknown

Football (CFL)

  • List of All Teams: unknown

Baseball

Basketball

Soccer


πŸ’» Universities


πŸ’΅ Finance / Shopping


πŸ—£οΈ Politics


🍁 Social and Culture


Rules

Reminder that the rules for lemmy.ca also apply here. See the sidebar on the homepage:

https://lemmy.ca


founded 3 years ago
MODERATORS
 

It would be nice to be able to bring to light the price gouging that is taking place in Canada with regards to grocery stores.

you are viewing a single comment's thread
view the rest of the comments
[–] danielquinn@lemmy.ca 18 points 1 year ago (1 children)

The project is Open source, so you might be able to leverage it for Canadian data. All you need is:

  • Understanding of the expected format for the project
  • Access to data from Canadian retailers. This can be acquired via APIs (these are usually free) or by scraping their sites.
[–] JohnnyCanuck@lemmy.ca 12 points 1 year ago (1 children)

At the bottom of the chain on mastodon the creator says they use the search APIs of the store websites. I wouldn't have expected those to be easily accessible!

[–] danielquinn@lemmy.ca 4 points 1 year ago

Yeah a lot of chains even have a documented, developer-friendly API. If that's not available though, you can usually figure out the API just by looking at the calls your browser makes when visiting a page. Most sites use a REST API for catalog pages that's then rendered out with JavaScript.

If that doesn't work, then you can usually scrape everything with Selenium. It's a little harder to do, but still quite manageable, though that usually has to be a background job, as it's slow.