Kinderkopje - /r/Peloton's Data Collection Project
Statement of intent
This project is an AI-assisted hub for collecting information from r/peloton, UCI.org and other sources (see Sources below) to help create future content for r/peloton. It is built for the r/peloton moderators and is open to anyone.
What it is for:
Race thread generation
One-day, stage, rest-day and mega threads, drafted from the season and race data and ready to paste into Reddit's scheduler.
Race statistics
For example the 5x5 table (the top five of each of the last five editions of a race) and the most likely riders to win.
Team statistics
This year against last year, points haul per month. Per race is next.
Open database
The results collected so far in one SQLite file that anyone can download, with races, names, links and countries. The goal is about five years. Download it on the Data page.
As a side effect we are also building a small open database of cycling results, about five years back, as a single SQLite file that anyone can download. Other cycling statistics sites exist, but the code here is open source (MIT) and the data are publicly published results, credited to their sources.
How it fits together
How to start
- Threads: open a calendar or paste old threads, edit the season, press Generate.
- Collect and Teams and points: drag the capture bookmarks to your bookmarks bar and press them on the UCI DataRide pages you open yourself.
- Races: look up a race: its names, links, the 5x5 and the age statistics, ready to copy.
- Data: save your database as a file, ask it questions in SQL, or search the public dataset once it is published.
How we collect data
- By hand, in a browser. Pages on UCI.org and DataRide are opened by a person, and the capture bookmark only reads what is on screen. The tool does not crawl.
- We deliberately do not scrape FirstCycling. Its terms do not allow automated access, and we respect that. It is listed under Sources to be read by hand. If you want data from it in the database, ask first; we will not work around a refusal or disguise the tool as a browser.
- Wikipedia and Wikidata are read through their public APIs, politely: one request at a time, with pauses.
- Open and credited. Everything collected is kept in a database you can save and inspect, with its sources named.
Sources
About
- Code: github.com/Erlbon/kinderkopje, MIT licence. To report a problem or ask for something to be removed, open an issue.
- Data credits: rankings and results are published by the Union Cycliste Internationale (uci.org, dataride.uci.ch). Team levels and stage tables come from Wikipedia (CC BY-SA 4.0). Race information and old threads are from r/peloton, by their authors.
- Not affiliated with UCI or Reddit.
- Privacy: everything runs in your browser and is kept in a SQLite database there; nothing is uploaded.
v0.1.0 (db55b20)