0 |
Strava is the social network for athletes. The data that can be extracted include: Activites, Athletes, Clubs, Gears, Routes, SegmentEfforts, Segments, Streams, Uploads, Models |
The default rate limit allows 200 requests every 15 minutes, with up to 2,000 requests per day |
https://www.strava.com/api/v3/ |
Check how much data you can retrieve. My guess this is only to extract your own data or data from users who authorize you |
1 |
The data that can be retrieved are large amounts of statistical data to analyze anything from income to education and sustainability. The API is from Danmarks Statistik (Danish Statistics). |
There doesn’t seem to be any paid version and no rate limit. However they do specify a limit on the amount of data that can be extracted at once, but that can possibly be changed in the future if needed. Additionally it seems the API can run in a console version on the website platform. |
https://api.statbank.dk/v1/tables |
Great resource! Be mindful that census data does not capture individual behaviour, but rather aggregated data. Anyways still a goldmine. |
2 |
From the strava API you can get alot of data like: Activities, Segments, Athletes, Routes, Gear, Clubs |
The rate limits are 200 per 15 minutes and 2.000 per day |
www.strava.com/api/v3 |
Check how much data you can retrieve. My guess this is only to extract your own data or data from users who authorize you |
3 |
Strava’s API provides data about physical activities as well as social relations, everything from route track to associated running club or segment information. note : need to send an application |
200 pr. 15 min and 2000 pr. day |
https://www.strava.com/api/v3/athlete |
Check how much data you can retrieve. My guess this is only to extract your own data or data from users who authorize you |
4 |
Using the Twitter API you can gather ready made data observational data in the form of tweets, users, and followers. |
Low rate-limit access (Exact number of requests is not stated) |
https://api.twitter.com/1.1 |
This API used to be a fantastic resource. Unfortunately it is now pretty useless, unless one can pay a lot of money. Here are the rate limits: https://developer.twitter.com/en/docs/twitter-api/rate-limits#v2-limits-free |
5 |
ArxivAPI - You can get papers and all documents realted to science, engineering, search, discovery… |
one request every three seconds and limit requests to a single connection at a time |
https://info.arxiv.org/help/api/index.html |
Great resource! |
6 |
Reddit API: provides insight into public opinion, trends, and sentiments. We can gather data about popular posts, comments, and interactions on this social media. |
60 requests per minute |
https://www.reddit.com/dev/api/ |
Rate limits are quite low with the latest version of the API. If you are fine working with old data (before 2023), you can probably find some Reddit dumps online collected via the pushshift API |
7 |
The API can be used to gather all kinds of information from the q/a website Quora. |
There are no explicit limits, although quora will probably limit you, if you have too many requests. |
https://github.com/DiptoDas8/quoras |
This is an automatic scraper (not an API). Looks interesting, may be not straightforward to use. |
8 |
This is data from an American survey which is about topics of social, economic, demographic, and housing characteristics of the U.S. population. In total, there are 31.000 variables The requirement for the survey is that the palce have to have a populations of 65,000 peoples. |
500 calls per day, else you have to have a key. |
https://www.census.gov/data/developers/data-sets/acs-1year.html?fbclid=IwAR1prZ1uBiHSp4d2b34P0pinq95RqjaJlNwjRudgK-Jmt7bitxwGVLoP5Vc |
Great resource! Be mindful that census data generally does not capture individual behaviour, but rather aggregated data. Anyways it’s still a goldmine. |
9 |
Spotify API: Albums, tracks, playlists, search, categories, users. |
It has rate limits but it doesent seem to be specified exactly. |
https://developer.spotify.com/documentation/web-api |
Great resource! |
10 |
Social, economic, demographic, and housing characteristics of the U.S. population |
“You can include up to 50 variables in a single API query and can make up to 500 queries per IP address per day. More than 500 queries per IP address per day requires that you register for a Census key.” |
https://www.census.gov/data/developers/data-sets/acs-1year.html |
Great resource! Be mindful that census data generally does not capture individual behaviour, but rather aggregated data. Anyways it’s still a goldmine. |
11 |
social, economic, demographic, and housing characteristics of the U.S. population. |
500 queries per IP address per day, more will require registration for a Census key. |
https://www.census.gov/data/developers/data-sets/acs-1year.html |
Great resource! Be mindful that census data generally does not capture individual behaviour, but rather aggregated data. Anyways it’s still a goldmine. |
12 |
ChatGPT API: an access the capabilities of the chatbot and integrate them into its own program. - generate sensible answers to questions or even practice dialogues |
number of requests per minute |
https://platform.openai.com/docs/introduction |
Great resource! ChatGPT has ingested a lot of data generated by humans, so it can provide insights on human behaviour and society. Always be mindful of the limits: hallucinations, biases, lack of control on the origin of the data, etc. |
13 |
Information about social media, what time and day some platform is mostly used maybe |
200 API requests |
https://www.ayrshare.com/ |
It seems more a resource to share data rather than to gather data |
14 |
American household statistics, unemployment rates, Inflation and prices, productivity, Spending and time use, Workplace injuries. |
Not specified. |
https://www.bls.gov/developers/api_python.htm#python2 |
Looks like a great resource! Be mindful that census data generally does not capture individual behaviour, but rather aggregated data. Anyways it’s still a goldmine. |
15 |
One Call API 3.0 is a powerful and affordable weather service that allows you to retrieve current, historical, short-term and long-term forecasted weather data and severe weather alerts, making it the ideal integration for a wide range of use cases. One Call API 3.0 contains the following data: Minute forecast for 1 hour Hourly forecast for 48 hours Daily forecast for 8 days Weather data for 40+ years history archive and 4 days ahead forecast by timestamp Daily aggregated weather data for 40+ years historical archive and 1,5 year forecast ahead National weather alerts One Call API 3.0 is based on the proprietary OpenWeather Model and is updated every 10 minutes. |
Free: 60 calls/minute for max 1,000,000 calls/month If you need more information there are different pricing options. |
https://openweathermap.org/api |
Great resource to get weather data, that can be integrated with other data to capture aspects of behaviour and society (e.g. attitude towards extreme climate events, climate change, etc) |
16 |
Contains data from various surveys from US Census Bureaus, associated with geographic bounday areas |
50 variables per api query, up to 500 per day per ip. For more request a key |
https://www.census.gov/data/developers/guidance/api-user-guide.Overview.html#list-tab-559651575 |
Great resource! Be mindful that census data generally does not capture individual behaviour, but rather aggregated data. Anyways it’s still a goldmine. |
17 |
Spotify API: Contains metadata for songs, as well as users if they authorize it |
Not explicitly stated, based on calls in a 30 second rolling window |
https://developer.spotify.com/documentation/web-api |
Great resource! |
18 |
Nationalize.io is a very simple API that uses a machine learning model to predict the nationality of a given surname. Therefore, from this API you can gather only the predicted nationality of people and the probability of the prediction. This can be used in tandem with https://agify.io/ and https://genderize.io/ to predict age and gender for the same name. It’s also possible to search for up to 10 names at a time. |
The free version can be used for up to 100 names per day. |
The API can be found at https://nationalize.io/, where the only parameter is surname, making the API endpoint https://api.nationalize.io/?name=your_query |
Interesting! Especially used in combination with other data to estimate nationality from names. There can be some biases though. |
19 |
You are able to gather image data types (e.g. png, jpg), video data types (mp4, gif). |
Depends on what features are being used in the API. Here is a reference for the rate limits: https://developers.pinterest.com/docs/reference/ratelimits/ |
https://developers.pinterest.com/docs/api/v5/ |
Could be a nice resource. Quickly skimmingthrough it, it seems like this may be more relevant to advertisers to check their own ads. |
20 |
Contains various APIs both free and premium, for various things (e.g. job search, food nutrients) |
Varying by endpoint |
https://rapidapi.com/hub |
Could be a great resource! |
21 |
Streetview imagery, objects (signs, benches, lights), coordinates. |
Streetview imagery hhas rate limit of 50.000 per min. per app. Features are limited to 50.000 per day. |
https://www.mapillary.com/developer/api-documentation |
A great resource for open source street-image data |