Q. Where can I find large datasets open to the public?
A.
– Cross-disciplinary data repositories, data collections and data search engines:
- https://www.kaggle.com/datasets
- http://www.assetmacro.com
- http://usgovxml.com
- http://aws.amazon.com/datasets
- http://databib.org
- http://datacite.org
- http://figshare.com
- http://linkeddata.org
- http://reddit.com/r/datasets
- http://thewebminer.com/
- http://thedatahub.org alias http://ckan.net
- http://quandl.com
- http://www.growmeme.com/overview
- http://www.kdnuggets.com/datasets/index.html
- http://enigma.io
- http://www.ufindthem.com/
- http://NetworkRepository.com
- http://MLvis.com
- http://www.growmeme.com/overview
- http://data.opendatasoft.com
- http://gdeltproject.org/data.html
__________________________
– Single datasets and data repositories
1- http://archive.ics.uci.edu/ml/
2- http://crawdad.org/
3- http://data.austintexas.gov
4- http://data.cityofchicago.org
5- http://data.govloop.com
6- http://data.gov.uk/
7- http://data.gov.in
8- http://data.medicare.gov
9- http://data.seattle.gov
10- http://data.sfgov.org
11- http://data.sunlightlabs.com
12- https://datamarket.azure.com/
13- http://developer.yahoo.com/geo/g…
14- http://econ.worldbank.org/datasets
15- http://en.wikipedia.org/wiki/Wik…
16- http://factfinder.census.gov/ser…
17- http://ftp.ncbi.nih.gov/
18- http://gettingpastgo.socrata.com
19- http://googleresearch.blogspot.c...
20- http://books.google.com/ngrams/
21- http://medihal.archives-ouvertes.fr
22- http://public.resource.org/
23- http://rechercheisidore.fr
24- http://snap.stanford.edu/data/in…
25- http://timetric.com/public-data/
26- https://wist.echo.nasa.gov/~wist…
27- http://www2.jpl.nasa.gov/srtm
28- http://www.archives.gov/research…
29- http://www.bls.gov/
30- http://www.crunchbase.com/
31- http://www.dartmouthatlas.org/
32- http://www.data.gov/
33- http://www.datakc.org
34- http://dbpedia.org
35- http://www.delicious.com/jbaldwi…
36- http://www.faa.gov/data_research/
37- http://www.factual.com/
38- http://research.stlouisfed.org/f…
39- http://www.freebase.com/
40- http://www.google.com/publicdata…
41- http://www.guardian.co.uk/news/d…
42- http://www.infochimps.com
43- http://www.kaggle.com/
44- http://build.kiva.org/
45- http://www.nationalarchives.gov.…
46- http://www.nyc.gov/html/datamine…
47- http://www.ordnancesurvey.co.uk/…
48- http://www.philwhln.com/how-to-g…
49- http://www.imdb.com/interfaces
50- http://imat-relpred.yandex.ru/en…
51- http://www.dados.gov.pt/pt/catal…
52- http://knoema.com
53- http://daten.berlin.de/
54- http://www.qunb.com
55- http://databib.org/
56- http://datacite.org/
57- http://data.reegle.info/
58- http://data.wien.gv.at/
59- http://data.gov.bc.ca
60- https://pslcdatashop.web.cmu.edu/
61- http://www.icpsr.umich.edu/icpsrweb/CPES/ – Collaborative
62- http://www.dati.gov.it
63- http://dati.trentino.it
64- http://www.databagg.com/
65- http://networkrepository.com
66- http://www.grid.unep.ch/index.php?lang=en
_______
Source : Quora
Contributions from group members:
1- http://academictorrents.com/
By Hatem Kotb
Below are some of the links I found that contain data sets for those who want to practice. Some of them are public city data sets filtered by type (Education, Health, Transport…etc.)
- http://open.canada.ca/en
- http://www.eea.europa.eu/data-and-maps/
- http://homepage.data-planet.com/
- https://inventory.data.gov/dataset
- http://www.google.com/publicdata/directory
- http://www.europeandataportal.eu/
- https://nycopendata.socrata.com/
- https://www.quandl.com/
- https://www.quora.com/Where-can-I-find-large-datasets-open-…
- https://www.reddit.com/r/datasets
- https://data.sfgov.org/
- https://archive.ics.uci.edu/ml/datasets.html
- https://data.gov.uk/
- http://www.data.gov/education/
- http://www.data.gov/
- http://www.liquidasset.com/winedata.html
- http://finance.yahoo.com/q/hp?s=YHOO
- http://toddwschneider.com/…/analyzing-1-1-billion-nyc-taxi…/
- http://wiki.dbpedia.org/Datasets
- http://archive.ics.uci.edu/ml/datasets.html
- http://support.minitab.com/en-us/datasets/
- http://apps.who.int/gho/data/node.main
- http://datasociety.co/data/
- https://data.cityofchicago.org/…/Crimes-2001-to-p…/ijzp-q8t2
- http://www.baseball-reference.com/
- https://crudata.uea.ac.uk/cru/data/temperature/
- http://www.esrl.noaa.gov/gmd/ccgg/data-products.html
- http://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2011038
Posted By : Mohamed Abuelanin

