Where can I find large datasets open to the public?

Q. Where can I find large datasets open to the public?
A.

– Cross-disciplinary data repositories, data collections and data search engines:

  1. https://www.kaggle.com/datasets
  2. http://www.assetmacro.com
  3. http://usgovxml.com
  4. http://aws.amazon.com/datasets
  5. http://databib.org
  6. http://datacite.org
  7. http://figshare.com
  8. http://linkeddata.org
  9. http://reddit.com/r/datasets
  10. http://thewebminer.com/
  11. http://thedatahub.org alias http://ckan.net
  12. http://quandl.com
  13. http://www.growmeme.com/overview
  14. http://www.kdnuggets.com/datasets/index.html
  15. http://enigma.io
  16. http://www.ufindthem.com/
  17. http://NetworkRepository.com
  18. http://MLvis.com
  19. http://www.growmeme.com/overview
  20. http://data.opendatasoft.com
  21. http://gdeltproject.org/data.html

__________________________

– Single datasets and data repositories

1- http://archive.ics.uci.edu/ml/
2- http://crawdad.org/
3- http://data.austintexas.gov
4- http://data.cityofchicago.org
5- http://data.govloop.com
6- http://data.gov.uk/
7- http://data.gov.in
8- http://data.medicare.gov
9- http://data.seattle.gov
10- http://data.sfgov.org
11- http://data.sunlightlabs.com
12- https://datamarket.azure.com/
13- http://developer.yahoo.com/geo/g
14- http://econ.worldbank.org/datasets
15- http://en.wikipedia.org/wiki/Wik
16- http://factfinder.census.gov/ser
17- http://ftp.ncbi.nih.gov/
18- http://gettingpastgo.socrata.com
19- http://googleresearch.blogspot.c...
20- http://books.google.com/ngrams/
21- http://medihal.archives-ouvertes.fr
22- http://public.resource.org/
23- http://rechercheisidore.fr
24- http://snap.stanford.edu/data/in
25- http://timetric.com/public-data/
26- https://wist.echo.nasa.gov/~wist
27- http://www2.jpl.nasa.gov/srtm
28- http://www.archives.gov/research
29- http://www.bls.gov/
30- http://www.crunchbase.com/
31- http://www.dartmouthatlas.org/
32- http://www.data.gov/
33- http://www.datakc.org
34- http://dbpedia.org
35- http://www.delicious.com/jbaldwi
36- http://www.faa.gov/data_research/
37- http://www.factual.com/
38- http://research.stlouisfed.org/f
39- http://www.freebase.com/
40- http://www.google.com/publicdata
41- http://www.guardian.co.uk/news/d
42- http://www.infochimps.com
43- http://www.kaggle.com/
44- http://build.kiva.org/
45- http://www.nationalarchives.gov.
46- http://www.nyc.gov/html/datamine
47- http://www.ordnancesurvey.co.uk/
48- http://www.philwhln.com/how-to-g
49- http://www.imdb.com/interfaces
50- http://imat-relpred.yandex.ru/en
51- http://www.dados.gov.pt/pt/catal
52- http://knoema.com
53- http://daten.berlin.de/
54- http://www.qunb.com
55- http://databib.org/
56- http://datacite.org/
57- http://data.reegle.info/
58- http://data.wien.gv.at/
59- http://data.gov.bc.ca
60- https://pslcdatashop.web.cmu.edu/
61- http://www.icpsr.umich.edu/icpsrweb/CPES/ – Collaborative 
62- http://www.dati.gov.it
63- http://dati.trentino.it
64- http://www.databagg.com/
65- http://networkrepository.com
66- http://www.grid.unep.ch/index.php?lang=en
_______
Source : Quora

Contributions from group members:
1- http://academictorrents.com/

By Hatem Kotb
Below are some of the links I found that contain data sets for those who want to practice. Some of them are public city data sets filtered by type (Education, Health, Transport…etc.)

  1. http://open.canada.ca/en
  2. http://www.eea.europa.eu/data-and-maps/
  3. http://homepage.data-planet.com/
  4. https://inventory.data.gov/dataset
  5. http://www.google.com/publicdata/directory
  6. http://www.europeandataportal.eu/
  7. https://nycopendata.socrata.com/
  8. https://www.quandl.com/
  9. https://www.quora.com/Where-can-I-find-large-datasets-open-…
  10. https://www.reddit.com/r/datasets
  11. https://data.sfgov.org/
  12. https://archive.ics.uci.edu/ml/datasets.html
  13. https://data.gov.uk/
  14. http://www.data.gov/education/
  15. http://www.data.gov/
  16. http://www.liquidasset.com/winedata.html
  17. http://finance.yahoo.com/q/hp?s=YHOO
  18. http://toddwschneider.com/…/analyzing-1-1-billion-nyc-taxi…/
  19. http://wiki.dbpedia.org/Datasets
  20. http://archive.ics.uci.edu/ml/datasets.html
  21. http://support.minitab.com/en-us/datasets/
  22. http://apps.who.int/gho/data/node.main
  23. http://datasociety.co/data/
  24. https://data.cityofchicago.org/…/Crimes-2001-to-p…/ijzp-q8t2
  25. http://www.baseball-reference.com/
  26. https://crudata.uea.ac.uk/cru/data/temperature/
  27. http://www.esrl.noaa.gov/gmd/ccgg/data-products.html
  28. http://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2011038

#datasets #data

Posted By : Mohamed Abuelanin

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s