Datasets

Kaggle competition to train a text-based geolocation model with a dataset of 500k annotated texts from across the world 🌎📍

2023-01-27T14:08:17+00:00

You can check out the Kaggle competition: https://www.kaggle.com/competitions/text-based-geolocation/

Also, our Github is here if you need it: https://github.com/1712n/yachay-public/tree/master/conf_geotagging_model

submitted by /u/yachay_ai
[link] [comments]

Dataset for Pests/Insect - Whitefly to train GAN

2023-01-27T17:42:56+00:00

I aim to implement an object detection of pest: Whitefly in open-fields: leafs in the field. Since to dataset currently exists, and to create one is out of the scope (its hard to pollute a field so as to take data), I will artificially train a pipeline for that cause. Since >5k insects must be artificially added to current leaf datasets, I would like to train a GAN so as to generate pests whiteflies. However I dont seem to find a dataset and google search and crop is tedious and laborious.

submitted by /u/giakou4
[link] [comments]

Understanding Panel Data calculation

2023-01-27T11:10:02+00:00

I am a total beginner to Panel Data and I've always been bad with Maths, Economics, Statistics etc. So I would appreciate any help I get!

I need to build a Panel Data. I have Data (1) with Country, Year (in total 18 yrs), Control Variables and the Dependent and Independent Variable. I needed additional Control Variables and used other Databanks to get the Data (2) such as GDP, Population, Education. The Control Variables in Data (1) are in % e.g., 0.28. The Control Variables in Data (2) are like this: GDP e.g., 1260.61, Population e.g., 22645130, and Education e.g. 42.61.

I think bc my Control Variables in Data (1) are in % I need to also do that for my Control Variables in Data (2), right? And I guess Education is already shown as %. Meaning I need the percentage of GDP and Population. I only know that Data (1) is a National-level Dataset, does that mean I create the mean of GDP by dividing each GDP per year with the total years?

Or Is that something that does not need to be done to GDP and Population since these are variables on Country level?

submitted by /u/5Stars_everytime
[link] [comments]

Dataset for predicting the amount of carbon in soil?

2023-01-27T02:57:48+00:00

I'm looking for a dataset that would allow me to train a model to detect the amount of carbon in soil. One issue that I'm running into with the sources I've found (mostly from ISRIC) is that they deal with images and coordinates, whereas what I'm looking for is flat-files (simple tabular data) and (latitude-longitude). I understand that I can just convert latitude-longitude to coordinates and guesstimate the bounding boxes of the coordinates, but in terms of the other requirement I'm not sure.

I'm looking for data on the continental united states

submitted by /u/iamquah
[link] [comments]

Looking for data sets to help categorize IP Addresses

2023-01-27T04:09:05+00:00

Are there any public source datasets that provide information on whether an IP is owned by a public entity or not? E.g. a dataset of IPs commonly used by libraries?

I’m aware of the datasets that give location, ISP, and DSN.

submitted by /u/Nerdy_birdy747
[link] [comments]

National Database of Childcare Prices

2023-01-26T05:23:23+00:00

submitted by /u/brianckeegan
[link] [comments]

I'm looking for a time-series dataset for classification with events

2023-01-26T17:00:31+00:00

hello, I'm looking for a time series dataset for classification, however, which contains some event-related labels, eg. time step 14 to 20 represents z event, does any of you have knowledge about one? Thanks :)

submitted by /u/Tokemon66
[link] [comments]

"The Semantic Scholar Open Data Platform", Kinney et al 2023 ("200M+ papers, 80M+ authors, 550M+ paper-authorship edges, & 2.4B+ citation edges")

2023-01-26T03:04:09+00:00

submitted by /u/gwern
[link] [comments]

dataset on casual conversations between men and women?

2023-01-26T17:45:30+00:00

i am learning to make a chatbot that can talk to the opposite gender mostly bot being the feminine one here to just have casual conversations and tried to look for a database that has casual conversations between them but found nothing of use

all i could find was movie scripts datasets that wont really work all that well

submitted by /u/neutoreddit
[link] [comments]

China’s Total Outward Direct Investment Flows by Country

2023-01-26T08:56:42+00:00

Hi!

I am trying to find a dataset of China’s Total Outward Direct Investment Flows by Country for conducting a masters thesis research.

As I see from many articles, MOFCOM (Ministry of Commerce People’s Republic of China Foreign Investment Statistics) has been providing these.

However, i cannot find them online anyway (only statistical bulletin that does not show all countries).

Maybe someone in this community knows where to find them?

Looking forward to any guidance!

submitted by /u/BlueApple12
[link] [comments]

I'm looking for landslides images datasets

2023-01-26T05:14:37+00:00

I'm in my final year of Uni and I'm doing a project on landslides detection & prevention.

I'm still in the ideation process and what I want to do is basically a software that gives u all sort of information based on the landslide picture taken and if possible detect how likely a landslide is to happen before it does.

Any of u know where I can find datasets of landslide images? it will be a huge help if it's a before and after images.

Thanks in advance

submitted by /u/Shami2020
[link] [comments]

Lexical similarity of 331 natural languages

2023-01-25T13:40:16+00:00

Wiki on this measure https://en.m.wikipedia.org/wiki/Lexical_similarity#:~:text=In%20linguistics%2C%20lexical%20similarity%20is,there%20are%20no%20common%20words.

submitted by /u/cavedave
[link] [comments]

Datasets with accurate movie revenues and budgets

2023-01-25T19:47:13+00:00

Hi All, I have explored the Tmdb dataset but the data points are quite few and are user entered hence not so accurate. Does anyone know about any datasets which include production and marketing revenues of a movie as well as budget?

submitted by /u/memebaes
[link] [comments]

How to numerically classify a histogram?

2023-01-25T21:05:47+00:00

I am working on car parking data, looking at snapshots of different days for different locations. Some days are 30% full, some days are 50% full, and so on. We have 84 days and 30 locations.

I've made histograms of the busy-ness for each location. Sample histograms. As you can see, they're quite varied in shape and size. I am hoping to have an intuitive way to describe these locations, e.g. 'mostly quiet', 'sometimes busy, sometimes quiet'. But hopefully based on something numerical rather than eyeballing it. I'm finding the median and standard deviation to be an unsatisfying way to describe these. Especially because they are not bell curves.

I'm wondering what classification methods would be suitable?

submitted by /u/monkey_gamer
[link] [comments]

What data can I find on my third-world country?

2023-01-25T17:48:22+00:00

Iraq is a third-world country that hasn't fully integrated into the digital age yet by collecting and publicizing data. I am an aspiring data analyst and wanted to check what data was avaialble for me to work on. All I found were some very general demographic reports by region and other simple and inconsistent data.

Are there any websites/sources that I can pull data of Iraq, and or KRI from?

submitted by /u/seever
[link] [comments]

Instagram dataset needed with images, descriptions and # of likes

2023-01-25T21:14:26+00:00

Looking for Instagram dataset (free or paid)

I need:

postId
description
numberOfLikes
numberOfComments (nice to have)
images (files or direct link to download)

submitted by /u/ValeraT1982
[link] [comments]

Macro data on core countries from 1860 to 1914

2023-01-25T18:54:18+00:00

submitted by /u/cavedave
[link] [comments]

Need help getting a dataset from Baidu

2023-01-25T14:22:29+00:00

Trying to download an underwater dataset but having trouble creating an account in Baidu. SMS verification says it can't process the request.

https://pan.baidu.com/s/1dqB_k6agorQBVVqCda0vjA

password: lsui

Would be really happy if it gets into gdrive or somewhere else. It's just under 500mb. Thank you so much.

submitted by /u/bheek
[link] [comments]

Macroeconomic data on European countries from 1860 to 1914

2023-01-25T08:40:38+00:00

Title. Does anybody here know where can I find macro indicators of countries like Belgium Netherlands Germany Italy Portugal Spain. The core countries responsible for the Scramble for Africa. I want variables like productivity of labor per hour, Total Land rents etc

submitted by /u/idareet60
[link] [comments]

Looking for a many to many string dataset

2023-01-25T04:50:17+00:00

I am looking to replicate a work project for my personal git repository, it was a pretty simple string matching system but it has some interesting wrinkles. For obvious reasons I can't use the data from work so I am hoping to get some help finding a suitable replacement instead of creating a synthetic dataset.

Essentially I'm looking for a many to many string dataset. At work it was matching the names clients use for different insurance companies to what my company uses.

For example a client could have Insurance company A and in our records we would match it to Insurance company 1, 2 and 3. So the one incoming company would have three different matches in our historical records.

For my project this doesn't have to be insurance companies. I was looking at stock listings or names to nickname lists as possible datasets for this project. So far I haven't quite found what I'm looking for.

Any suggestions on possible datasets would be great. Also if I haven't been clear about anything let me know.

submitted by /u/snowbirdnerd
[link] [comments]

Paleoclimate Studies

2023-01-24T22:01:02+00:00

submitted by /u/cavedave
[link] [comments]

Pregnancy Dataset for evaluation of maternal risk

2023-01-24T20:56:15+00:00

I'm working on a project about pregnancy and I need to evaluate the maternal risk during the 9 months, I have searched a lot but can't find, has anyone come across pregnancy datasets or maybe pregnancy cases?

submitted by /u/Hazelnutflavor
[link] [comments]

IoT sensors dataset for a Building/Office space/Smart Home?

2023-01-25T07:45:04+00:00

I am working on a machine learning project where i want to automate the HVAC appliances (ON/OFF) in a BMS system based on certain parameters like temp, time, date, human activity etc.

where can i get HVAC sensors dataset?

submitted by /u/1_--
[link] [comments]

My research is about a certain ifetime distribution , I'm supposed to analyse survival data. And I'm interested in analysing psychiatric disorders, any suitable data sets?

2023-01-24T10:25:28+00:00

The survival data I found in some papers regrading the same distribution of interest are the following: A data set about lifetime of individuals diagnosed with cancer. "7, 35, ...1027, 1047" I'm not sure what does it means, does the numbers represent the days from the diagnosis until death? There is also another dataset of lifetimes of pigs injected with bacterium causing the infection of the disease. And the data set is " 28, 67, ..., 400" I'm not sure what the numbers represent. I want to analyse survival data regarding psychiatric disorders. I found some papers studying genetic relationship and the development of psychiatric disorders. But data set they used is not clear, and the subject seems very complicated and there are different genetics causing the disorder and they also considered environmental causes like trauma and a degree of severity. I'm not sure the subject fits for survival analysis, and how can I apply my distribution to the data and do EDA, they also included a link of a database. But I'm overwhelmed I'm not an expert on this subject but I still want to analyse anything related to psychiatric disorders. Can anyone please help find appropriate survival data set regrading psychiatric disorders ?? Please let me know if you want me to write the whole dataset of the cancer and pigs data and the description included in the paper, to help me find something similar. Thank u in advance

submitted by /u/STATNotes
[link] [comments]

Facebook Ad Library Report for US Advertisers

2023-01-24T18:45:17+00:00

This report shows the number of ads about social issues, elections or politics, and the total amounts spent for those ads, reaching people in the selected country for specified date ranges. For full transparency, Meta reports on all relevant versions of an ad stored in Meta systems, which means numbers in this report may differ slightly from numbers in Meta Ads Manager. The date range is from May 7, 2018 - Jan 21, 2023 .

View Data: https://app.gigasheet.com/spreadsheet/Facebook-Ad-Library-Report-2023-01-21-US-Advertisers-csv/4ab3124a_cdaf_49a3_9543_17e7bbe6cd31?public=true

Source: https://www.facebook.com/ads/library/report/?source=archive-landing-page&country=US

submitted by /u/sheetheadd
[link] [comments]