Full COVID-19 Dataset for Nigeria Broken Down By State (CSV and PDF)


I recently joined a small project to produce an easily accessible COVID-19 dataset for Nigeria broken down into states.

It all began while I was trying to find COVID-19 datasets for Nigeria broken down state by state, I realised that the only one available was in PDF format which makes it more challenging to extract just the data.

I pitched the idea of a small project to extract the datasets from the PDF to CSV files to the nice folks at NG44 and they graciously agreed to support the project with funds.

To be clear, we are not generating the data per se. That credit goes to the Nigeria Center for Disease Control (NCDC). 

What we are mostly doing is manually extracting the data from the original PDF file format in which they are published into the more useful CSV file format and put it up on github.

Github Link:

Here's the shortlink to the dataset on github: https://bit.ly/covidnigeriadata

About

This dataset contains the official daily data for COVID-19 cases in Nigeria broken down by state. To our knowledge this is the most complete COVID-19 dataset for Nigeria at this time.

Why

We worked on this dataset because as budding data scientists, we couldn't find a suitably up to date and accessible dataset for COVID-19 and Coronavirus cases in Nigeria broken down by state to aid data scientists, statisticians and machine learning enthusiasts and experts in their analysis and search for solutions.

Although the Nigeria Center for Disease Control (NCDC) generates and publishes this data, it does so in PDF form which is not an easily accessible medium for automated methods and common data extraction libraries.

Method

The original data is provided by the NCDC at https://bit.ly/covidncdc
The work being done by us is to extract the data from the PDF files into CSV format.
We tried to automate the extraction process using python (pandas with selenium and beautifulsoup) but did not succeed.

So we ended up doing it manually. And this means we have to keep updating the files manually (See the start of this write-up for the date of the most recent update.)

Folder Information

When you unzip the zip file, the structure of the folders are:
  • /PDF
  • /CSV
Each of these folders contains the daily pdf and csv files placed in separate folders for each month.
The /PDF folder contains the original PDF data files downloaded from the NCDC website.
The /CSV folder contains the extracted daily data in CSV format. Each day has a separate file. The CSV files are named according to their date in the following format: dd_mm_yyyy.csv

Missing Dates:

There was no published data for some of the days so there are no datafiles for those missing dates which are:
  • 20 March 2020
  • 27 March 2020

Data Source:

Nigeria Center for Disease Control (NCDC) https://ncdc.gov.ng/ Direct link to data page: https://bit.ly/covidncdc

Credits:

COVID-19 News Updates

https://coronavirusnigeria.ng4n.com/updates/

Contact Us

For feedback send email to covid19data @ ng4n.com

Comments

Post a Comment

Popular posts from this blog

12 Days of Christmas Lyrics Generated by an AI (Sort of)

Image
  As I learn machine learning, one thing I find fascinating (and also greatly enjoyable) is playing around with demos and pre-trained models of various machine learning algorithms and models. While many of the more recent models generally perform pretty well for many of the tasks they are built for, I am more interested in the relatively small area of the graph where the model goofs i.e messes up. Depending on the model and what it is supposed to do, these goofs can go very wrong, giving you results that range from weird, absurd and uncanny to hilarious and outright comical. From time to time I will post some of these goofy mistakes I experience while playing around with these demos and pre-trained models. Today, I present "The 12 days of Christmas" as generated by a GPT-2 model trained by Hugging Face using papers from Arxiv.org The 12 Days of Christmas is a popular Christmas song and Hugging Face is a company that specializes in creating AI and machine learni...
Read more

Can You Spot the Fake Generated Face?

Image
Here is an exercise for you: Can you spot the fake face (or faces) among the six images below? By fake I mean generated (in other words, the person does not exist and has never existed). See the faces in larger format below (click on the image for an even higher resolution):              If your answer was one (or more) out of A, B, C, D, E or F then you are right. Actually ALL the faces are fake and the people in the images do not exist, have never existed and most likely never will. The faces were "imagined" and created (in high definition) by an Artificial Intelligence algorithm. Specifically it was created by a type of Deep Learning algorithm/model known as a GAN which is short for Generative Adversarial Network. What is a GAN? In concept, a GAN is a combination of two separate neural networks that compete against each other to ultimately produce "fake" data that is as close as possible to real sa...
Read more

NLP in Africa: One Reason why I'm Learning Machine Learning

Image
Natural language processing (or NLP) is a branch of machine learning that deals with the languages spoken by humans. This branch includes things like automatic translation, text and speech generation amongst other things. The thing about most of the current NLP systems is that they require humongous amounts of sample text, speech and/or translations and other samples of the languages in focus to be able to be trained to perform these tasks of translation, generation etc This need for large sample data is the biggest challenge for many African languages because a majority of these languages have very limited amounts of such samples - too little to successfully train an NLP system. Many of these so called "low-resource" languages both in Africa and other parts of the world have been virtually overshadowed by the more popular languages like English, French, German, Spanish, Mandarin etc which have massive amounts of sample language data already available for use in trai...
Read more