Loading Vaccination State Data

[thejeshgn]

Hi All,
If you follow the datameet/covid19[1] Github repo, you would have seen that we download[2] the cumulative covid vaccination report daily. As of now, we are extracting only Total Doses at the India level and adding to the JSON[3]. The data looks like this, for each day.

	{
	  "_id": "2021-09-12T09:00:00.00+05:30|vaccinations",
	  "report_time": "2021-09-12T09:00:00.00+05:30",
	  "total":738207378,
	  "source": "mohfw",
	  "type": "vaccinations"
	}

Now, I have written a script to extract other parts of the PDF and the state level. The dataset will be backward compatible( shouldn't break any of your data pipelines). It will look like this at India level. Two additional attributes, "1stdose" and "2nddose".

{
  "_id": "2021-09-12T09:00:00.00+05:30|vaccinations",
  "report_time": "2021-09-12T09:00:00.00+05:30",
  "total":738207378,
  "1stdose":561101965,
  "2nddose":177105413,
  "source": "mohfw",
  "type": "vaccinations"
}

There will be new records at the state level, which will look like this.

{
  "_id": "2021-09-12T09:00:00.00+05:30|vaccinations|ka",
  "report_time": "2021-09-12T09:00:00.00+05:30",
  "state": "ka",
  "total": 47445632,
  "1stdose":35196111,
  "2nddose":12249521,  
  "source": "mohfw",
  "type": "vaccinations"
}

for Unassigned or Miscellaneous state will be

{
  "_id": "2021-09-12T09:00:00.00+05:30|vaccinations|unassigned",
  "report_time": "2021-09-12T09:00:00.00+05:30",
  "state": "unassigned",
  "total": 3458791,
  "1stdose":1556469,
  "2nddose":12249521,  
  "source": "mohfw",
  "type": "vaccinations"
}

Currently, I have been parsing and loading the old data (since 2021-03-08). It should be available by this weekend.

Once this is done. I will look into parsing and loading the District wise positivity rates.

You can follow the progress of this data load here.

[1] https://github.com/datameet/covid19/

[2] https://github.com/datameet/covid19/tree/master/downloads/mohfw-backup/cumulative_vaccination_coverage

[3] https://github.com/datameet/covid19/blob/master/data/mohfw_vaccination_status.json

[thejeshgn]

Country level is loaded.

State needs more parsing.