Additional data for Peninsular Malaysia (price, forecast price, forecast demand, forecast generation mix, active generators)

[q--]

I found some useful data at https://www.singlebuyer.com.my/

Single Buyer is the entity authorised by the Minister pursuant to the Electricity Supply Act (ESA) 1990 to conduct electricity planning and manage electricity procurement services for Peninsular Malaysia. Single Buyer plays a key role in promoting efficiency and facilitating competition in the generation sector, hence enhancing the development of the Malaysia Electricity Supply Industry (MESI). source

Here's an explanation of how the Malaysian Electricity Supply Industry is structured

I've highlighted stuff that our current parser doesn't have yet

At the website home page

• Current demand (we already have production)
• Forecast demand (appears broken. we don't have this yet)
• Installed capacity as of early this year (current source was last updated 2016. Sadly, no breakdown by type so not very useful)
• Forecast System Marginal Price (don't have this yet)

And some things not really useful for electricitymap: today's peak demand, peak demand ever (or this year), and the same figures for energy consumption (MWh)

Active generators

This is a map with thermal and renewable sources (including capacity). Also includes solar, which our current capacity source doesn't have. (Sadly our current generation breakdown source doesn't have solar either.) Compare with the capacity given at the home page to see if it's complete and use it to update the capacity breakdown?

Forecast and (delayed) actual System Marginal Price

Actual SMP is published one to two weeks in arrears | Forecast SMP for the next trading day is updated daily at 5pm

Historical price data is available: forecast goes back as far as 2016, and actual goes back to 2017

Weekly and Monthly Generation Mix forecast

Both the "Weekly" and "Monthly" pages have the same data, just with a different date range preset

Generation mix Forecast goes up to November 30 right now. This includes solar, though it appears it doesn't seem to take into account the impact of weather.

I don't see anything that indicates this is ever updated with the actual generation mix, so it seems we'll have to rely on our current source for that.

Weekly Demand Forecast

The week ahead demand forecast

---

Alternate source for demand and System Marginal Price (Forecast and Actual)

[Kongkille]

Thanks for the overview, this data would be quite useful for any modeling we'd want to do. Right now, I believe the most concrete action item would be to add the price forecast in the parser. I am uncertain about the forecasted demand if we use a separate source than the current source of production.

In that case, I might rename the issue "Price data for Peninsular Malaysia" - what do you think?

[q--]

Personally, I prefer my titles as descriptive as possible. If implementing only a single data source is desired, I'd suggest either splitting the issue into multiple separate issues or adding a list with checkboxes for things that have/haven't been implemented.

[Kongkille]

Makes sense, I am just trying to make sure that each issue we have is directly actionable. We have quite a lot of issues and sometimes it can be difficult to understand what exactly to do on all our issues, especially for newcomers.

And so for this issue, my point is that right now the most actionable thing would be to implement fetch_price with this source as I am not too sure we can use the other data types atm