Providing new data feeds to ABRP

[chuq]

Here in Australia we have been slow on the takeup of EVs, but now there are several networks popping up.  However apart from the Tesla superchargers, none of them appear in ABRP.

I've added a couple of stations near me to OpenChargeMap, but I'd like to contact the networks that operate them, to ask them to make their location information available in a format that is useful to OCM and ABRP.

A couple of questions:

1) What is easier for ABRP?  For the data to be provided to OCM (and then ABRP gets it from there) or to be provided to ABRP directly? 

2) What do I need to tell these organisations?  What formats etc?  (Bearing in mind I'm as much a stranger to these organisations as I am to ABRP - I can't get the data myself or help test.) 

The organisations (all in Australia) are:
- Queensland Electric Super Highway - a government funded and operated network of 18 DC fast chargers (50 kW) in Queensland.
- NRMA Electric Vehicle network - a state motoring organisation which is funding and operating over 40 DC fast chargers (50 kW) in New South Wales (12 built so far)
- Chargefox - a charge network operator which, as well as already operating many AC and 50kW DC chargers, is building a network of 22 ultra-rapid (350 kW) charging sites across the country (3 built so far)
- Evie Networks - a charge network operator which hasn't built anything yet, but are also planning ultra-rapid (350 kW) charging sites across the country

 

 

[chuq]

Addendum to this:

I’m happy to create a Google Sheet with the relevant site details if that is a quicker way of setting this up.  I just need to know what fields are required and in which order.

(Then later on as the relevant companies/government departments make their feeds available, a more long term synchronisation method can be set up.)

 

[Jason-ABRP]

The best way for us to get data is via OCPI, it's already adopted by a number of networks, and provides us with  a standard way to retrieve charger information:

https://ocpi-protocol.org/

We're already working on some neat features that are somewhat dependent on OCPI's capabilities, like incorporating live status (like redirecting you around an in-use charger) in our routefinding.  All stuff we're tinkering with in the background but can only be done with an interface like OCPI.

Any kind of API is workable, though, so long as we can query it and display the data to you!

[chuq]

Thanks Jason!  One of the organisations I've mentioned, Chargefox, is experienced in running EV charging stations so I expect they'll want to do something like this.  I've logged a request with their support team.

Of the others, the Queensland one is run by a government department and their chargers aren't managed from what I can see (they are free and not part of any charging network).  They might not have the resources, or if they do, it might not be a priority for them.  The NRMA network is kind of in between the two (they aren't an EV charging specific organisation, but they are taking a greater hands-on approach).  Would the simple Google Sheets option be better for these locations?

Any comments on "data provider to ABRP" vs "data provider to OCM to ABRP"?  Obviously any site info that goes to OCM just flows on to ABRP without any effort from you, but are there any benefits to the provider interfacing direct to ABRP?

[Jason-ABRP]

12 hours ago, chuq said:

Thanks Jason!  One of the organisations I've mentioned, Chargefox, is experienced in running EV charging stations so I expect they'll want to do something like this.  I've logged a request with their support team.

Of the others, the Queensland one is run by a government department and their chargers aren't managed from what I can see (they are free and not part of any charging network).  They might not have the resources, or if they do, it might not be a priority for them.  The NRMA network is kind of in between the two (they aren't an EV charging specific organisation, but they are taking a greater hands-on approach).  Would the simple Google Sheets option be better for these locations?

Any comments on "data provider to ABRP" vs "data provider to OCM to ABRP"?  Obviously any site info that goes to OCM just flows on to ABRP without any effort from you, but are there any benefits to the provider interfacing direct to ABRP?

Google Sheets would be easy enough to implement, @Bo (ABRP) already did that once for the Tesla CCS plugs in Europe.  Not ideal, but workable.

We always prefer primary sources for a number of reasons, generally the data is more thorough, and up-to-date (Prime --> OCM --> ABRP induces some lag).  It's also generally more trustworthy, though it should be the same data, we've had a few oddball cases.  But if -->OCM is what they're willing to support, then we're happy with whatever we can get.

[chuq]

Thanks Jason,

I've created a Google Sheet here: https://docs.google.com/spreadsheets/d/1A6jrzPsrrUyWzEQ4HVpoaHK85cK3un0auG1b5Gc85NA/edit?usp=sharing

Note that there is a second tab "notes", which contains some general background info.  Specifically I've provided the plug data in two formats: Columns J-M and N-Y.  Please let me know which of these formats works best for you (or something else entirely).  Also if there are any more fields that you need.

I'm also sharing this spreadsheet link with a few EV community groups for their comments, as noted on the "notes" page.

[chuq]

Hi @Jason (ABRP) - any further updates on whether ABRP can make use of this data?

[Bo-ABRP]

Sorry for the delay, I just added an import function for your chart. Please check if data is what it should be and if we could add any more relevant info!

The import happens daily around 23:00 UTC.

[chuq]

Thanks @Bo (ABRP) - that is brilliant!

The only issue I can see so far is that some of the chargers already exist (from OCM) and so naming consistency is a bit off.  I'm guessing existing stations take priority?

If I update columns in the spreadsheet, will it overwrite?

Which columns are you using for connector info?  J-M or N-Y?  I provided both because I wasn't sure which was best for you, but they provide the same info in two different formats.  I can remove the unused columns.

[Bo-ABRP]

I am using N-Y since that also conveys other charger speeds than J-M (you have 100 kW, for example). But the parsing is quite hard-coded, so please don't remove any columns without warning me, it will break the import. 

Any updates will overwrite, and yes, other databases typically take priority so far.

[chuq]

Hi Bo,

I just wanted to say thanks for doing this - I've been updating the spreadsheet as new chargers come online and it's been working really well!

A comments and a request:

• I'm planning on reusing columns J-M for other things.  Don't worry, I won't shift/rename other columns!
• Is it possible for you to only import the rows which have "Operational" in column A?  At the moment I have two separate sheets in the workbook, "Data" for Operational, and Coming soon" for In progress or Speculation.  Both sheets have the same layout and I'd like to put all on the same sheet, but have ABRP only import the "Operational" ones!

[chuq]

On 8/27/2019 at 10:41 PM, chuq said:

Is it possible for you to only import the rows which have "Operational" in column A?  At the moment I have two separate sheets in the workbook, "Data" for Operational, and Coming soon" for In progress or Speculation.  Both sheets have the same layout and I'd like to put all on the same sheet, but have ABRP only import the "Operational" ones!

Hi @Bo (ABRP) - forgot to tag you before - any chance of this change being implemented?

[caf]

@chuq Where did you source the Chargefox data in your spreadsheet?

You have the Sydney (4 Defries Avenue) site listed as {Cdmo 50 x 1; CCS2 50 x 1; CCS2 350 x 2}, but in the Chargefox app itself it is listed as {Type 2 22 x 2; Type 2 22 x 2}.  There's also a 50kW DC listed as "Under Construction" there.

The Chargefox app also has 26 other locations in the greater Sydney area that I think are missing from your list (only one of them doing DC charging at the moment unfortunately).

Would you like me to transcribe the information from their app for your spreadsheet?

[chuq]

@caf I think the Chargefox app shows two pins at the site - the 22kW chargers (which have been there for months) and the Ultra-rapid charger (which is new).  I'm only including the fast & ultra-rapid sites in the spreadsheet, so I don't include AC chargers (except where a fast charger site has an AC charger adjacent to it).  AC charging sites are not particularly helpful for ABRP's purpose (routing long distance trips) which is why I don't include them.

I believe ABRP also sources from OpenChargeMap, which would be a good place to add the 22 kW sites (if you want to do them all manually, that is!)

[caf]

@chuq Yes - oddly the second pin for the DC site is still listed as "Under Construction", but there's reviews on Plugshare indicating it's operational so I guess they're just slow updating their own app.

They do list another DC site that's not on your sheet, though:

"Concord JLR", 49/53 Parramatta Rd, Concord, NSW 2137.  2x CCS2 25kW.

Or do you only consider 50kW+ sites as "fast"?

[chuq]

On 11/21/2019 at 1:01 PM, caf said:

@chuq Yes - oddly the second pin for the DC site is still listed as "Under Construction", but there's reviews on Plugshare indicating it's operational so I guess they're just slow updating their own app.

They do list another DC site that's not on your sheet, though:

"Concord JLR", 49/53 Parramatta Rd, Concord, NSW 2137.  2x CCS2 25kW.

Or do you only consider 50kW+ sites as "fast"?

Yep - only 50 kW+ sites!  Otherwise there would be hundreds of them.  ABRP does use AC charging locations, but not for most of the time.  Definitely add AC ones to OpenChargeMap though if you spot them and would like ABRP to use them, since ABRP will import from there..  

In case you're wondering why I don't just add the DC chargers to OCM - I keep the spreadsheet for a secondary purpose - many networks have a list of 'Coming soon' locations which are up to a year away.  I use the data in the spreadsheet to make a map of "What the Australian fast charging coverage will look like in 12 months time".  Note that only Operational chargers are imported into ABRP, but all the "coming soon"/"speculative" ones are used in my other maps.

Edited November 22, 2019 by chuq

[caf]

@chuq: Ahh, I thought you might have put all DC sites in.

That map you're making sounds neat, is it publicly available?

[Gleb]

We have similar, but even more prominent lack of chargers data in Ukraine.

There are several more widespread providers, such as:

https://charge.autoenterprise.com.ua/

https://toka.energy/

And plethora of non-networked plugs. 

They are mostly listed on plugshare.

What do I write to the provider, and how can I maintain my own list to be used for route planning?

[chuq]

On 11/27/2019 at 3:36 PM, caf said:

@chuq: Ahh, I thought you might have put all DC sites in.

That map you're making sounds neat, is it publicly available?

This is the latest version!  

Orange = 350 kW

Black = 50 kW

[caf]

@chuq

Thanks, looks great!

I have some 50KW updates for your sheet if you want:

• The site at 4 Knowles Place, Canberra is in the ActewAGL network (you have it listed but as "none").
• There is a 50KW site in the ActewAGL network at Anketell St & Oakden St, Greenway ACT 2900 (-35.422750, 149.072389) with 1xCHAdeMO, 1xCCS1
• There is a 50KW site in the ActewAGL network at 1 Rogan St, Canberra ACT 2609 (-35.309310, 149.187787) with 1xCHAdeMO, 1xCCS1

Yes, weirdly they have one site with CCS2 and two sites with CCS1.

[chuq]

Hey @Bo (ABRP) and @Jason (ABRP) - are you having issues importing new sites from the Australian CCS spreadsheet?

I added a site "Kings Meadows" last week, that worked fine - I also added a site "Keith" a couple of days ago and that so far hasn't shown up.

These are the rows in the source spreadsheet:

 

On further investigation, it looks like ABRP might have sourced Kings Meadows from OCM, but Keith hasn't been added to OCM there yet.  So maybe that's the reason.

[chuq]

Note: I have just added the "Chargefox Keith" location to OCM as well, so it might pop up on ABRP due to it's inclusion there.

[caf]

I noticed today that the Batemans Bay site which is listed in @chuq's spreadsheet isn't in ABRP anymore either.  Could it be the default filter that's set (filtering to TAS only) on the spreadsheet that's confusing the import?

[chuq]

Yikes, I hadn't considered my filtering view may affect the import of sites - my apologies if this is the case

I've just checked a few sites around Melbourne which are non network affiliated and they are still showing up in ABRP, so I don't think that's the issue... 

At first I thought you meant the Dan Murphys site, and thought perhaps it might have been auto-merged with the NRMA site since the two are so close, but on closer inspection the Dan Murphys one is labelled as "Coming" (I haven't seen evidence that it is operation yet) and the NRMA one (marked "Operational") is not visible!

So still a bit of a mystery...

 

[caf]

Yes there's recent reviews on Plugshare saying the Dan Murphy's site isn't working yet.

I actually submitted the NRMA site to OCM before I thought about looking at your spreadsheet, it's not in there yet though.

[caf]

@chuq it seems to be back now, for whatever reason.

Edited June 24, 2020 by caf
Fix @ mention