Seeing as in about 10 days they're giving every single customer a massive 'fuck you'... are they going to try and shut off access to my data if I don't pay.
I want to download the data for the last 3+yrs and need to know if I have to do it by the 30th April.
Anomnomnomaly There's a thread about it here:
https://community.givenergy.cloud/d/2881-report-data-download-as-excel-file
I would suggest this:
https://givenergymonitor.co.uk/transfer.html
Rubikcube - yaay...of course you would say that!! - with the best app on the market (other apps are available!!)
Rubikcube Incidentally - your revised website is fantastic and so easy to use
And there's this one I found the other day which will download every days data for you into a csv file:
https://github.com/driessamyn/givenergy-foss
I used the windows version after setting up an short lived read only Givenergy api key. I now have 1189 csv files to load somewhere.
I've also got Home Assistant writing out the same data every 30 seconds as well. All I need to do now is a script to load them into a SQL database and write some reports. A few days fun if I find I want to look at more than I have in HA.
SJB after setting up an short lived read only Givenergy api key
This presumably won't be possible from May onwards unless you pay for continuing API access?
pwdst I wouldn't have thought so.
I'm using the app already, one thing I wasn't sure about is what figure to enter for the battery capacity. It's reading 9500, but I have two GE batteries, the 5.2kwh and the 8.2kwh.
My understanding of the two is that the 5.2 has a directly useable 4.2kwh with the rest reserved to account for cell degradation over the warranty, whilst the 8.2kwh is actually 10.2kwh for the same reason.
So my capacity is actually 15.4kwh with a directly useable 12.4kwh.
So is 9500 the correct figure in the battery capacity field?
This is the kind of thing I was wondering about... downloading my data and being able to upload it in HA, as I've recently bought a Pi5 (4GB) for that reason... and have been told to install predbat too.
I'd be setting 12400 as a starting poingt, then monitor %AGES vs portal figures.
Anomnomnomaly - look on the portal..go to inverter...then general...look at the battery capacity - it shows the kWh - this Inverter App uses Wh - so x 1000
What purpose do all these fancy graphs serve ?
The sun only shines when it wants to and there is no way of influencing that.
I would put in 12400 for the capacity. It is only used to estimate when the battery will be full/empty on the battery bar, so a precise figure isn't important.
IW Graphs can, for example, help highlight that there is a fault with one of your panels- or simply that they need cleaning.
I can see that, but that would be using current data, not historical
IW Historical data could be of relevance to assessing any payback and also potentially looking at any degradation/identifying when any fault might have started. It could also be used to fine tune any forecast models against actual performance.
For many people though it might just give them the satisfaction of seeing the cumulative performance of their system over time.
SJB
WARNING - I dl'ed and ran the givenergy-foss package last night for my AIOx2+GW. The data retrieval failed on the Gateway on first run, so I restarted it and left it overnight. This morning, when I saw it still hadn't worked, I noticed my API had a Revoked status, blamed myself, generated a new one and re-started.
I was then contacted by Givenergy this morning (!!!), with a portal message saying that there was an issue at their end with me retrieving Gateway data, and that they would be deploying a fix later today. (And then I was subsequently asked not to generate any more API tokens and do it again - oops.)
PianSom That's interesting. Fortunately I downloaded my data on Sunday and won't need to download any more 🙂.
AndyZ900rs OK, so the portal is saying 13.41kwh
IW There's different kinds of sunshine and different kinds of cloud.... I didn't know that when I got my system.
Turns out that a high and thin cloud cover can actually be beneficial for solar generation vs some direct sunlight... because some of the light is bounced up into the atmosphere and reflected back down by the clouds.
Which is why it's often warmer when there's cloud cover and colder when it's clear skies.
Direct sunlight can also heat the panels up more, and heat can lower efficiency. It's basic physics and thermodynamics.
Also... some us just like seeing the data and monitoring how our systems work each month. I share monthly updates on solar systems with people, how that affects use, how many days I was effectively off grid and how the majority of my electric bills from April to Sept are all standing charges... which are set to go up when my fixed deal ends to 69p a day... or £252 a year for the privilege of being allowed to use expensive energy generated by wind and solar whilst being charged as if it was generated by gas.
SJB
Giv solved their issue and let me know. I have now got a full data backup locally.
SJB I got no idea how that is supposed to work, the exe it tells you to download doesnt do anything, don't understand the instructions AT ALL.
nvm figured it out, slows down real fast on downloading lol 66% after 20 minutes
another edit lol
Took ~ 1 hour to get everything.
Another edit
that was just the gateway apparently, now its doing inverter, estimating 8 hours
Another edit
both took around an hour each
SJB All I need to do now is a script to load them into a SQL database and write some reports. A few days fun if I find I want to look at more than I have in HA.
there are some scripts and procedures I wrote last year that can do this, they weren’t directly using the CSV files from the new givenergy-foss solution, but there were for the powershell scripts and could easily be adapted.
Is it possible to export home assistant data into csv as well?
Might be worth mentioning that the Giv Portal (daily) Data CSV downloads (42 fields) are significantly different from the CSVs that the givenergy-foss importer utility spits out (37 fields). I'll attempt a paste from my comparison sheet, but very much doubt it will be intelligble! Here goes:
jonhd Might be worth mentioning that the Giv Portal (daily) Data CSV downloads (42 fields) are significantly different from the CSVs that the givenergy-foss importer utility spits out (37 fields). I'll attempt a paste from my comparison sheet, but very much doubt it will be intelligble! Here goes:
could well be a time difference. The GivEnergy portal holds data in UTC, so if you download summer data the time will all be one hour out. I amended the powershell script I was using to fix this but not all of them. I’m guessing that the givenergy-foss does the conversion.
geoffreycoan Apologies - I wasn't being clear. Those were just 2 randomly-selected rows. Have chosen 2 matching (date/time) rows, and added comparison 'indicators'. Red text indicates that there is no equivalent mapping between the two CSVs (Giv data download / givenergy-foss importer).
And, in a slightly friendlier format(!)...
maybe raise a github issue for the givenergy-foss to see if the extra portal entities can be added, although TBH none of them look massively essential.