FERC 714: transform of hourly demand table (dbf +xbrl)

[cmgosnell]

Overview

Closes #3838. There is a tasklist in the issue!

What problem does this address?
most of the work here has been in cleaning the date formats 🙄

• datetimes omigosh....
  • 🟢 convert_dates_to_zero_offset_hours_xbrl hours being 01-24 or 01-00 (of next day.. probably I put in some emails to ferc about this)
  • 🟢 convert_dates_to_zero_seconds: some last record of the days being last second of the day (T23:59)
  • GAPS. There are 41 gaps in the timeseries
  • there are lots of overlapping timestamps rn
• ...

What did you change?

Testing

How did you make sure this worked? How can a reviewer verify this?

To-do list

Beta Give feedback

1. If updating analyses or data processing functions: make sure to update or write data validation tests (e.g. test_minmax_rows())
2. Update the release notes: reference the PR and related issues.
3. Run make pytest-coverage locally to ensure that the merge queue will accept your PR.
4. Review the PR yourself and call out any questions or issues you have
5. For minor ETL changes or data additions, once make pytest-coverage passes, make sure you have a fresh full PUDL DB downloaded locally, materialize new/changed assets and all their downstream assets and run relevant data validation tests using pytest and --live-dbs.
6. For bigger ETL or data changes run the full ETL locally and then run the data validations using make pytest-validate.
7. Alternatively, run the build-deploy-pudl GitHub Action manually.

[aesharpe]

Just a lil lonely comment because it's not part of the code you edited therefore I can't comment directly on the line...

The doc strings for the OFFSET_CODES dictionary seems like it has a copy and paste error in it?

[aesharpe]

This looks really good! I found it really easy to go through all the functions and understand what was happening to the table. Most of my comments are non-blocking. Love that all of the functions are bite-sized! :)

[aesharpe]

oh also, @cmgosnell reminder to add some color to the metadata/resources/ferc714.py module about the out_ferc714__hourly_planning_area_demand table.