Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

OpenSTEF Integration #585

Closed
wants to merge 82 commits into from
Closed

OpenSTEF Integration #585

wants to merge 82 commits into from

Conversation

rodalynbarce
Copy link
Contributor

No description provided.

@rodalynbarce rodalynbarce self-assigned this Nov 27, 2023
@rodalynbarce rodalynbarce reopened this Dec 8, 2023
@rodalynbarce rodalynbarce reopened this Dec 13, 2023
@cching95 cching95 self-requested a review December 13, 2023 13:44
rodalynbarce and others added 24 commits December 13, 2023 13:45
@rodalynbarce
Added OpenSTEF components
3685c59 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Remove commented out code
c22e137 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Added ENTSO-E and MFFBAS source components
a144296 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Black formatting
08f908a 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Update environment.yml
f620c5a 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Added init
1547cf0 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Black formatting
4b6d2b7 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Update openstef-dbc version
0c15a4c 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Updates
a058109 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Test Updates
a24fbeb 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Updates
76c2742 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Test updates
a7e242b 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Envrionment changes
2ae2747 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Update env
abbf34a 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Black formatting
0dd717f 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Updates
6212be0 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
Summary Statistics API (rtdip#588)
b762495 
* Summary statistics api

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* summary statistics api tests

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* updates

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix code smells

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix duplications

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix duplications in test summary

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

---------

Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
fix standard deviation bug (rtdip#591)
a79e793 
Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
Update documentation links on APIs (rtdip#592)
3631116 
* fix standard deviation bug

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* update api doc links

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

---------

Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@IW-SS @rodalynbarce
Source connector for CASIO System Level Data (rtdip#579)
c6dff0e 
* Adding CAISO Sources

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Adding CAISO System Level Forecast Sources with UnitTesting and Docs

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Removing unnecessary code

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing Compatibility issues between Pandas 2.0 and PySpark

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing Black Check

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing DCO and Black issues

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Code cleanups + Pandas backwards compatibility support

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing Sonar Checks

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

---------

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
Refactored Time series Unit Tests (rtdip#598)
6dcdcec 
* restructure test folder

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix pytest collection error

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* update

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* move test utils

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* Refactored raw and resample unit tests

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* remove import from test raw

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* refactored interpolate unit test

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* refactor unit tests of time series functions

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* created a utils folder inside test queries

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix test api errors

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix error

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix errors in metadata and resample imports

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* updates

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix unit tests

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix summary and raw unit tests

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* added reample query

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

---------

Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
update api links (rtdip#602)
48ecec5 
Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Update serializer
dfb9cf1 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Added package version requirement
377c709 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
rodalynbarce and others added 28 commits December 13, 2023 13:58
@rodalynbarce
Update env
92ef18d 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Black formatting
38d6e9b 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Updates
c82288a 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
Summary Statistics API (rtdip#588)
dfcad22 
* Summary statistics api

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* summary statistics api tests

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* updates

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix code smells

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix duplications

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix duplications in test summary

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

---------

Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
fix standard deviation bug (rtdip#591)
67e075c 
Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
Update documentation links on APIs (rtdip#592)
106e588 
* fix standard deviation bug

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* update api doc links

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

---------

Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@IW-SS @rodalynbarce
Source connector for CASIO System Level Data (rtdip#579)
f4d6700 
* Adding CAISO Sources

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Adding CAISO System Level Forecast Sources with UnitTesting and Docs

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Removing unnecessary code

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing Compatibility issues between Pandas 2.0 and PySpark

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing Black Check

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing DCO and Black issues

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Code cleanups + Pandas backwards compatibility support

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing Sonar Checks

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

---------

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
Refactored Time series Unit Tests (rtdip#598)
07b03d6 
* restructure test folder

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix pytest collection error

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* update

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* move test utils

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* Refactored raw and resample unit tests

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* remove import from test raw

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* refactored interpolate unit test

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* refactor unit tests of time series functions

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* created a utils folder inside test queries

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix test api errors

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix error

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix errors in metadata and resample imports

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* updates

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix unit tests

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix summary and raw unit tests

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* added reample query

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

---------

Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
update api links (rtdip#602)
43101ba 
Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Update serializer
3255d20 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Added package version requirement
7efe268 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@srjhunjhunwalacorp @cching95 @rodalynbarce
Blog OPC UA to Delta Lake (rtdip#604)
4712b92 
* blog opcua

Signed-off-by: S.jhunjhunwala2@shell.com <S.jhunjhunwala2@shell.com>

* OPC UA to delta

Signed-off-by: S.jhunjhunwala2@shell.com <S.jhunjhunwala2@shell.com>

* author update

Signed-off-by: S.jhunjhunwala2@shell.com <S.jhunjhunwala2@shell.com>

* picture update opc ua blog

Signed-off-by: S.jhunjhunwala2@shell.com <S.jhunjhunwala2@shell.com>

* updates

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* updates

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

---------

Signed-off-by: S.jhunjhunwala2@shell.com <S.jhunjhunwala2@shell.com>
Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Co-authored-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@IW-SS @rodalynbarce
Source connector for ERCOT System Level Data (rtdip#583)
9815f2c 
* Adding ERCOT Daily Load Source

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing spaces in components.md

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing spaces in mkdocs.md

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing Pandas Compatibility

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Putting HTML Raw response in the test file for ERCOT

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Fixing Sonar Code Smells

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

* Code cleanups

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>

---------

Signed-off-by: Shivam Saxena <shivam.saxena@innowatts.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Black formatting
e8faa7a 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Update tests
69bc110 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Updates
c6b4ed9 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Black formatting
c0735c3 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Updates
9e87eb5 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Revert changes back
f9fb15e 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Add test skip clause
849b6ac 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Formatting
cd2b8c8 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Removed 3.8
af212ff 
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
Update documentation links on APIs (rtdip#592)
e0fed4c 
* fix standard deviation bug

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* update api doc links

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

---------

Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
update api links (rtdip#602)
d58e6d2 
Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
Mirico Transformer, Documentation and Unit Tests (rtdip#608)
3403b12 
* mirico transformer, documentation and unit tests

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix code smells

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* update

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

* fix  bug

Signed-off-by: Chloe Ching <chloe.ching@shell.com>

---------

Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@cching95 @rodalynbarce
add mirico transformer to init (rtdip#609)
15b7b22 
Signed-off-by: Chloe Ching <chloe.ching@shell.com>
Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Merge remote-tracking branch 'origin/feature/integration_a' into feat…
eb46640 
…ure/integration_a

Signed-off-by: rodalynbarce <Rodalyn.Barce@shell.com>
@rodalynbarce
Merge branch 'develop' into feature/integration_a
407bf0b
@sonarqubecloud SonarQubeCloud
Copy link

Quality Gate Passed Quality Gate passed

The SonarCloud Quality Gate passed, but some issues were introduced.

6 New issues
0 Security Hotspots
85.5% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cching95 cching95 Awaiting requested review from cching95

Assignees

@rodalynbarce rodalynbarce

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@rodalynbarce @cching95 @IW-SS @srjhunjhunwalacorp