Skip to content

Conversation

@felixwang9817
Copy link
Collaborator

@felixwang9817 felixwang9817 commented Jan 29, 2022

What this PR does / why we need it: This PR cleans up feast plan. Specifically:

  1. Fco is renamed to FeastObject.

  2. Unchanged objects are no longer logged.
    first feast apply:
    Screen Shot 2022-01-28 at 4 41 04 PM
    then feast plan:
    Screen Shot 2022-01-28 at 4 41 45 PM

  3. Validation and inference are run during feast plan.

Which issue(s) this PR fixes:

Fixes #

Does this PR introduce a user-facing change?:

feast plan output only includes changed objects

@felixwang9817 felixwang9817 requested a review from a team as a code owner January 29, 2022 00:43
@felixwang9817 felixwang9817 requested review from woop and removed request for a team January 29, 2022 00:43
@felixwang9817 felixwang9817 requested review from adchia and removed request for woop January 29, 2022 00:43
@felixwang9817 felixwang9817 added kind/feature New feature or request and removed size/L labels Jan 29, 2022
Signed-off-by: Felix Wang <[email protected]>
@codecov-commenter
Copy link

codecov-commenter commented Jan 29, 2022

Codecov Report

Merging #2256 (335e8db) into master (12e2130) will decrease coverage by 0.00%.
The diff coverage is 55.17%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #2256      +/-   ##
==========================================
- Coverage   85.31%   85.30%   -0.01%     
==========================================
  Files         108      108              
  Lines        9127     9108      -19     
==========================================
- Hits         7787     7770      -17     
+ Misses       1340     1338       -2     
Flag Coverage Δ
integrationtests 73.24% <31.03%> (+0.17%) ⬆️
unittests 59.66% <50.00%> (-0.09%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
sdk/python/feast/diff/infra_diff.py 75.30% <0.00%> (-2.90%) ⬇️
sdk/python/feast/inference.py 87.50% <ø> (ø)
sdk/python/feast/diff/registry_diff.py 72.03% <37.83%> (ø)
sdk/python/feast/feature_store.py 90.46% <100.00%> (+0.93%) ⬆️
sdk/python/feast/repo_operations.py 54.87% <100.00%> (+0.27%) ⬆️
sdk/python/tests/integration/e2e/test_usage_e2e.py 100.00% <100.00%> (ø)
sdk/python/tests/unit/diff/test_registry_diff.py 100.00% <100.00%> (ø)
.../integration/online_store/test_universal_online.py 97.91% <0.00%> (+0.41%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 12e2130...335e8db. Read the comment docs.

Signed-off-by: Felix Wang <[email protected]>
Signed-off-by: Felix Wang <[email protected]>
Copy link
Collaborator

@adchia adchia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

self._make_inferences(entities_to_update, views_to_update, odfvs_to_update)

# Apply infra and registry changes.
infra_diff.update()
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

non-blocking, but another cleanup would be to have InfraObject#update -> InfraObject#create or something since it only right now creates the object

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: adchia, felixwang9817

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:
  • OWNERS [adchia,felixwang9817]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@feast-ci-bot feast-ci-bot merged commit 895589a into feast-dev:master Jan 30, 2022
feast-ci-bot pushed a commit that referenced this pull request Jan 31, 2022
* Add backticks to left_table_query_string (#2250)

Signed-off-by: david <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Delete entity key from Redis only when all attached feature views are gone (#2240)

* Delete entity from redis when the last attached feature view is deleted

Signed-off-by: pyalex <[email protected]>

* Delete entity key from Redis only when all attached feature views are gone

Signed-off-by: pyalex <[email protected]>

* make lint happy

Signed-off-by: pyalex <[email protected]>

* make lint happy

Signed-off-by: pyalex <[email protected]>

* one more try with mypy

Signed-off-by: pyalex <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* historical_field_mappings2 merge for one sign off commit (#2252)

Signed-off-by: Michelle Rascati <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Correct inconsistent dependency (#2255)

Signed-off-by: Judah Rand <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Add snowflake environment variables to allow testing on snowflake infra (#2258)

* add snowflake environment vars to test framework

Signed-off-by: sfc-gh-madkins <[email protected]>

* add snowflake environment vars to test framework

Signed-off-by: sfc-gh-madkins <[email protected]>

* Return `UNIX_TIMESTAMP` as Python `datetime` (#2244)

* Refactor `UNIX_TIMESTAMP` conversion

Signed-off-by: Judah Rand <[email protected]>

* Return `UNIX_TIMESTAMP` types as `datetime` to user

Signed-off-by: Judah Rand <[email protected]>

* Fix linting errors

Signed-off-by: Judah Rand <[email protected]>

* Rename variable to something more sensible

Signed-off-by: Judah Rand <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Feast plan clean up (#2256)

* Run validation and inference on views and entities during plan

Signed-off-by: Felix Wang <[email protected]>

* Do not log objects that are unchanged

Signed-off-by: Felix Wang <[email protected]>

* Rename Fco to FeastObject

Signed-off-by: Felix Wang <[email protected]>

* Remove useless method

Signed-off-by: Felix Wang <[email protected]>

* Lint

Signed-off-by: Felix Wang <[email protected]>

* Always initialize registry during feature store initialization

Signed-off-by: Felix Wang <[email protected]>

* Fix usage test

Signed-off-by: Felix Wang <[email protected]>

* Remove print statements

Signed-off-by: Felix Wang <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Squash commits

Signed-off-by: Danny Chiao <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Add error type and refactor query execution to have retries

Signed-off-by: Danny Chiao <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Handle more snowflake errors

Signed-off-by: Danny Chiao <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Fix lint errors

Signed-off-by: Danny Chiao <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Fix lint errors

Signed-off-by: Danny Chiao <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Fix lint errors

Signed-off-by: Danny Chiao <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* Fix wrong import

Signed-off-by: Danny Chiao <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* modify registry.db s3 object initialization to work in S3 subdirectory with Java Feast Server (#2259)

Signed-off-by: NalinGHub <[email protected]>
Signed-off-by: sfc-gh-madkins <[email protected]>

* clean up docs

Signed-off-by: sfc-gh-madkins <[email protected]>

* lint-python

Signed-off-by: sfc-gh-madkins <[email protected]>

* fixed historical test

Signed-off-by: sfc-gh-madkins <[email protected]>

* fixed historical test

Signed-off-by: sfc-gh-madkins <[email protected]>

Co-authored-by: David Miller <[email protected]>
Co-authored-by: Oleksii Moskalenko <[email protected]>
Co-authored-by: Michelle Rascati <[email protected]>
Co-authored-by: Judah Rand <[email protected]>
Co-authored-by: Felix Wang <[email protected]>
Co-authored-by: Danny Chiao <[email protected]>
Co-authored-by: Nalin Mehra <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants