Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(component): support metadata filter in artifact component #979

Merged
merged 3 commits into from
Feb 24, 2025

Conversation

heiruwu
Copy link
Member

@heiruwu heiruwu commented Feb 24, 2025

Because

  • Instill Artifact now support metadata filter for chunk similarity search

This commit

  • support metadata filter in artifact component TASK_RETRIEVE

@heiruwu heiruwu marked this pull request as ready for review February 24, 2025 15:43
Copy link

codecov bot commented Feb 24, 2025

Codecov Report

Attention: Patch coverage is 54.83871% with 14 lines in your changes missing coverage. Please review.

Project coverage is 19.58%. Comparing base (1aa40c2) to head (c40fed0).
Report is 33 commits behind head on main.

Files with missing lines Patch % Lines
...nent/data/instillartifact/v0/task_search_chunks.go 54.83% 14 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #979      +/-   ##
==========================================
+ Coverage   19.22%   19.58%   +0.36%     
==========================================
  Files         426      436      +10     
  Lines       84603    84957     +354     
==========================================
+ Hits        16264    16642     +378     
+ Misses      66002    65955      -47     
- Partials     2337     2360      +23     
Flag Coverage Δ
unittests 19.58% <54.83%> (+0.36%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@heiruwu heiruwu merged commit 624029a into main Feb 24, 2025
11 checks passed
@heiruwu heiruwu deleted the update-artifact-component branch February 24, 2025 18:41
Copy link
Collaborator

@jvallesm jvallesm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did a post-merge review, the logic looks fine, I just detected a small typo in a struct definition 👍 LGTM

Thanks for re-generating the component documents, I think we should generate them automatically in the CI like in the code generated by the protobuf files. Something to keep in mind in the future.

// The media type to filter
FileMediaType string `json:"file-media-type"`
// The content type to filter
ContetType string `json:"content-type"`
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: small typo s/Contet/Content

jvallesm pushed a commit that referenced this pull request Feb 25, 2025
🤖 I have created a release *beep* *boop*
---


##
[0.51.0-beta](v0.50.0-beta...v0.51.0-beta)
(2025-02-25)


### Features

* **all:** rename VDP to pipeline
([#963](#963))
([8ba570a](8ba570a))
* **component:** support metadata filter in artifact component
([#979](#979))
([624029a](624029a))
* **Docling:** prefetch model artifacts
([#964](#964))
([c9ff323](c9ff323))
* **document:** convert PDF to Markdown with Docling
([#959](#959))
([a9dbf55](a9dbf55))
* **document:** log execution times for benchmarking
([#969](#969))
([ac3e2c3](ac3e2c3))
* **init:** remove preset pipeline downloader
([#970](#970))
([11f8f5c](11f8f5c))
* **minio:** add client info and user header to artifact binary fetcher
([#978](#978))
([78c9c1f](78c9c1f))
* **minio:** add service name and version to MinIO requests
([#976](#976))
([39c66cd](39c66cd))
* **minio:** log MinIO actions with requester
([#972](#972))
([8ba353e](8ba353e))
* **perplexity:** add new Sonar models
([#957](#957))
([2699679](2699679))
* **recipe:** rename `format` to `type` in variable section
([#971](#971))
([88ead91](88ead91))
* **x:** update MinIO package to delegate audit logs
([#973](#973))
([f81287b](f81287b))


### Bug Fixes

* **ci:** registry image build
([#960](#960))
([3a56698](3a56698))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: No status
Development

Successfully merging this pull request may close these issues.

3 participants