Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add remove adapters for LLMpipeline #1852

Open
wants to merge 49 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
cd3452b
Update continuous_batching_pipeline.hpp for remove adapters
wenyi5608 Mar 5, 2025
58d7928
Update llm_pipeline.hpp
wenyi5608 Mar 5, 2025
913086f
Update lora_adapter.hpp
wenyi5608 Mar 5, 2025
e10844d
Update continuous_batching_adapter.hpp
wenyi5608 Mar 5, 2025
63a260c
Update continuous_batching_impl.cpp
wenyi5608 Mar 5, 2025
dc1e445
Update continuous_batching_impl.hpp
wenyi5608 Mar 5, 2025
a61e966
Update continuous_batching_pipeline.cpp
wenyi5608 Mar 5, 2025
9d03f49
Update icontinuous_batching.cpp
wenyi5608 Mar 5, 2025
d180c87
Update icontinuous_batching.hpp
wenyi5608 Mar 5, 2025
3fe9c56
Update llm_pipeline.cpp
wenyi5608 Mar 5, 2025
c15f23d
Update llm_pipeline_base.hpp
wenyi5608 Mar 5, 2025
57f75cf
Update llm_pipeline_stateful.cpp
wenyi5608 Mar 5, 2025
4fd3200
Update llm_pipeline_stateful.hpp
wenyi5608 Mar 5, 2025
2052795
Update llm_pipeline_static.cpp
wenyi5608 Mar 5, 2025
8c35a3f
Update llm_pipeline_static.hpp
wenyi5608 Mar 5, 2025
78f4be7
Update lora_adapter.cpp
wenyi5608 Mar 5, 2025
2b076fc
Update prompt_lookup_impl.cpp
wenyi5608 Mar 5, 2025
837070b
Update prompt_lookup_impl.hpp
wenyi5608 Mar 5, 2025
6e14676
Update speculative_decoding_impl.cpp
wenyi5608 Mar 5, 2025
972527e
Update speculative_decoding_impl.hpp
wenyi5608 Mar 5, 2025
42e5978
Update continuous_batching_impl.cpp
wenyi5608 Mar 7, 2025
d5cbea9
Update llm_pipeline_stateful.cpp
wenyi5608 Mar 7, 2025
f5b1b10
Update lora_adapter.cpp
wenyi5608 Mar 8, 2025
bfa970e
Update continuous_batching_pipeline.hpp
wenyi5608 Mar 17, 2025
31e21a8
Update llm_pipeline.hpp
wenyi5608 Mar 17, 2025
4a5e357
Update lora_adapter.hpp
wenyi5608 Mar 17, 2025
5236d20
Update continuous_batching_adapter.hpp
wenyi5608 Mar 17, 2025
29779d1
Update continuous_batching_impl.cpp
wenyi5608 Mar 17, 2025
6dd2df1
Update continuous_batching_impl.hpp
wenyi5608 Mar 17, 2025
f9e23d3
Update continuous_batching_pipeline.cpp
wenyi5608 Mar 17, 2025
be4b388
Update icontinuous_batching.cpp
wenyi5608 Mar 17, 2025
a0c053b
Update icontinuous_batching.hpp
wenyi5608 Mar 17, 2025
aeff485
Update llm_pipeline.cpp
wenyi5608 Mar 17, 2025
56d5561
Update llm_pipeline_base.hpp
wenyi5608 Mar 17, 2025
c3a0db0
Update llm_pipeline_stateful.cpp
wenyi5608 Mar 17, 2025
5b02537
Update llm_pipeline_stateful.hpp
wenyi5608 Mar 17, 2025
7de647a
Update llm_pipeline_static.cpp
wenyi5608 Mar 17, 2025
8b4bf86
Update llm_pipeline_static.hpp
wenyi5608 Mar 17, 2025
352a82b
Update lora_adapter.cpp
wenyi5608 Mar 17, 2025
2a2e3fe
Update prompt_lookup_impl.cpp
wenyi5608 Mar 17, 2025
7cb3fbb
Update prompt_lookup_impl.hpp
wenyi5608 Mar 17, 2025
cd5337d
Update speculative_decoding_impl.cpp
wenyi5608 Mar 17, 2025
b418105
Update speculative_decoding_impl.hpp
wenyi5608 Mar 17, 2025
4abb135
Update lora_adapter.hpp
wenyi5608 Mar 17, 2025
5d90e7a
Update icontinuous_batching.cpp
wenyi5608 Mar 19, 2025
7b98968
Update llm_pipeline_static.cpp
wenyi5608 Mar 19, 2025
4d3ff30
Update lora_adapter.cpp
wenyi5608 Mar 19, 2025
1e5411d
Update py_openvino_genai.pyi
wenyi5608 Mar 19, 2025
de4c06a
Update py_lora_adapter.cpp
wenyi5608 Mar 19, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update icontinuous_batching.hpp
remove adapters
wenyi5608 authored Mar 5, 2025

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
commit d180c877677d1b758313a1881118abe86cf2c114
6 changes: 5 additions & 1 deletion src/cpp/src/icontinuous_batching.hpp
Original file line number Diff line number Diff line change
@@ -133,5 +133,9 @@ class ContinuousBatchingPipeline::IContinuousBatchingPipeline {
* Ends chat
*/
void finish_chat();

void remove_adapters(const ov::AnyMap& plugin_config);

virtual void remove_adapters(const std::optional<AdapterConfig>& config) = 0;
};
}
}