Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

IPEX XPU deepspeed support #343

Closed
wants to merge 53 commits into from
Closed

IPEX XPU deepspeed support #343

wants to merge 53 commits into from

Conversation

sramakintel
Copy link
Contributor

@sramakintel sramakintel commented Aug 27, 2024 •
edited
Loading

Description

Related Issue

Changes Made

  • The code follows the project's coding standards.
  • No Intel Internal IP is present within the changes.
  • The documentation has been updated to reflect any changes in functionality.

Validation

  • I have tested any changes in container groups locally with test_runner.py with all existing tests passing, and I have added new tests where applicable.

ma-pineda and others added 26 commits August 12, 2024 08:43
@ma-pineda @pre-commit-ci @jafraustro
Adding classical-ml and data-analytics presets (#255)
0b6f994 
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Co-authored-by: Tyler Titsworth <tyler.titsworth@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: jafraustro <jaime.fraustro.valdez@intel.com>
@dependabot
Bump step-security/harden-runner from 2.9.0 to 2.9.1 (#302)
58cc2a3
@dependabot
Bump the python group in /python with 3 updates (#297)
45d23db 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@sramakintel
Remove keyless sources from pytorch xpu (#293)
325d79c 
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
Co-authored-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
@dependabot
Bump github/codeql-action from 3.25.15 to 3.26.0 (#303)
31f296a
@dependabot
Bump actions/upload-artifact from 4.3.5 to 4.3.6 (#304)
88325df 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@sharvil10 @sramakintel @dependabot
Token Authentication enabled and tested for Torchserve workflow (#306)
9803461 
Signed-off-by: sharvil10 <sharvil.shah@intel.com>
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Tyler Titsworth <tyler.titsworth@intel.com>
Co-authored-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump the pytorch group across 1 directory with 14 updates (#309)
4dded50 
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: tylertitsworth <tyler.titsworth@intel.com>
@sramakintel @sharvil10
@dependabot @pre-commit-ci
update ipex layers to 2.1.40-xpu (#305)
4a7f238 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
Signed-off-by: sharvil10 <sharvil.shah@intel.com>
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Signed-off-by: Srikanth Ramakrishna  <srikanth.ramakrishna@intel.com>
Co-authored-by: Sharvil Shah <sharvil.shah@intel.com>
Co-authored-by: Tyler Titsworth <tyler.titsworth@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
update pytorch cpu whl index (#312)
14fa971 
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Update Intel Optimized ML Docs (#313)
7b8b19b 
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
@sramakintel
rework PR 310 for review (#314)
d952100 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
@dependabot
Bump the tensorflow group across 1 directory with 8 updates (#315)
47d5dfb 
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: tylertitsworth <tyler.titsworth@intel.com>
@dependabot
Bump mkdocs-material from 9.5.31 to 9.5.32 in /docs in the docs group (…
908fd4a 
…#320)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump onnxruntime from 1.18.1 to 1.19.0 in /preset (#319)
6197b78 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump matplotlib from 3.9.1.post1 to 3.9.2 in /classical-ml in the cla…
f5024ac 
…ssical-ml group (#323)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump github/codeql-action from 3.26.0 to 3.26.2 (#322)
e938f41 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@sramakintel
update xpu requirements and image tags (#325)
cdef1e4 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
Add TGI on Intel Chart (#283)
4139104 
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
@dependabot
Bump github/codeql-action from 3.26.2 to 3.26.5 (#333)
13a2416 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump mkdocs-material from 9.5.32 to 9.5.33 in /docs in the docs group (…
262a89c 
…#331)
@sramakintel
IPEX XPU Torchserve support (#336)
658e61e 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
Correct TM&B (#329)
18f2760 
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Open Up XPU Conda Reqs (#330)
cd824cf 
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
@dependabot
Bump numpy from 2.0.1 to 2.1.0 in /tensorflow in the tensorflow group…
7ad4020 
… across 1 directory (#341)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@sramakintel
validate deepspeed on single node single gpu
4bbf3e5 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
sramakintel and others added 23 commits August 28, 2024 11:40
@sramakintel
fix idp build
577f83b 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
@sramakintel
fix xpu jupyter build
3c44cb3 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
@sramakintel
Merge branch 'main' into sramakr1/ipex_deepspeed_xpu
e08d231
Add Perf Sample Example Section (#307)
1d643a6 
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
@dependabot
Bump notebook from 7.2.1 to 7.2.2 in /classical-ml in the pip group (#…
57291b3 
…347)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump jupyterlab from 4.2.4 to 4.2.5 in /classical-ml in the pip group (…
3f6e3a5 
…#348)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump the docs group in /docs with 2 updates (#351)
69b24d3 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump actions/upload-artifact from 4.3.6 to 4.4.0 (#354)
b95845e 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump github/codeql-action from 3.26.5 to 3.26.6 (#355)
f7e8c19 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump actions/setup-python from 5.1.1 to 5.2.0 (#357)
536e096 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Compare against same Python Version (#358)
bde3ae0 
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
Create Container Map (#360)
31730a9 
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Patch Container Mapping (#361)
0af8f7f 
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
Patch container mapping (2) (#363)
2e9bee7 
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
Test CPU Validation Runners (#362)
02e2097 
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
@dependabot
Bump pydantic from 2.8.2 to 2.9.1 in /test-runner in the test-runner …
d1cc89f 
…group (#371)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@sharvil10
Gaudi OpenShift notebook container (#365)
70bfa56 
Signed-off-by: sharvil10 <sharvil.shah@intel.com>
@sramakintel @pre-commit-ci
IPEX XPU 2.3.110 support (#378)
e4a0073 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
Signed-off-by: Srikanth Ramakrishna  <srikanth.ramakrishna@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Tyler Titsworth <tyler.titsworth@intel.com>
Update Dependabot Patterns (#377)
5ca74f7 
Signed-off-by: Tyler Titsworth <tyler.titsworth@intel.com>
@dependabot
Bump step-security/harden-runner from 2.9.1 to 2.10.1 (#381)
fd50d3f 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@sramakintel
update setuptools and pip to resolve trivy vulnerabilities (#380)
5b55cc1 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
@dependabot @sramakintel
Bump the pytorch group across 1 directory with 13 updates (#379)
1b1c1d4 
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
Signed-off-by: Srikanth Ramakrishna  <srikanth.ramakrishna@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
Co-authored-by: Tyler Titsworth <tyler.titsworth@intel.com>
@sramakintel
merge changes with main
8a8ab5f 
Signed-off-by: Srikanth Ramakrishna <srikanth.ramakrishna@intel.com>
@tylertitsworth tylertitsworth force-pushed the main branch 2 times, most recently from 287e97c to e186489 Compare September 26, 2024 22:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@tylertitsworth tylertitsworth Awaiting requested review from tylertitsworth

@jitendra42 jitendra42 Awaiting requested review from jitendra42 jitendra42 is a code owner

@sharvil10 sharvil10 Awaiting requested review from sharvil10 sharvil10 is a code owner

@dmsuehir dmsuehir Awaiting requested review from dmsuehir

@ma-pineda ma-pineda Awaiting requested review from ma-pineda

@jafraustro jafraustro Awaiting requested review from jafraustro jafraustro is a code owner

Assignees

@sramakintel sramakintel

Labels
WIP Work in Progress
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@sramakintel @tylertitsworth @ma-pineda @sharvil10