Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v0.4.0-Beta #35

Merged
merged 59 commits into from
May 28, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
37056f7
Bump actions/upload-artifact from 3 to 4 (#228)
dependabot[bot] Apr 10, 2024
c752c2f
Revert "Bump actions/upload-artifact from 3 to 4" (#233)
Apr 10, 2024
a56a203
Invalid registry input in composite (#234)
Apr 10, 2024
d7a7736
Container Pipeline v2 (#227)
May 1, 2024
3f7a7fd
update invalid pillow dep (#270)
May 1, 2024
5ebeb19
Bump actions/upload-artifact from 3 to 4 (#236)
dependabot[bot] May 1, 2024
16b5e68
swap internal composite branch source (#271)
May 1, 2024
65b776a
swap to external source
May 1, 2024
db5e4c8
Add exception for TLDs like Preset (#279)
May 6, 2024
5fcc3e9
Merge branch 'develop' into ttitswor/composite-external-source
May 6, 2024
28d30fd
Fix Manual Container CI (#274)
May 6, 2024
4cc73f9
Merge branch 'develop' into ttitswor/composite-external-source
May 6, 2024
9625410
formatting fix (#277)
jitendra42 May 6, 2024
59cc75e
Remove Gitmodules (#281)
May 6, 2024
50881f1
Fix Volumes Evaluation when -a not provided (#275)
May 6, 2024
f216563
Merge branch 'develop' into ttitswor/composite-external-source
May 6, 2024
b129a22
add merge_group support (#282)
May 7, 2024
db2b4d9
Bump the python-requirements group in /classical-ml with 3 updates (#…
dependabot[bot] May 7, 2024
2fb563d
Bump the python-requirements group in /pytorch/serving with 4 updates…
dependabot[bot] May 7, 2024
8c4c746
Fix preset containers vulnerabilities (#280)
ma-pineda May 8, 2024
0615b2e
Merge branch 'develop' into ttitswor/composite-external-source
May 8, 2024
5e2f7dc
Bump super-linter/super-linter from 6.3.1 to 6.4.1 (#260)
dependabot[bot] May 8, 2024
48778eb
Bump intel-extension-for-pytorch from 2.2.0+cpu to 2.3.0 in /pytorch/…
dependabot[bot] May 10, 2024
cd671ba
Add Classical-ML tests (#287)
sramakintel May 10, 2024
1fa9a2c
Bump ossf/scorecard-action from 2.3.1 to 2.3.3 (#290)
dependabot[bot] May 10, 2024
9839575
Bump jupyterlab from 4.2.0rc0 to 4.2.0 in /classical-ml in the python…
dependabot[bot] May 10, 2024
30707b3
PyTorch 2.3.0+cpu (#292)
May 10, 2024
8694781
Merge branch 'develop' into ttitswor/composite-external-source
May 13, 2024
212868c
update runner labels to public
May 13, 2024
94a03fc
Update READMEs (#293)
May 14, 2024
fce4da9
Update Classical ML Intel SKLearn Version (#295)
May 14, 2024
dbd9566
Add TF base tests (#276)
sramakintel May 14, 2024
6bfa02f
Add Merge Group Testing (#296)
May 14, 2024
ed5d905
Documentation Automation (#273)
May 14, 2024
5f7d04e
Merge branch 'develop' into ttitswor/composite-external-source
May 14, 2024
e10fadb
Bump mkdocs-material from 9.5.21 to 9.5.22 in /docs in the python-req…
dependabot[bot] May 14, 2024
20cd0ed
Add third_party folder (#297)
jitendra42 May 15, 2024
4c73a2b
Merge branch 'develop' into ttitswor/composite-external-source
May 15, 2024
4a3b782
Add no_push to container CI (#302)
May 16, 2024
00f13a3
Add XPU IPEX Version Links (#301)
May 16, 2024
09d5320
Add Masking to Test Runner (#300)
May 16, 2024
75828d6
Merge branch 'develop' into ttitswor/composite-external-source
May 16, 2024
cb5bd9d
Update docs.yaml
May 17, 2024
101416a
Add Github workflow to update DockerHub repo description (#308)
jitendra42 May 20, 2024
6490e83
Update Integration Test to Trigger on any Variation of requirements f…
May 20, 2024
a828d90
Bump mkdocs-material from 9.5.22 to 9.5.23 in /docs in the python-req…
dependabot[bot] May 20, 2024
90dc2ec
Bump super-linter/super-linter from 6.4.1 to 6.5.0 (#312)
dependabot[bot] May 21, 2024
bc09913
Bump the python-requirements group in /classical-ml with 2 updates (#…
dependabot[bot] May 21, 2024
4175d5e
Add Group Names to dependabot.yml (#307)
May 21, 2024
a0cffa2
Bump mkdocs-material from 9.5.23 to 9.5.24 in /docs in the docs group…
dependabot[bot] May 21, 2024
7193d20
Bump setuptools from 69.5.1 to 70.0.0 in /python in the python group …
dependabot[bot] May 21, 2024
cf18e1a
Bump requests from 2.31.0 to 2.32.0 in /tensorflow/serving in the pip…
dependabot[bot] May 22, 2024
8d09b96
Add PyTorch Tests (#303)
May 22, 2024
6636c37
Switch to Miniforge3 as base for all Conda containers (#321)
ashahba May 23, 2024
5680236
Merge branch 'develop' into ttitswor/composite-external-source
May 23, 2024
9213b51
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] May 23, 2024
73a522e
Merge branch 'main' into v0.4.0-Beta
May 23, 2024
0a5b171
update reporting
May 23, 2024
dd7335f
reduce label names
May 23, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
87 changes: 87 additions & 0 deletions .github/ISSUE_TEMPLATE/bug-report.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,87 @@
# Copyright (c) 2024 Intel Corporation
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

name: Bug Report
description: Template for bug reports
labels: ["Bug"]
body:
- type: textarea
id: description
attributes:
label: Describe the bug
description: Please provide a clear and concise description of what the bug is.
placeholder: Please provide a clear and concise description of what the bug is.
validations:
required: true
- type: textarea
id: logs
attributes:
label: Error Logs
description: >-
Paste the error logs that indicate the problem in the most readable
format possible.
placeholder: Error logs
render: Markdown
validations:
required: true
- type: textarea
id: repro
attributes:
label: Reproduction Instructions
description: Step-by-step instructions one needs to follow to get this error.
placeholder: git clone https://github.com/intel/ai-containers
render: Markdown
validations:
required: true
- type: checkboxes
id: section
attributes:
label: Affected Subfolder
description: Please identify which subfolder the the bug resides.
options:
- label: classical-ml
required: false
- label: enterprise
required: false
- label: preset
required: false
- label: python
required: false
- label: pytorch
required: false
- label: tensorflow
required: false
- label: test-runner
required: false
- type: textarea
id: versions
attributes:
label: Versions
description: >-
Provide the version number for any relevant packages, applications, or
systems.
value: |
lscpu
lspci
cat /etc/os-release
docker --version
docker compose version
python --version
pip freeze
render: Markdown
validations:
required: true
- type: markdown
attributes:
value: Thank you for Contributing!
39 changes: 39 additions & 0 deletions .github/ISSUE_TEMPLATE/docs.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
# Copyright (c) 2024 Intel Corporation
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

name: Docs
description: Report an issue related to the documentation.
labels: ["Bug"]
body:
- type: textarea
id: description
attributes:
label: Describe the Issue
description: >-
A clear and concise descrption of what content is wrong and where that
content is located.
placeholder: >-
A clear and concise descrption of what content is wrong and where that
content is located.
validations:
required: true
- type: textarea
id: suggest-a-fix
attributes:
label: Suggested Remediation
description: Tell us how we could improve the documentation.
placeholder: My idea, plan, or suggestion
- type: markdown
attributes:
value: Thank you for Contributing!
35 changes: 35 additions & 0 deletions .github/ISSUE_TEMPLATE/feature-request.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
# Copyright (c) 2024 Intel Corporation
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

name: Feature Request
description: template for missing feature
labels: ["enhancement"]
body:
- type: textarea
attributes:
label: Description
description: A clear and concise description of the problem or missing capability
validations:
required: true
- type: textarea
attributes:
label: Describe the solution you'd like
description: If you have a solution in mind, please describe it.
- type: textarea
attributes:
label: Describe alternatives you've considered
description: Have you considered any alternative solutions or workarounds?
- type: markdown
attributes:
value: Thank you for Contributing!
55 changes: 43 additions & 12 deletions .github/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
# limitations under the License.

---
name: Build Container Group Action
name: Build Container Group
description: Given the inputs found below, build all containers found in a docker-compose.yaml file for a given configuration
author: tyler.titsworth@intel.com
inputs:
Expand All @@ -40,45 +40,76 @@ inputs:
required: false
default: false
type: boolean
no-start:
description: Do not start containers after building them
required: false
default: false
type: boolean
outputs:
container-group:
description: "Container Group"
value: ${{ steps.container-output.outputs.group }}
runs:
using: composite
steps:
- name: Random Number Generator
- name: Generate Project Number
shell: bash
run: echo "project-number=$(shuf -i 0-10000 -n1)" >> $GITHUB_ENV
- name: Build Containers
shell: bash
run: echo "random-number=$(shuf -i 0-1000 -n1)" >> $GITHUB_ENV
if: ${{ !fromJson(inputs.no-start) }}
run: |
REGISTRY=${{ inputs.registry }} \
REPO=${{ inputs.repo }} \
COMPOSE_PROJECT_NAME=${{ env.project-number }} \
${{ inputs.env_overrides }} docker compose -p ${{ env.project-number }} up --build --force-recreate --always-recreate-deps
working-directory: ${{ inputs.group_dir }}
- name: Build Containers
shell: bash
if: ${{ fromJson(inputs.no-start) }}
run: |
REGISTRY=${{ inputs.registry }} \
REPO=${{ inputs.repo }} \
COMPOSE_PROJECT_NAME=${{ env.random-number }} \
${{ inputs.env_overrides }} docker compose -p ${{ env.random-number }} up --build --force-recreate --always-recreate-deps
COMPOSE_PROJECT_NAME=${{ env.project-number }} \
${{ inputs.env_overrides }} docker compose -p ${{ env.project-number }} up --build --force-recreate --always-recreate-deps --no-start
working-directory: ${{ inputs.group_dir }}
- name: Push Containers
shell: bash
if: ${{ !fromJson(inputs.no-push) }}
run: |
REGISTRY=${{ inputs.registry }} \
REPO=${{ inputs.repo }} \
COMPOSE_PROJECT_NAME=${{ env.random-number }} \
${{ inputs.env_overrides }} docker compose -p ${{ env.random-number }} push
COMPOSE_PROJECT_NAME=${{ env.project-number }} \
${{ inputs.env_overrides }} docker compose -p ${{ env.project-number }} push
working-directory: ${{ inputs.group_dir }}
- name: Print Containers
id: container-output
shell: bash
run: |
REGISTRY=${{ inputs.registry }} \
mkdir matrix
images=$(REGISTRY=${{ inputs.registry }} \
REPO=${{ inputs.repo }} \
COMPOSE_PROJECT_NAME=${{ env.random-number }} \
${{ inputs.env_overrides }} docker compose -p ${{ env.random-number }} images --format json | jq --arg registry "${{ secrets.registry }}" '.[] | select(.Repository | contains($registry)) | "\(.Repository):\(.Tag)"' | jq -s '.' >> $GITHUB_STEP_SUMMARY
COMPOSE_PROJECT_NAME=${{ env.project-number }} \
${{ inputs.env_overrides }} docker compose -p ${{ env.project-number }} images --format json)
for image in $(echo $images | jq -r --arg registry "$REGISTRY" '.[] | select(.Repository | contains($registry)) | .Tag'); do
echo "$image" > matrix/$image.txt
done
echo "group=${{ inputs.group_dir }}" | tr '/' '_' >> $GITHUB_OUTPUT
working-directory: ${{ inputs.group_dir }}
- uses: actions/upload-artifact@v4
with:
name: ${{ env.project-number }}-${{ steps.container-output.outputs.group }}
path: ${{ inputs.group_dir }}/matrix/*
retention-days: 1
overwrite: true
- name: Un-Tag Containers
if: ${{ always() }}
shell: bash
run: |
REGISTRY=${{ inputs.registry }} \
REPO=${{ inputs.repo }} \
COMPOSE_PROJECT_NAME=${{ env.random-number }} \
${{ inputs.env_overrides }} docker compose -p ${{ env.random-number }} down --rmi all
COMPOSE_PROJECT_NAME=${{ env.project-number }} \
${{ inputs.env_overrides }} docker compose -p ${{ env.project-number }} down --rmi all
working-directory: ${{ inputs.group_dir }}
- name: Remove Containers
if: ${{ always() }}
Expand Down
52 changes: 46 additions & 6 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,15 +19,55 @@

version: 2
updates:
- package-ecosystem: pip
directory: /test-runner
- directory: /test-runner
groups:
test-runner:
patterns:
- "*"
package-ecosystem: pip
schedule:
interval: weekly
- package-ecosystem: github-actions
directory: /
- directory: /
package-ecosystem: github-actions
schedule:
interval: weekly
- package-ecosystem: pip
directory: /pytorch/serving
- directory: /pytorch
groups:
pytorch:
patterns:
- "*"
package-ecosystem: pip
schedule:
interval: weekly
- directory: /classical-ml
groups:
classical-ml:
patterns:
- "*"
package-ecosystem: pip
schedule:
interval: weekly
- directory: /tensorflow
groups:
tensorflow:
patterns:
- "*"
package-ecosystem: pip
schedule:
interval: weekly
- directory: /python
groups:
python:
patterns:
- "*"
package-ecosystem: pip
schedule:
interval: weekly
- directory: /docs
groups:
docs:
patterns:
- "*"
package-ecosystem: pip
schedule:
interval: weekly
36 changes: 36 additions & 0 deletions .github/dockerhub-readmes.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
{
"readmes": [
{
"fname": "./classical-ml/README.md",
"repo-name": "intel/intel-optimized-ml"
},
{
"fname": "./python/README.md",
"repo-name": "intel/python"
},
{
"fname": "./pytorch/README.md",
"repo-name": "intel/intel-extension-for-pytorch"
},
{
"fname": "./tensorflow/README.md",
"repo-name": "intel/intel-extension-for-tensorflow"
},
{
"fname": "./preset/README.md",
"repo-name": "intel/data-analytics"
},
{
"fname": "./preset/README.md",
"repo-name": "intel/classical-ml"
},
{
"fname": "./preset/README.md",
"repo-name": "intel/deep-learning"
},
{
"fname": "./preset/README.md",
"repo-name": "intel/inference-optimization"
}
]
}
2 changes: 2 additions & 0 deletions .github/linters/.isort.cfg
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
[settings]
profile=black
2 changes: 1 addition & 1 deletion .github/linters/.python-lint
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
[MESSAGES CONTROL]
disable=line-too-long, missing-module-docstring, redefined-outer-name, no-member, used-before-assignment, consider-using-with, bare-except, consider-using-dict-items, import-error, broad-exception-caught, raise-missing-from, not-an-iterable, too-few-public-methods
disable=line-too-long, missing-module-docstring, redefined-outer-name, no-member, used-before-assignment, consider-using-with, bare-except, consider-using-dict-items, import-error, broad-exception-caught, raise-missing-from, not-an-iterable, too-few-public-methods, unused-argument, unsubscriptable-object, cell-var-from-loop
4 changes: 1 addition & 3 deletions .github/linters/actionlint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,5 @@
---
self-hosted-runner:
labels:
- builder
- k8-runners
- aia-devops
- test-runner
- kubectl
Loading
Loading