v0.5.0

What's Changed

• Terminate model server quicker on receiving term signal by @pankajroark in #404
• Extend config.yaml patch support by @joostinyi in #377
• Simplify config file to be more user friendly by @varunshenoy in #407
• Revert "Simplify config file to be more user friendly" by @squidarth in #414
• Silence copy commands in the log by @varunshenoy in #415
• Add support for patching external packages by @joostinyi in #417
• Truss Remote by @aspctu in #380
• New README by @philipkiely-baseten in #421
• Revert "Revert "Simplify config file to be more user friendly"" by @varunshenoy in #416
• Streaming in Truss. by @squidarth in #386
• Control server move to FastApi, plus streaming, termination support by @pankajroark in #422
• Drop truss push for now from README by @bolasim in #426
• Add hf_cache key to config.yml by @varunshenoy in #425
• initialize inference environment before starting overseer thread by @joostinyi in #433
• Move release workflow to dedicated branch by @bolasim in #434
• Bump rc to 0.4.10rc7 by @varunshenoy in #432
• Truss Remote follow-up by @aspctu in #429
• Fix lint from moving workflow by @bolasim in #438
• Remove duplicate logging file from control server by @bolasim in #437
• Adding .trussrc support by @aspctu in #436
• Loosen restriction on packaging version for package compatibility by @bolasim in #442
• truss watch cli command by @joostinyi in #428
• Drop examples from truss init by @bolasim in #441
• Bump version for release testing by @bolasim in #446
• Fix depedency for truss package and bump pre-release version by @bolasim in #448
• Remove clutter from log messages by @varunshenoy in #420
• FIX: Switch python with $PYTHON_EXECUTABLE by @varunshenoy in #453
• Keeping config.yml simple after truss push by @varunshenoy in #454
• Revert "Remove clutter from log messages (#420)" by @varunshenoy in #455
• Push publish=False by default by @bolasim in #457
• Try delay during restart to avoid port issue by @bolasim in #458
• Make --publish a flag. by @squidarth in #460
• Bump version to 0.5.0 for release after testing by @bolasim in #459
• 0.5.0 release by @bolasim in #447

New Contributors

• @varunshenoy made their first contribution in #407

Full Changelog: v0.4.9...v0.5.0

v0.4.10rc9

What's Changed

• Bola/cherrypick release fixes for inf_env by @bolasim in #435

Full Changelog: v0.4.10rc5...v0.4.10rc9

v0.4.10rc6

What's Changed

• Control server move to FastApi, plus streaming, termination support by @pankajroark in #422

Full Changelog: v0.4.10rc5...v0.4.10rc6

v0.4.10rc5

What's Changed

• New README by @philipkiely-baseten in #421
• Revert "Revert "Simplify config file to be more user friendly"" by @varunshenoy in #416
• Streaming in Truss. by @squidarth in #386

Full Changelog: v0.4.10rc4...v0.4.10rc5

v0.4.10rc4

What's Changed

• Update base-images.md by @pankajroark in #323
• changelog for Truss 0.4.8 by @philipkiely-baseten in #353
• Add custom base image example for Nemo Titanet by @bolasim in #352
• Run live reload server locally by @bolasim in #319
• Add missing dependencies by @aspctu in #354
• Crashing inference server by @aspctu in #303
• Use uvloop for uvicorn by @pankajroark in #357
• Fix integration test by @pankajroark in #359
• Convert control server from Flask to FastAPI by @bolasim in #358
• Add support for patching a truss directory by @pankajroark in #360
• Add TemporalFusionTransformer truss example by @spal1 in #367
• Remove unneeded docs files by @philipkiely-baseten in #368
• Ignore hidden files during serialization by @aspctu in #356
• Revert "Ignore hidden files during serialization" by @aspctu in #370
• Bump version to publish a new context builder at this point. by @pankajroark in #371
• Fix context builder image build by @pankajroark in #372
• add test suite for patching completeness by @joostinyi in #369
• Truss file syncer patch generation mechanism by @joostinyi in #365
• Fix async issues with control server and use the same Uvicorn setup as inference by @bolasim in #373
• increase integration test parallelism to 10 by @joostinyi in #375
• increase to 10 runners on release ci workflow by @joostinyi in #376
• Move inference server from thread to startup of control server by @bolasim in #379
• Remove re-dundant test and change to lighter image by @bolasim in #381
• Ignore hidden files by @aspctu in #374
• Revert control server to Flask instead of FastAPI by @bolasim in #385
• Move WIP local watch server to dev dependencies and dyanmic imports by @bolasim in #397
• Fix indentation in docs by @philipkiely-baseten in #403
• Create Github releases from release CI by @bolasim in #384
• Terminate model server quicker on receiving term signal by @pankajroark in #404
• Extend config.yaml patch support by @joostinyi in #377
• Simplify config file to be more user friendly by @varunshenoy in #407
• Revert "Simplify config file to be more user friendly" by @squidarth in #414
• Silence copy commands in the log by @varunshenoy in #415
• Add support for patching external packages by @joostinyi in #417
• Truss Remote by @aspctu in #380

New Contributors

• @varunshenoy made their first contribution in #407

Full Changelog: v0.4.8...v0.4.10rc4

v0.4.10rc3

What's Changed

• Extend config.yaml patch support by @joostinyi in #377

Full Changelog: v0.4.10rc1...v0.4.10rc3

v0.4.10rc1

What's Changed

• Terminate model server quicker on receiving term signal by @pankajroark in #404

Full Changelog: v0.4.9...v0.4.10rc1

v0.4.9

What's Changed

• Update base-images.md by @pankajroark in #323
• changelog for Truss 0.4.8 by @philipkiely-baseten in #353
• Add custom base image example for Nemo Titanet by @bolasim in #352
• Run live reload server locally by @bolasim in #319
• Add missing dependencies by @aspctu in #354
• Crashing inference server by @aspctu in #303
• Use uvloop for uvicorn by @pankajroark in #357
• Fix integration test by @pankajroark in #359
• Convert control server from Flask to FastAPI by @bolasim in #358
• Add support for patching a truss directory by @pankajroark in #360
• Add TemporalFusionTransformer truss example by @spal1 in #367
• Remove unneeded docs files by @philipkiely-baseten in #368
• Ignore hidden files during serialization by @aspctu in #356
• Revert "Ignore hidden files during serialization" by @aspctu in #370
• Bump version to publish a new context builder at this point. by @pankajroark in #371
• Fix context builder image build by @pankajroark in #372
• add test suite for patching completeness by @joostinyi in #369
• Truss file syncer patch generation mechanism by @joostinyi in #365
• Fix async issues with control server and use the same Uvicorn setup as inference by @bolasim in #373
• increase integration test parallelism to 10 by @joostinyi in #375
• increase to 10 runners on release ci workflow by @joostinyi in #376
• Move inference server from thread to startup of control server by @bolasim in #379
• Remove re-dundant test and change to lighter image by @bolasim in #381
• Ignore hidden files by @aspctu in #374
• Revert control server to Flask instead of FastAPI by @bolasim in #385
• Move WIP local watch server to dev dependencies and dyanmic imports by @bolasim in #397
• Fix indentation in docs by @philipkiely-baseten in #403
• Create Github releases from release CI by @bolasim in #384

Full Changelog: v0.4.8...v0.4.9

v0.4.9rc14

What's Changed

• Increment truss base image version by @pankajroark in #203
• Add truss patch flow tests for all python versions by @pankajroark in #205
• Make Docker images smaller by deleting pip cache by @bolasim in #211
• Filter out healthcheck endpoints from access logging by @zero1zero in #210
• For live reload, retry if model is not ready by @pankajroark in #213
• Increment version to pick up recent changes by @pankajroark in #215
• Automate publishing various artifacts on project version change by @pankajroark in #206
• Bring back table_logger fix by @pankajroark in #216
• Autogenerate types with pyre and check with mypy 3.8 by @bolasim in #214
• Implement Truss Accelerator Spec by @bolasim in #218
• make external packages docs live by @philipkiely-baseten in #220
• add whisper example truss by @joostinyi in #223
• add_python_req modified to handle duplicates, change the version if exists by @tugrulguner in #231
• Fix lint by @pankajroark in #232
• Add trusses for Stable Diffusion models by @spal1 in #233
• Fix python version in GPU base images by @bolasim in #235
• Drop legacy Kserve input validation by @bolasim in #219
• Remove Inputs Key from Truss Templates by @philipkiely-baseten in #244
• Fix integration tests by @philipkiely-baseten in #245
• Create RC for new changes by @philipkiely-baseten in #246
• non-rc version bump by @philipkiely-baseten in #248
• Additional context and clarity in processing doc by @philipkiely-baseten in #249
• Reverted #231 by @squidarth in #252
• Handle None string in accelerator spec and add tests by @bolasim in #251
• Add stable diffusion 2.1 example with weights packaged by @bolasim in #256
• GPU sharing truss example by @pankajroark in #255
• Ignore pycache files for live reload patching by @pankajroark in #257
• update truss init doc by @philipkiely-baseten in #253
• Drop duplicate copy of server code for tests by @bolasim in #259
• Document GPU Sharing Example by @bolasim in #261
• Install tar for the truss-context-builder by @bolasim in #264
• Ignore irrelevant changes for live-reload by @pankajroark in #266
• Add ControlNet example truss by @spal1 in #265
• Log model load time by @pankajroark in #263
• Implement external data support for Truss by @pankajroark in #267
• Late bind external data by @pankajroark in #269
• custom base image support by @joostinyi in #268
• Retry on load failure by @pankajroark in #271
• Revert "custom base image support (#268)" by @pankajroark in #272
• Fix an issue with pycache ignore for live reload by @pankajroark in #273
• Justin/sam by @joostinyi in #274
• Add Flan-T5 XL truss by @spal1 in #276
• Justin/custom base image support by @joostinyi in #277
• Prep pytorch example by @bolasim in #282
• Drop pre/post process from templates by @bolasim in #279
• Add AI Search example based on qdrant by @bolasim in #285
• Use blake3 for calculating content hash by @pankajroark in #286
• custom base image fixes by @joostinyi in #287
• fix live reload requirement install, bump version by @joostinyi in #289
• Drop kserve dependencies from Truss by @bolasim in #258
• Add support for python 3.10 and 3.11, dropping 3.7 by @bolasim in #291
• Make sure all examples use the latest spec_version by @bolasim in #292
• Revert "Make sure all examples use the latest spec_version" by @aspctu in #294
• Fix python dockerfile by @joostinyi in #293
• "control_server_host" now binds to both IPV4 & IPV6 by @dsarfati in #283
• Update poetry to 1.4.2 by @bolasim in #290
• Sagemaker hosting container support by @palp in #295
• hack: use root logger for model_wrapper load logs by @joostinyi in #298
• refactor base image config, remove unnecessary urllib pin by @joostinyi in #300
• Adding support for patching by @aspctu in #296
• Make context builder python version match truss by @bolasim in #302
• Skip integration tests for dev versions by @bolasim in #305
• Removing HF patch by @aspctu in #304
• Add precommit check for github actions and fix by @bolasim in #306
• Check dev version in version detect step instead by @bolasim in #307
• Skip downloading step pre-reqs if skipping step by @bolasim in #308
• Bola/skip better by @bolasim in #309
• Bump Version by @bolasim in #310
• Reorder workflows to not waste time building images we don't need by @bolasim in #311
• Change skip condition to always() to avoid automatic skips by @bolasim in #312
• small docs fixes by @philipkiely-baseten in #314
• Allow building test context builder images directly from branch by @bolasim in #315
• Fix entrypoint for published servers by @bolasim in #313
• Revert "Fix entrypoint for published servers" by @joostinyi in #318
• Fix SERVER_START_CMD environment variable by @joostinyi in #320
• Rework deployment workflow to build baseimage based on version changes by @bolasim in #324
• Extra version without python by @bolasim in #325
• Move test fixture to use docker build emulator by @bolasim in #326
• Bump Version to get new release image by @bolasim in #322
• Release 0.4.8 by @bolasim in #329
• Change default stream to stdout for truss logs. by @squidarth in #328
• Drop live reload from base images by @bolasim in #317
• Drop always so that we can cancel things by @bolasim in #331
• Change --use-docker flag to --no-docker flag. by @squidarth in #330
• Adding requests to server requirements by @aspctu in #333
• Bump base image version too by @bolasim in #334
• Run integration tests in parallel of 5 groups until we make them faster by @bolasim in #335
• propagate error on generation script by @joostinyi in #336
• Update base image to 20.04 to support more python versions by @bolasim in #337
• Bundle external data into docker image, rather than download at runtime by @pankajroark in #332
• Allow concurrent release jobs by @bolasim in #339
• Fix issue with dataclasses for python3.11 by @bolasim in #340
• fix python#.#-venv install for live reload with custom base images only by @joostinyi in #341
• Don't run PR workflow on main branch by @bolasim in #342
• Change log when control server starts by @jrochette in #346
• Drop b10cp...

v0.4.8

What's Changed

• Rework deployment workflow to build baseimage based on version changes by @bolasim in #324
• Extra version without python by @bolasim in #325
• Move test fixture to use docker build emulator by @bolasim in #326
• Bump Version to get new release image by @bolasim in #322
• Release 0.4.8 by @bolasim in #329
• Change default stream to stdout for truss logs. by @squidarth in #328
• Drop live reload from base images by @bolasim in #317
• Drop always so that we can cancel things by @bolasim in #331
• Change --use-docker flag to --no-docker flag. by @squidarth in #330
• Adding requests to server requirements by @aspctu in #333
• Bump base image version too by @bolasim in #334
• Run integration tests in parallel of 5 groups until we make them faster by @bolasim in #335
• propagate error on generation script by @joostinyi in #336
• Update base image to 20.04 to support more python versions by @bolasim in #337
• Bundle external data into docker image, rather than download at runtime by @pankajroark in #332
• Allow concurrent release jobs by @bolasim in #339
• Fix issue with dataclasses for python3.11 by @bolasim in #340
• fix python#.#-venv install for live reload with custom base images only by @joostinyi in #341
• Don't run PR workflow on main branch by @bolasim in #342
• Change log when control server starts by @jrochette in #346
• Drop b10cp from docker build by @bolasim in #343
• Modify custom base image venv patch by @bolasim in #344
• Always run integration tests by @bolasim in #345
• Publish 0.4.8 after testing by @bolasim in #348
• Bump truss version in control server by @bolasim in #350
• Publish 0.4.8 by @bolasim in #351

New Contributors

• @jrochette made their first contribution in #346

Full Changelog: v0.4.6...v0.4.8