v0.4.6

What's Changed

• Add AI Search example based on qdrant by @bolasim in #285
• Use blake3 for calculating content hash by @pankajroark in #286
• custom base image fixes by @joostinyi in #287
• fix live reload requirement install, bump version by @joostinyi in #289
• Drop kserve dependencies from Truss by @bolasim in #258
• Add support for python 3.10 and 3.11, dropping 3.7 by @bolasim in #291
• Make sure all examples use the latest spec_version by @bolasim in #292
• Revert "Make sure all examples use the latest spec_version" by @aspctu in #294
• Fix python dockerfile by @joostinyi in #293
• "control_server_host" now binds to both IPV4 & IPV6 by @dsarfati in #283
• Update poetry to 1.4.2 by @bolasim in #290
• Sagemaker hosting container support by @palp in #295
• hack: use root logger for model_wrapper load logs by @joostinyi in #298
• refactor base image config, remove unnecessary urllib pin by @joostinyi in #300
• Adding support for patching by @aspctu in #296
• Make context builder python version match truss by @bolasim in #302
• Skip integration tests for dev versions by @bolasim in #305
• Removing HF patch by @aspctu in #304
• Add precommit check for github actions and fix by @bolasim in #306
• Check dev version in version detect step instead by @bolasim in #307
• Skip downloading step pre-reqs if skipping step by @bolasim in #308
• Bola/skip better by @bolasim in #309
• Bump Version by @bolasim in #310
• Reorder workflows to not waste time building images we don't need by @bolasim in #311
• Change skip condition to always() to avoid automatic skips by @bolasim in #312
• small docs fixes by @philipkiely-baseten in #314
• Allow building test context builder images directly from branch by @bolasim in #315
• Fix entrypoint for published servers by @bolasim in #313
• Revert "Fix entrypoint for published servers" by @joostinyi in #318
• Fix SERVER_START_CMD environment variable by @joostinyi in #320

New Contributors

• @dsarfati made their first contribution in #283
• @palp made their first contribution in #295

Full Changelog: v0.4.5...v0.4.6

v0.4.5

What's Changed

• Justin/sam by @joostinyi in #274
• Add Flan-T5 XL truss by @spal1 in #276
• Justin/custom base image support by @joostinyi in #277
• Prep pytorch example by @bolasim in #282
• Drop pre/post process from templates by @bolasim in #279

Full Changelog: v0.4.4...v0.4.5

v0.4.4

What's Changed

• Add ControlNet example truss by @spal1 in #265
• Log model load time by @pankajroark in #263
• Implement external data support for Truss by @pankajroark in #267
• Late bind external data by @pankajroark in #269
• custom base image support by @joostinyi in #268
• Retry on load failure by @pankajroark in #271
• Revert "custom base image support (#268)" by @pankajroark in #272
• Fix an issue with pycache ignore for live reload by @pankajroark in #273

Full Changelog: v0.4.3...v0.4.4

v0.4.3

What's Changed

• Ignore irrelevant changes for live-reload by @pankajroark in #266

Full Changelog: v0.4.2...v0.4.3

v0.4.2

What's Changed

• Handle None string in accelerator spec and add tests by @bolasim in #251
• Add stable diffusion 2.1 example with weights packaged by @bolasim in #256
• GPU sharing truss example by @pankajroark in #255
• Ignore pycache files for live reload patching by @pankajroark in #257
• update truss init doc by @philipkiely-baseten in #253
• Drop duplicate copy of server code for tests by @bolasim in #259
• Document GPU Sharing Example by @bolasim in #261
• Install tar for the truss-context-builder by @bolasim in #264

Full Changelog: v0.4.1...v0.4.2

v0.4.1

What's Changed

• Additional context and clarity in processing doc by @philipkiely-baseten in #249
• Reverted #231 by @squidarth in #252

Full Changelog: v0.4.0...v0.4.1

v0.4.0

What's Changed

• Increment truss base image version by @pankajroark in #203
• Add truss patch flow tests for all python versions by @pankajroark in #205
• Make Docker images smaller by deleting pip cache by @bolasim in #211
• Filter out healthcheck endpoints from access logging by @zero1zero in #210
• For live reload, retry if model is not ready by @pankajroark in #213
• Increment version to pick up recent changes by @pankajroark in #215
• Automate publishing various artifacts on project version change by @pankajroark in #206
• Bring back table_logger fix by @pankajroark in #216
• Autogenerate types with pyre and check with mypy 3.8 by @bolasim in #214
• Implement Truss Accelerator Spec by @bolasim in #218
• make external packages docs live by @philipkiely-baseten in #220
• add whisper example truss by @joostinyi in #223
• add_python_req modified to handle duplicates, change the version if exists by @tugrulguner in #231
• Fix lint by @pankajroark in #232
• Add trusses for Stable Diffusion models by @spal1 in #233
• Fix python version in GPU base images by @bolasim in #235
• Drop legacy Kserve input validation by @bolasim in #219
• Remove Inputs Key from Truss Templates by @philipkiely-baseten in #244
• Fix integration tests by @philipkiely-baseten in #245
• Create RC for new changes by @philipkiely-baseten in #246
• non-rc version bump by @philipkiely-baseten in #248

New Contributors

• @tugrulguner made their first contribution in #231

Full Changelog: v0.3.2...v0.4.0

v0.3.2

Bug fix for draft models for older versions of python

v0.2.0

With this release, a minor version increment recognizes the overall progress made on Truss since its initial release in Summer 2022. And simplified naming for key functions improves Truss' developer experience, while carefully considered warnings and a long deprecation period ensure nothing breaks.

Interface changes

• In the Python client, truss.create() replaces truss.mk_truss().
• In the Python client, truss.load() replaces truss.from_directory().
• In the Truss handle, truss.predict() offers a shorter alternative to truss.server_predict(). To use in place of truss.docker_predict(), pass the optional kwarg use_docker=True.
• In the command-line interface, the behavior of truss predict has been updated to match the Python client.
  • Previously, truss predict ran on Docker by default, which could be overriden with RUN_LOCAL=true.
  • Now, truss predict runs without Docker by default, which can be overriden with USE_DOCKER=true.

These interface changes are intended to improve Truss' developer experience, not cause unnecessary trouble. As such, the old mk_truss() and from_directory() functions, while marked with a deprecation warning, will not be removed until the next major version update. And both server_predict() and docker_predict() will be supported in the Truss handle indefinitely.

v0.1.13rc2

Failed models should shut down server
Solve python requirements inference