All pull requests

Pull requests

• feat(chart): optional per-caller rate limits at the ingress gateway

  #894·diazagasatya opened Oct 28, 2026Collaborator·

  ·

• feat(model-engine): add generated pod volume hooks

  #893·erichwoo-scale opened Oct 27, 2026·

  ·

• fix(model-engine): apply REDIS_AUTH_TOKEN to the AWS cache URL and keep it out of logs and user jobs

  #892·neelaypandit-scale opened Oct 27, 2026Collaborator·

  ·

• fix(model-engine): deprecate artifact image builds, file uploads and TensorRT-LLM, and reject unsafe inputs [llm-engine Security Scan]

  #887·lorenzo-norcini-scale opened Oct 16, 2026Collaborator·4 tasks done·

  ·
  9

• fix(model-engine): harden LLM endpoints, inference logging and the endpoint cache [llm-engine Security Scan]

  #886·lorenzo-norcini-scale opened Oct 16, 2026Collaborator·3 tasks done·

  ·
  8

• fix(chart): keep tenant pods off control-plane credentials and stop running cached-image binaries [llm-engine Security Scan]

  #885·lorenzo-norcini-scale opened Oct 16, 2026Collaborator·3 tasks done·

  ·
  2

• feat(chart): mount extra volumes (e.g. an S3 CA bundle) in endpoint and batch job pods

  #879·khascale opened Sep 27, 2026·

  ·

• [PLA4-44978] Remove Celery autoscaler timing logs

  #876·samuelshih opened Sep 11, 2026·

  ·

• chart: allow a gateway-only resources override (MLI-8534)

  #873·jay-tervala opened Aug 25, 2026Contributor·

  ·
  2

• ci: auto-publish model-engine helm chart to public ECR on merge (MLI-7871)

  #859·billyang-scale opened Jul 23, 2026Collaborator·

  ·
  1

• Fix model-engine image vulnerabilities

  #854·scale-ballen opened Jul 14, 2026Contributor·

  ·
  2

• fix: make DB migrations idempotent and stamp alembic after init_database

  #852·sayakmaity opened Jul 2, 2026Contributor·

  ·
  1

• [DO NOT MERGE] Also scan 'default' namespace in celery autoscaler (#828)

  #829·mayavkrishnan25 opened May 13, 2026Contributor·

  ·
  1

• feat(devx): local dev setup for control plane and full end-to-end flow (MLI-6681)

  #823·lilyz-ai opened May 7, 2026Contributor·5 tasks·

  ·
  9

• docs: SEV1 post-mortem for model-engine 500s incident (MLI-6574)

  #817·lilyz-ai opened Apr 29, 2026Contributor·2 tasks·

  ·
  28

• proposal: temporal endpoint type for Temporal activity workers (MLI-6425)

  #815·lilyz-ai opened Apr 24, 2026Contributor·3 tasks·

  ·
  5

• chore: bump model-engine image tag to latest main (2e9d0078)

  #811·lilyz-ai opened Apr 21, 2026Contributor·2 tasks·

  ·

• feat: support OpenAI 2 in Python client

  #806·scale-ballen opened Apr 13, 2026Contributor·

  ·
  3

• feat(vllm_batch): add reasoning_parser support for batch inference

  #804·lilyz-ai opened Apr 3, 2026Contributor·

  ·
  1

• fix(gcp): surface GCP Secret Manager errors and validate DB credentials

  #793·lilyz-ai opened Mar 31, 2026Contributor·3 tasks·

  ·

• chore: bump model-engine image tag to 4de8ad99

  #789·lilyz-ai opened Mar 27, 2026Contributor·2 tasks·

  ·

• fix(vllm): accept --disable-log-requests as no-op for vLLM 0.17+ compat

  #783·lilyz-ai opened Mar 19, 2026Contributor·1 task done·

  ·
  1

• fix: map disable_log_requests to --no-enable-log-requests for newer vLLM

  #779·lilyz-ai opened Mar 11, 2026Contributor·2 tasks·

  ·

• change hook weight to -1 (job has to run after config maps placed)

  #776·masbarnes opened Mar 10, 2026·

  ·
  1

• Feat: Update Readme to add how to publish model engine image

  #766·postevanus-scale opened Feb 24, 2026Contributor·

  ·