phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Add mangum.

Browse source
This commit is contained in:
David Manouchehri 2023-11-23 00:04:47 -05:00
parent 4d9aa7a3f7
commit 60ca43b6d9
No known key found for this signature in database
3 changed files with 7 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
litellm/proxy/lambda.py Normal file
View file

@ -0,0 +1,4 @@
from mangum import Mangum
from litellm.proxy.proxy_server import app
handler = Mangum(app, lifespan="on")

3
requirements.txt
View file

@ -13,4 +13,5 @@ pyyaml
rq rq
prisma prisma
celery celery
psutil psutil
mangum

2
template.yaml
View file

@ -46,7 +46,7 @@ Resources:
Properties: Properties:
FunctionName: !Sub "${AWS::StackName}-llmlite" FunctionName: !Sub "${AWS::StackName}-llmlite"
CodeUri: "./litellm" CodeUri: "./litellm"
Handler: proxy/lambda.lambda_handler Handler: proxy/lambda.handler
Runtime: python3.11 Runtime: python3.11
AutoPublishAlias: !Ref AliasParameter AutoPublishAlias: !Ref AliasParameter
Role: !GetAtt LambdaExecutionRole.Arn Role: !GetAtt LambdaExecutionRole.Arn