-
Notifications
You must be signed in to change notification settings - Fork 572
fix(litellm): fix gen_ai.request.messages to be as expected
#5255
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
fix(litellm): fix gen_ai.request.messages to be as expected
#5255
Conversation
…inal messages and handle data URLs correctly
Semver Impact of This PR🟢 Patch (bug fixes) 📋 Changelog PreviewThis is how your changes will appear in the changelog. New Features ✨
Bug Fixes 🐛Litellm
Other
Documentation 📚
Internal Changes 🔧Release
Other
🤖 This preview updates automatically when you update the PR. |
| "modality": "image", | ||
| "mime_type": mime_type, | ||
| "content": content, | ||
| } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Non-base64 data URIs incorrectly converted to blob type
Medium Severity
The _convert_message_parts function converts ALL data URIs starting with data: to blob type, but the test test_convert_message_parts_data_url_without_base64 expects non-base64 data URIs (like data:image/png,rawdata) to be converted to uri type instead. The parse_data_uri function successfully parses any data URI with a comma, so the exception-based fallback to uri type never triggers for valid non-base64 data URIs. The code needs to check for ;base64 in the data URI header before treating it as a blob.
Issues
Closes https://linear.app/getsentry/issue/TET-1635/redact-images-litellm