Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

idea: Enhanced thread title generation and allow users to have cost management options (for cloud APIs) #3711

Open
imtuyethan opened this issue Sep 20, 2024 · 0 comments
Labels

Comments

@imtuyethan
Copy link
Contributor

imtuyethan commented Sep 20, 2024

Problem Statement

  • For all models: Thread titles that are too long or contain special characters are currently ignored, awaiting the next generation attempt. This can lead to missing or inconsistent titles.
  • For cloud models: The second API call for thread title generation incurs additional costs, which may not be desirable for all users. For short-term solution, we have addressed here: bug: avoid 2nd remote API request to generate thread titles #3121

Feature Idea

  1. Improve Title Display (for all models):

    • Automatically truncate long titles with ellipsis (...) in the UI.
    • Show the full title on hover for easy reference.
    • Handle special characters gracefully to ensure titles are always displayed.
  2. Customizable Title Generation for Cloud Models:

    • Add settings for cloud model title generation.
    • Options:
      a) Use 2nd API call for title generation (more accurate but costs money).
      b) Use text from the initial prompt as the title (saves money, maybe less descriptive, bug: avoid 2nd remote API request to generate thread titles #3121).
    • Allow users to set this preference globally or per model.

These improvements would enhance title readability, give users more control over API usage costs, and ensure consistent title generation across all model types.

@imtuyethan imtuyethan added the type: feature request A new feature label Sep 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: No status
Development

No branches or pull requests

1 participant