Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Performance Optimizations for TP-Aware GPTQ #67

Draft
wants to merge 5 commits into
base: main
Choose a base branch
from
Draft

Performance Optimizations for TP-Aware GPTQ #67

wants to merge 5 commits into from

Commits on Mar 25, 2024

  1. TP-aware optimizations draft 

    Signed-off-by: Chih-Chieh-Yang <[email protected]>
    @cyang49
    cyang49 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    c3efc60 View commit details
    Browse the repository at this point in the history

  2. fix use_exllama logic error 

    Signed-off-by: Chih-Chieh-Yang <[email protected]>
    @cyang49
    cyang49 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    58903e5 View commit details
    Browse the repository at this point in the history

  3. Fix merge bugs 

    Signed-off-by: Chih-Chieh-Yang <[email protected]>
    @cyang49
    cyang49 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    4f65abc View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. Change default to disabling TP-aware optimizations 

    Signed-off-by: Chih-Chieh-Yang <[email protected]>
    @cyang49
    cyang49 committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    c7034df View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Merge branch 'main' into pr_tp_gptq

    @tdoublep
    tdoublep committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    b09929f View commit details
    Browse the repository at this point in the history