Skip to content

Improve weight handling.#130

Merged
copybara-service[bot] merged 1 commit intogoogle:devfrom
veluca93:weight-handling
Apr 6, 2024
Merged

Improve weight handling.#130
copybara-service[bot] merged 1 commit intogoogle:devfrom
veluca93:weight-handling

Conversation

@veluca93
Copy link
Copy Markdown
Contributor

@veluca93 veluca93 commented Apr 5, 2024

  • Allow scaling of SFP weights
  • Allow using uncompressed weights
  • Do not try to compress weights in the main model calls
  • Reduce code duplication in weight handling with some macros

Comment thread gemma.h Outdated
Comment thread gemma.cc Outdated
Comment thread gemma.cc Outdated
Comment thread gemma.cc Outdated
Comment thread gemma.cc Outdated
Comment thread gemma.cc Outdated
Comment thread gemma.cc Outdated
Comment thread gemma.cc Outdated
Copy link
Copy Markdown
Member

@jan-wassenberg jan-wassenberg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one more for do_fread :)

Copy link
Copy Markdown
Member

@jan-wassenberg jan-wassenberg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@jan-wassenberg jan-wassenberg added the copybara-import Trigger Copybara for merging pull requests label Apr 5, 2024
Comment thread util/app.h Outdated
Comment thread gemma.cc Outdated
@veluca93 veluca93 force-pushed the weight-handling branch 2 times, most recently from 7db0c07 to 7a72690 Compare April 6, 2024 09:03
- Allow scaling of SFP weights
- Allow using uncompressed weights
- Do not try to compress weights in the main model calls
- Reduce code duplication in weight handling with some macros

Co-authored-by: Eugene Kliuchnikov <eustas@google.com>
Co-authored-by: Thomas Fischbacher <tfish@google.com>
Co-authored-by: Zoltan Szabadka <szabadka@google.com>
@copybara-service copybara-service Bot merged commit 325ef06 into google:dev Apr 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

copybara-import Trigger Copybara for merging pull requests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants