Skip to content

feat(llm): add streaming output feature#172

Closed
ChenZiHong-Gavin wants to merge 14 commits intoapache:mainfrom
ChenZiHong-Gavin:streaming-output
Closed

feat(llm): add streaming output feature#172
ChenZiHong-Gavin wants to merge 14 commits intoapache:mainfrom
ChenZiHong-Gavin:streaming-output

Conversation

@ChenZiHong-Gavin
Copy link
Copy Markdown
Collaborator

No description provided.

@github-actions github-actions Bot added the llm label Feb 21, 2025
@ChenZiHong-Gavin ChenZiHong-Gavin changed the title fix(llm): fix llm config feat(llm): add streaming method Feb 21, 2025
@ChenZiHong-Gavin ChenZiHong-Gavin changed the title feat(llm): add streaming method feat(llm): add streaming generate method Feb 21, 2025
@ChenZiHong-Gavin ChenZiHong-Gavin changed the title feat(llm): add streaming generate method feat(llm): add streaming output feature Feb 21, 2025
@ChenZiHong-Gavin ChenZiHong-Gavin marked this pull request as ready for review February 24, 2025 07:32
@dosubot dosubot Bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Feb 24, 2025
imbajin added a commit that referenced this pull request Mar 6, 2025
follow #172 

In order to achieve asynchronization, we compromised by changing `gremlin_generate_operator` to a synchronous generation mode. This can be changed back to an asynchronous mode after achieving full asynchronization in the subsequent agentization process.

---------

Co-authored-by: chenzihong <522023320011@smail.nju.edu.cn>
Co-authored-by: chenzihong <58508660+ChenZiHong-Gavin@users.noreply.github.com>
Co-authored-by: imbajin <jin@apache.org>
@imbajin
Copy link
Copy Markdown
Member

imbajin commented Mar 6, 2025

Close it due to #190

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request llm size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants