LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

lightspeed-evaluation

fork to add RAG and tool metadata and support rlsapi /v1/infer endpoint

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

2mo ago

Recent commits

Latest commits.

updates - resolves errors, add to .gitignore to avoid eval output in repo
2c0194cElle Mackey3mo ago
updates to the report script to improve recommendations/explanations
8d129ddElle Mackey3mo ago
updated reporting and running full eval, report generation with script to make it easier to repeat test runs
3401e19Elle Mackey3mo ago
added script to compare runs with specific metrics tied to question/answer sets - assumes you have 2 runs to compare
489780bElle Mackey3mo ago
adding test question files to run
aa6ea3f

Elle Mackey

3mo ago

updates to get it to work with upstream new commits, tested code that works

c6f6147Elle Mackey3mo ago

add rlsapi /v1/infer endpoint test support for RAG and tool call metrics, config/system.yaml and jira_wrong_answers.yaml are included for testing

609dc74Elle Mackey3mo ago

Merge pull request #191 from asamal4/judge-panel-doc

3049752Asutosh Samal3mo ago

Top contributors

Builders behind this project.