Post
3016
Implemented Test-Time Diffusion Deep Researcher (TTD-DR) in OptiLLM! š
Just shipped a game-changing feature that turns any LLM into a powerful research agent. TTD-DR applies diffusion-inspired techniques to iteratively refine research reports while grounding them in real web sources.
How it works:
ā¢ Generates initial draft
ā¢ Identifies knowledge gaps
ā¢ Searches web for missing info
ā¢ Iteratively refines through "denoising" steps
ā¢ Produces comprehensive reports with 15-30+ sources
The magic? It works with ANY model so you can choose your favorite open-source models on HF!
Key results:
- 47 complex research queries tested
- Every report backed by real web sources
- Quality rivals human research analysts
- No more hallucinations on current events!
Try it:
pip install optillm
Then use "deep_research-your-model-name" as the model identifier
- Implementation: https://github.com/codelion/optillm/tree/main/optillm/plugins/deep_research
- Paper: https://arxiv.org/abs/2507.16075v1
- Sample reports: https://github.com/codelion/optillm/tree/main/optillm/plugins/deep_research/sample_reports
Special thanks to the TTD-DR paper authors for this brilliant approach!
#research #llm #opensource #inference
Just shipped a game-changing feature that turns any LLM into a powerful research agent. TTD-DR applies diffusion-inspired techniques to iteratively refine research reports while grounding them in real web sources.
How it works:
ā¢ Generates initial draft
ā¢ Identifies knowledge gaps
ā¢ Searches web for missing info
ā¢ Iteratively refines through "denoising" steps
ā¢ Produces comprehensive reports with 15-30+ sources
The magic? It works with ANY model so you can choose your favorite open-source models on HF!
Key results:
- 47 complex research queries tested
- Every report backed by real web sources
- Quality rivals human research analysts
- No more hallucinations on current events!
Try it:
pip install optillm
Then use "deep_research-your-model-name" as the model identifier
- Implementation: https://github.com/codelion/optillm/tree/main/optillm/plugins/deep_research
- Paper: https://arxiv.org/abs/2507.16075v1
- Sample reports: https://github.com/codelion/optillm/tree/main/optillm/plugins/deep_research/sample_reports
Special thanks to the TTD-DR paper authors for this brilliant approach!
#research #llm #opensource #inference